no code implementations • 24 Mar 2025 • Zhen Zhang, Ignavier Ng, Dong Gong, Yuhang Liu, Mingming Gong, Biwei Huang, Kun Zhang, Anton Van Den Hengel, Javen Qinfeng Shi
By developing the necessary theory to establish a connection between analytic functions and DAG constraints, we demonstrate that analytic functions from the set $\{f(x) = c_0 + \sum_{i=1}^{\infty}c_ix^i | \forall i > 0, c_i > 0; r = \lim_{i\rightarrow \infty}c_{i}/c_{i+1} > 0\}$ can be employed to formulate effective DAG constraints.
no code implementations • 12 Mar 2025 • Yuhang Liu, Dong Gong, Erdun Gao, Zhen Zhang, Biwei Huang, Mingming Gong, Anton Van Den Hengel, Javen Qinfeng Shi
The remarkable achievements of large language models (LLMs) have led many to conclude that they exhibit a form of intelligence.
no code implementations • 21 Jan 2025 • Minghao Fu, Biwei Huang, Zijian Li, Yujia Zheng, Ignavier Ng, Yingyao Hu, Kun Zhang
The study of learning causal structure with latent variables has advanced the understanding of the world by uncovering causal relationships and latent factors, e. g., Causal Representation Learning (CRL).
no code implementations • 17 Jan 2025 • Gongxu Luo, Haoyue Dai, Boyang Sun, Loka Li, Biwei Huang, Petar Stojanov, Kun Zhang
Gene Regulatory Network Inference (GRNI) aims to identify causal relationships among genes using gene expression data, providing insights into regulatory mechanisms.
no code implementations • 29 Nov 2024 • Parjanya Prashant, Ignavier Ng, Kun Zhang, Biwei Huang
To the best of our knowledge, this is the first work to propose a differentiable causal discovery method for nonlinear latent hierarchical models.
no code implementations • 19 Nov 2024 • Xichen Guo, Zheng Li, Biwei Huang, Yan Zeng, Zhi Geng, Feng Xie
We address the issue of the testability of instrumental variables derived from observational data.
no code implementations • 29 Oct 2024 • Yuanyuan Wang, Biwei Huang, Wei Huang, Xi Geng, Mingming Gong
Subsequently, we extend this analysis to encompass scenarios where hidden confounders exhibit causal dependencies, with the causal structure of latent variables described by a Directed Acyclic Graph (DAG).
no code implementations • 24 Oct 2024 • Kaifeng Jin, Ignavier Ng, Kun Zhang, Biwei Huang
Recent advances in differentiable structure learning have framed the combinatorial problem of learning directed acyclic graphs as a continuous optimization problem.
no code implementations • 8 Oct 2024 • Yingyu Lin, Yuxing Huang, Wenqin Liu, Haoran Deng, Ignavier Ng, Kun Zhang, Mingming Gong, Yi-An Ma, Biwei Huang
Real-world data often violates the equal-variance assumption (homoscedasticity), making it essential to account for heteroscedastic noise in causal discovery.
no code implementations • 24 Aug 2024 • Bao Duong, Hung Le, Biwei Huang, Thin Nguyen
Recently, reinforcement learning (RL) has proved a promising alternative for conventional local heuristics in score-based approaches to learning directed acyclic causal graphs (DAGs) from observational data.
no code implementations • 24 Aug 2024 • Haiyao Cao, Zhen Zhang, Panpan Cai, Yuhang Liu, Jinan Zou, Ehsan Abbasnejad, Biwei Huang, Mingming Gong, Anton Van Den Hengel, Javen Qinfeng Shi
We revisit this research line and find that incorporating RL-specific context can reduce unnecessary assumptions in previous identifiability analyses for latent states.
no code implementations • 16 Aug 2024 • Qiang Huang, Chuizheng Meng, Defu Cao, Biwei Huang, Yi Chang, Yan Liu
Counterfactual estimation from observations represents a critical endeavor in numerous application fields, such as healthcare and finance, with the primary challenge being the mitigation of treatment bias.
no code implementations • 30 Jul 2024 • Yupei Yang, Biwei Huang, Fan Feng, Xinyue Wang, Shikui Tu, Lei Xu
General intelligence requires quick adaption across tasks.
1 code implementation • 30 Jul 2024 • Yupei Yang, Biwei Huang, Shikui Tu, Lei Xu
We demonstrate that causal exploration aids in learning accurate world models using fewer data and provide theoretical guarantees for its convergence.
1 code implementation • 24 Jul 2024 • Xinshuai Dong, Ignavier Ng, Biwei Huang, Yuewen Sun, Songyao Jin, Roberto Legaspi, Peter Spirtes, Kun Zhang
Linear causal models are important tools for modeling causal dependencies and yet in practice, only a subset of the variables can be observed.
no code implementations • 14 Jul 2024 • Wenjie Wang, Biwei Huang, Feng Liu, Xinge You, Tongliang Liu, Kun Zhang, Mingming Gong
In this paper, we propose a kernel selection method within the generalized score function that automatically selects the optimal kernel that best fits the data.
no code implementations • 1 Jun 2024 • Lingjing Kong, Guangyi Chen, Biwei Huang, Eric P. Xing, Yuejie Chi, Kun Zhang
Learning concepts from natural high-dimensional data (e. g., images) holds potential in building human-aligned and interpretable machine learning models.
1 code implementation • 20 May 2024 • Guanglin Zhou, Zhongyi Han, Shiming Chen, Biwei Huang, Liming Zhu, Salman Khan, Xin Gao, Lina Yao
Recent studies indicate that large multimodal models (LMMs) potentially act as general-purpose assistants and are highly robust against different distributions.
no code implementations • 23 Mar 2024 • Yuhang Liu, Zhen Zhang, Dong Gong, Mingming Gong, Biwei Huang, Anton Van Den Hengel, Kun Zhang, Javen Qinfeng Shi
This work establishes a {sufficient} and {necessary} condition characterizing the types of distribution shifts for identifiability in the context of latent additive noise models.
1 code implementation • 20 Feb 2024 • Loka Li, Ignavier Ng, Gongxu Luo, Biwei Huang, Guangyi Chen, Tongliang Liu, Bin Gu, Kun Zhang
This discrepancy has motivated the development of federated causal discovery (FCD) approaches.
no code implementations • 9 Feb 2024 • Yuhang Liu, Zhen Zhang, Dong Gong, Biwei Huang, Mingming Gong, Anton Van Den Hengel, Kun Zhang, Javen Qinfeng Shi
Multimodal contrastive representation learning methods have proven successful across a range of domains, partly due to their ability to generate meaningful shared representations of complex phenomena.
1 code implementation • 2 Feb 2024 • Guang-Yuan Hao, Jiji Zhang, Biwei Huang, Hao Wang, Kun Zhang
Counterfactual reasoning is pivotal in human cognition and especially important for providing explanations and making decisions.
no code implementations • 18 Jan 2024 • Guanglin Zhou, Zhongyi Han, Shiming Chen, Biwei Huang, Liming Zhu, Tongliang Liu, Lina Yao, Kun Zhang
Domain Generalization (DG) endeavors to create machine learning models that excel in unseen scenarios by learning invariant features.
no code implementations • 18 Dec 2023 • Xinshuai Dong, Biwei Huang, Ignavier Ng, Xiangchen Song, Yujia Zheng, Songyao Jin, Roberto Legaspi, Peter Spirtes, Kun Zhang
Most existing causal discovery methods rely on the assumption of no latent confounders, limiting their applicability in solving real-life problems.
no code implementations • 6 Dec 2023 • Ziyan Wang, Yali Du, Yudi Zhang, Meng Fang, Biwei Huang
Offline Multi-agent Reinforcement Learning (MARL) is valuable in scenarios where online interaction is impractical or risky.
Multi-agent Reinforcement Learning
reinforcement-learning
+1
no code implementations • NeurIPS 2023 • Yuanyuan Wang, Xi Geng, Wei Huang, Biwei Huang, Mingming Gong
In this paper, we present conditions for identifying the generator of a linear stochastic differential equation (SDE) from the distribution of its solution process with a given fixed initial state.
no code implementations • 24 Oct 2023 • Yuhang Liu, Zhen Zhang, Dong Gong, Mingming Gong, Biwei Huang, Anton Van Den Hengel, Kun Zhang, Javen Qinfeng Shi
However, this progress rests on the assumption that the causal relationships among latent causal variables adhere strictly to linear Gaussian models.
no code implementations • 13 Aug 2023 • Feng Xie, Biwei Huang, Zhengming Chen, Ruichu Cai, Clark Glymour, Zhi Geng, Kun Zhang
To this end, we propose a Generalized Independent Noise (GIN) condition for linear non-Gaussian acyclic causal models that incorporate latent variables, which establishes the independence between a linear combination of certain measured variables and some other measured variables.
1 code implementation • 31 Jul 2023 • Yujia Zheng, Biwei Huang, Wei Chen, Joseph Ramsey, Mingming Gong, Ruichu Cai, Shohei Shimizu, Peter Spirtes, Kun Zhang
Causal discovery aims at revealing causal relations from observational data, which is a fundamental task in science and engineering.
no code implementations • 9 Jun 2023 • Shaoan Xie, Biwei Huang, Bin Gu, Tongliang Liu, Kun Zhang
Traditional counterfactual inference, under Pearls' counterfactual framework, typically depends on having access to or estimating a structural causal model.
no code implementations • NeurIPS 2023 • Yudi Zhang, Yali Du, Biwei Huang, Ziyan Wang, Jun Wang, Meng Fang, Mykola Pechenizkiy
While the majority of current approaches construct the reward redistribution in an uninterpretable manner, we propose to explicitly model the contributions of state and action from a causal perspective, resulting in an interpretable reward redistribution and preserving policy invariance.
no code implementations • 4 Apr 2023 • Ignavier Ng, Biwei Huang, Kun Zhang
This paper investigates in which cases continuous optimization for directed acyclic graph (DAG) structure learning can and cannot perform well and why this happens, and suggests possible directions to make the search procedure more reliable.
no code implementations • 29 Jan 2023 • Guanglin Zhou, Shaoan Xie, GuangYuan Hao, Shiming Chen, Biwei Huang, Xiwei Xu, Chen Wang, Liming Zhu, Lina Yao, Kun Zhang
In the field of artificial intelligence (AI), the quest to understand and model data-generating processes (DGPs) is of paramount importance.
no code implementations • 1 Oct 2022 • Biwei Huang, Charles Jia Han Low, Feng Xie, Clark Glymour, Kun Zhang
Most causal discovery procedures assume that there are no latent confounders in the system, which is often violated in real-world problems.
no code implementations • 30 Aug 2022 • Yuhang Liu, Zhen Zhang, Dong Gong, Mingming Gong, Biwei Huang, Anton Van Den Hengel, Kun Zhang, Javen Qinfeng Shi
Within this new paradigm, we present an intricate causal generative model by introducing latent noises across domains, along with a latent content variable and a latent style variable to achieve more nuanced rendering of observational data.
no code implementations • 30 Aug 2022 • Yuhang Liu, Zhen Zhang, Dong Gong, Mingming Gong, Biwei Huang, Anton Van Den Hengel, Kun Zhang, Javen Qinfeng Shi
The task of causal representation learning aims to uncover latent higher-level causal representations that affect lower-level observations.
no code implementations • 30 Mar 2022 • Fan Feng, Biwei Huang, Kun Zhang, Sara Magliacane
Dealing with non-stationarity in environments (e. g., in the transition dynamics) and objectives (e. g., in the reward functions) is a challenging problem that is crucial in real-world applications of reinforcement learning (RL).
no code implementations • 12 Oct 2021 • Biwei Huang, Chaochao Lu, Liu Leqi, José Miguel Hernández-Lobato, Clark Glymour, Bernhard Schölkopf, Kun Zhang
Perceived signals in real-world scenarios are usually high-dimensional and noisy, and finding and using their representation that contains essential and sufficient information required by downstream decision-making tasks will help improve computational efficiency and generalization ability in the tasks.
1 code implementation • ICLR 2022 • Biwei Huang, Fan Feng, Chaochao Lu, Sara Magliacane, Kun Zhang
We show that by explicitly leveraging this compact representation to encode changes, we can efficiently adapt the policy to the target domain, in which only a few samples are needed and further policy optimization is avoided.
no code implementations • 26 Mar 2021 • Wei Chen, Kun Zhang, Ruichu Cai, Biwei Huang, Joseph Ramsey, Zhifeng Hao, Clark Glymour
The first step of our method uses the FCI procedure, which allows confounders and is able to produce asymptotically correct results.
no code implementations • 1 Jan 2021 • Chenwei Ding, Biwei Huang, Mingming Gong, Kun Zhang, Tongliang Liu, DaCheng Tao
Most algorithms in causal discovery consider a single domain with a fixed distribution.
no code implementations • 16 Dec 2020 • Chaochao Lu, Biwei Huang, Ke Wang, José Miguel Hernández-Lobato, Kun Zhang, Bernhard Schölkopf
We propose counterfactual RL algorithms to learn both population-level and individual-level policies.
no code implementations • NeurIPS 2020 • Feng Xie, Ruichu Cai, Biwei Huang, Clark Glymour, Zhifeng Hao, Kun Zhang
Despite its success in certain domains, most existing methods focus on causal relations between observed variables, while in many scenarios the observed ones may not be the underlying causal variables (e. g., image pixels), but are generated by latent causal variables or confounders that are causally related.
1 code implementation • NeurIPS 2020 • Kun Zhang, Mingming Gong, Petar Stojanov, Biwei Huang, Qingsong Liu, Clark Glymour
Such a graphical model distinguishes between constant and varied modules of the distribution and specifies the properties of the changes across domains, which serves as prior knowledge of the changing modules for the purpose of deriving the posterior of the target variable $Y$ in the target domain.
1 code implementation • NeurIPS 2019 • Biwei Huang, Kun Zhang, Pengtao Xie, Mingming Gong, Eric P. Xing, Clark Glymour
The learned SSCM gives the specific causal knowledge for each individual as well as the general trend over the population.
no code implementations • 26 May 2019 • Biwei Huang, Kun Zhang, Mingming Gong, Clark Glymour
In many scientific fields, such as economics and neuroscience, we are often faced with nonstationary time series, and concerned with both finding causal relations and forecasting the values of variables of interest, both of which are particularly challenging in such nonstationary environments.
no code implementations • 5 Mar 2019 • Biwei Huang, Kun Zhang, Jiji Zhang, Joseph Ramsey, Ruben Sanchez-Romero, Clark Glymour, Bernhard Schölkopf
In this paper, we develop a framework for causal discovery from such data, called Constraint-based causal Discovery from heterogeneous/NOnstationary Data (CD-NOD), to find causal skeleton and directions and estimate the properties of mechanism changes.
no code implementations • 27 Jan 2019 • Biwei Huang, Kun Zhang, Ruben Sanchez-Romero, Joseph Ramsey, Madelyn Glymour, Clark Glymour
A substantial body of researches use Pearson's correlation coefficients, mutual information, or partial correlation to investigate the differences in brain connectivities between ASD and typical controls from functional Magnetic Resonance Imaging (fMRI).
no code implementations • NeurIPS 2018 • Amiremad Ghassami, Negar Kiyavash, Biwei Huang, Kun Zhang
We study the problem of causal structure learning in linear systems from observational data given in multiple domains, across which the causal coefficients and/or the distribution of the exogenous noises may vary.
no code implementations • 12 Apr 2018 • Mingming Gong, Kun Zhang, Biwei Huang, Clark Glymour, DaCheng Tao, Kayhan Batmanghelich
For this purpose, we first propose a flexible Generative Domain Adaptation Network (G-DAN) with specific latent variables to capture changes in the generating process of features across domains.
no code implementations • 27 Sep 2015 • Kun Zhang, Biwei Huang, Jiji Zhang, Bernhard Schölkopf, Clark Glymour
Third, we develop a method for visualizing the nonstationarity of causal modules.