Search Results for author: Biwei Huang

Found 51 papers, 9 papers with code

Analytic DAG Constraints for Differentiable DAG Learning

no code implementations24 Mar 2025 Zhen Zhang, Ignavier Ng, Dong Gong, Yuhang Liu, Mingming Gong, Biwei Huang, Kun Zhang, Anton Van Den Hengel, Javen Qinfeng Shi

By developing the necessary theory to establish a connection between analytic functions and DAG constraints, we demonstrate that analytic functions from the set $\{f(x) = c_0 + \sum_{i=1}^{\infty}c_ix^i | \forall i > 0, c_i > 0; r = \lim_{i\rightarrow \infty}c_{i}/c_{i+1} > 0\}$ can be employed to formulate effective DAG constraints.

I Predict Therefore I Am: Is Next Token Prediction Enough to Learn Human-Interpretable Concepts from Data?

no code implementations12 Mar 2025 Yuhang Liu, Dong Gong, Erdun Gao, Zhen Zhang, Biwei Huang, Mingming Gong, Anton Van Den Hengel, Javen Qinfeng Shi

The remarkable achievements of large language models (LLMs) have led many to conclude that they exhibit a form of intelligence.

Identification of Nonparametric Dynamic Causal Structure and Latent Process in Climate System

no code implementations21 Jan 2025 Minghao Fu, Biwei Huang, Zijian Li, Yujia Zheng, Ignavier Ng, Yingyao Hu, Kun Zhang

The study of learning causal structure with latent variables has advanced the understanding of the world by uncovering causal relationships and latent factors, e. g., Causal Representation Learning (CRL).

Causal Discovery Representation Learning

Gene Regulatory Network Inference in the Presence of Selection Bias and Latent Confounders

no code implementations17 Jan 2025 Gongxu Luo, Haoyue Dai, Boyang Sun, Loka Li, Biwei Huang, Petar Stojanov, Kun Zhang

Gene Regulatory Network Inference (GRNI) aims to identify causal relationships among genes using gene expression data, providing insights into regulatory mechanisms.

Selection bias

Differentiable Causal Discovery For Latent Hierarchical Causal Models

no code implementations29 Nov 2024 Parjanya Prashant, Ignavier Ng, Kun Zhang, Biwei Huang

To the best of our knowledge, this is the first work to propose a differentiable causal discovery method for nonlinear latent hierarchical models.

Causal Discovery

Testability of Instrumental Variables in Additive Nonlinear, Non-Constant Effects Models

no code implementations19 Nov 2024 Xichen Guo, Zheng Li, Biwei Huang, Yan Zeng, Zhi Geng, Feng Xie

We address the issue of the testability of instrumental variables derived from observational data.

valid

Identifiability Analysis of Linear ODE Systems with Hidden Confounders

no code implementations29 Oct 2024 Yuanyuan Wang, Biwei Huang, Wei Huang, Xi Geng, Mingming Gong

Subsequently, we extend this analysis to encompass scenarios where hidden confounders exhibit causal dependencies, with the causal structure of latent variables described by a Directed Acyclic Graph (DAG).

Revisiting Differentiable Structure Learning: Inconsistency of $\ell_1$ Penalty and Beyond

no code implementations24 Oct 2024 Kaifeng Jin, Ignavier Ng, Kun Zhang, Biwei Huang

Recent advances in differentiable structure learning have framed the combinatorial problem of learning directed acyclic graphs as a continuous optimization problem.

A Skewness-Based Criterion for Addressing Heteroscedastic Noise in Causal Discovery

no code implementations8 Oct 2024 Yingyu Lin, Yuxing Huang, Wenqin Liu, Haoran Deng, Ignavier Ng, Kun Zhang, Mingming Gong, Yi-An Ma, Biwei Huang

Real-world data often violates the equal-variance assumption (homoscedasticity), making it essential to account for heteroscedastic noise in causal discovery.

Causal Discovery

Reinforcement Learning for Causal Discovery without Acyclicity Constraints

no code implementations24 Aug 2024 Bao Duong, Hung Le, Biwei Huang, Thin Nguyen

Recently, reinforcement learning (RL) has proved a promising alternative for conventional local heuristics in score-based approaches to learning directed acyclic causal graphs (DAGs) from observational data.

Causal Discovery Efficient Exploration +5

Rethinking State Disentanglement in Causal Reinforcement Learning

no code implementations24 Aug 2024 Haiyao Cao, Zhen Zhang, Panpan Cai, Yuhang Liu, Jinan Zou, Ehsan Abbasnejad, Biwei Huang, Mingming Gong, Anton Van Den Hengel, Javen Qinfeng Shi

We revisit this research line and find that incorporating RL-specific context can reduce unnecessary assumptions in previous identifiability analyses for latent states.

Disentanglement reinforcement-learning +2

An Empirical Examination of Balancing Strategy for Counterfactual Estimation on Time Series

no code implementations16 Aug 2024 Qiang Huang, Chuizheng Meng, Defu Cao, Biwei Huang, Yi Chang, Yan Liu

Counterfactual estimation from observations represents a critical endeavor in numerous application fields, such as healthcare and finance, with the primary challenge being the mitigation of treatment bias.

counterfactual Time Series

Boosting Efficiency in Task-Agnostic Exploration through Causal Knowledge

1 code implementation30 Jul 2024 Yupei Yang, Biwei Huang, Shikui Tu, Lei Xu

We demonstrate that causal exploration aids in learning accurate world models using fewer data and provide theoretical guarantees for its convergence.

On the Parameter Identifiability of Partially Observed Linear Causal Models

1 code implementation24 Jul 2024 Xinshuai Dong, Ignavier Ng, Biwei Huang, Yuewen Sun, Songyao Jin, Roberto Legaspi, Peter Spirtes, Kun Zhang

Linear causal models are important tools for modeling causal dependencies and yet in practice, only a subset of the variables can be observed.

parameter estimation

Optimal Kernel Choice for Score Function-based Causal Discovery

no code implementations14 Jul 2024 Wenjie Wang, Biwei Huang, Feng Liu, Xinge You, Tongliang Liu, Kun Zhang, Mingming Gong

In this paper, we propose a kernel selection method within the generalized score function that automatically selects the optimal kernel that best fits the data.

Causal Discovery

Learning Discrete Concepts in Latent Hierarchical Models

no code implementations1 Jun 2024 Lingjing Kong, Guangyi Chen, Biwei Huang, Eric P. Xing, Yuejie Chi, Kun Zhang

Learning concepts from natural high-dimensional data (e. g., images) holds potential in building human-aligned and interpretable machine learning models.

Interpretable Machine Learning

Adapting Large Multimodal Models to Distribution Shifts: The Role of In-Context Learning

1 code implementation20 May 2024 Guanglin Zhou, Zhongyi Han, Shiming Chen, Biwei Huang, Liming Zhu, Salman Khan, Xin Gao, Lina Yao

Recent studies indicate that large multimodal models (LMMs) potentially act as general-purpose assistants and are highly robust against different distributions.

In-Context Learning

Identifiable Latent Neural Causal Models

no code implementations23 Mar 2024 Yuhang Liu, Zhen Zhang, Dong Gong, Mingming Gong, Biwei Huang, Anton Van Den Hengel, Kun Zhang, Javen Qinfeng Shi

This work establishes a {sufficient} and {necessary} condition characterizing the types of distribution shifts for identifiability in the context of latent additive noise models.

Representation Learning

Federated Causal Discovery from Heterogeneous Data

1 code implementation20 Feb 2024 Loka Li, Ignavier Ng, Gongxu Luo, Biwei Huang, Guangyi Chen, Tongliang Liu, Bin Gu, Kun Zhang

This discrepancy has motivated the development of federated causal discovery (FCD) approaches.

Causal Discovery

Revealing Multimodal Contrastive Representation Learning through Latent Partial Causal Models

no code implementations9 Feb 2024 Yuhang Liu, Zhen Zhang, Dong Gong, Biwei Huang, Mingming Gong, Anton Van Den Hengel, Kun Zhang, Javen Qinfeng Shi

Multimodal contrastive representation learning methods have proven successful across a range of domains, partly due to their ability to generate meaningful shared representations of complex phenomena.

Representation Learning

Natural Counterfactuals With Necessary Backtracking

1 code implementation2 Feb 2024 Guang-Yuan Hao, Jiji Zhang, Biwei Huang, Hao Wang, Kun Zhang

Counterfactual reasoning is pivotal in human cognition and especially important for providing explanations and making decisions.

counterfactual Counterfactual Reasoning

HCVP: Leveraging Hierarchical Contrastive Visual Prompt for Domain Generalization

no code implementations18 Jan 2024 Guanglin Zhou, Zhongyi Han, Shiming Chen, Biwei Huang, Liming Zhu, Tongliang Liu, Lina Yao, Kun Zhang

Domain Generalization (DG) endeavors to create machine learning models that excel in unseen scenarios by learning invariant features.

Contrastive Learning Domain Generalization

A Versatile Causal Discovery Framework to Allow Causally-Related Hidden Variables

no code implementations18 Dec 2023 Xinshuai Dong, Biwei Huang, Ignavier Ng, Xiangchen Song, Yujia Zheng, Songyao Jin, Roberto Legaspi, Peter Spirtes, Kun Zhang

Most existing causal discovery methods rely on the assumption of no latent confounders, limiting their applicability in solving real-life problems.

Causal Discovery

Generator Identification for Linear SDEs with Additive and Multiplicative Noise

no code implementations NeurIPS 2023 Yuanyuan Wang, Xi Geng, Wei Huang, Biwei Huang, Mingming Gong

In this paper, we present conditions for identifying the generator of a linear stochastic differential equation (SDE) from the distribution of its solution process with a given fixed initial state.

Causal Inference

Identifiable Latent Polynomial Causal Models Through the Lens of Change

no code implementations24 Oct 2023 Yuhang Liu, Zhen Zhang, Dong Gong, Mingming Gong, Biwei Huang, Anton Van Den Hengel, Kun Zhang, Javen Qinfeng Shi

However, this progress rests on the assumption that the causal relationships among latent causal variables adhere strictly to linear Gaussian models.

Representation Learning

Generalized Independent Noise Condition for Estimating Causal Structure with Latent Variables

no code implementations13 Aug 2023 Feng Xie, Biwei Huang, Zhengming Chen, Ruichu Cai, Clark Glymour, Zhi Geng, Kun Zhang

To this end, we propose a Generalized Independent Noise (GIN) condition for linear non-Gaussian acyclic causal models that incorporate latent variables, which establishes the independence between a linear combination of certain measured variables and some other measured variables.

Causal-learn: Causal Discovery in Python

1 code implementation31 Jul 2023 Yujia Zheng, Biwei Huang, Wei Chen, Joseph Ramsey, Mingming Gong, Ruichu Cai, Shohei Shimizu, Peter Spirtes, Kun Zhang

Causal discovery aims at revealing causal relations from observational data, which is a fundamental task in science and engineering.

Causal Discovery

Advancing Counterfactual Inference through Nonlinear Quantile Regression

no code implementations9 Jun 2023 Shaoan Xie, Biwei Huang, Bin Gu, Tongliang Liu, Kun Zhang

Traditional counterfactual inference, under Pearls' counterfactual framework, typically depends on having access to or estimating a structural causal model.

counterfactual Counterfactual Inference +2

Interpretable Reward Redistribution in Reinforcement Learning: A Causal Approach

no code implementations NeurIPS 2023 Yudi Zhang, Yali Du, Biwei Huang, Ziyan Wang, Jun Wang, Meng Fang, Mykola Pechenizkiy

While the majority of current approaches construct the reward redistribution in an uninterpretable manner, we propose to explicitly model the contributions of state and action from a causal perspective, resulting in an interpretable reward redistribution and preserving policy invariance.

reinforcement-learning Reinforcement Learning

Structure Learning with Continuous Optimization: A Sober Look and Beyond

no code implementations4 Apr 2023 Ignavier Ng, Biwei Huang, Kun Zhang

This paper investigates in which cases continuous optimization for directed acyclic graph (DAG) structure learning can and cannot perform well and why this happens, and suggests possible directions to make the search procedure more reliable.

Emerging Synergies in Causality and Deep Generative Models: A Survey

no code implementations29 Jan 2023 Guanglin Zhou, Shaoan Xie, GuangYuan Hao, Shiming Chen, Biwei Huang, Xiwei Xu, Chen Wang, Liming Zhu, Lina Yao, Kun Zhang

In the field of artificial intelligence (AI), the quest to understand and model data-generating processes (DGPs) is of paramount importance.

Causal Identification Fairness +2

Latent Hierarchical Causal Structure Discovery with Rank Constraints

no code implementations1 Oct 2022 Biwei Huang, Charles Jia Han Low, Feng Xie, Clark Glymour, Kun Zhang

Most causal discovery procedures assume that there are no latent confounders in the system, which is often violated in real-world problems.

Causal Discovery

Identifiable Latent Causal Content for Domain Adaptation under Latent Covariate Shift

no code implementations30 Aug 2022 Yuhang Liu, Zhen Zhang, Dong Gong, Mingming Gong, Biwei Huang, Anton Van Den Hengel, Kun Zhang, Javen Qinfeng Shi

Within this new paradigm, we present an intricate causal generative model by introducing latent noises across domains, along with a latent content variable and a latent style variable to achieve more nuanced rendering of observational data.

Domain Adaptation

Identifying Weight-Variant Latent Causal Models

no code implementations30 Aug 2022 Yuhang Liu, Zhen Zhang, Dong Gong, Mingming Gong, Biwei Huang, Anton Van Den Hengel, Kun Zhang, Javen Qinfeng Shi

The task of causal representation learning aims to uncover latent higher-level causal representations that affect lower-level observations.

Representation Learning

Factored Adaptation for Non-Stationary Reinforcement Learning

no code implementations30 Mar 2022 Fan Feng, Biwei Huang, Kun Zhang, Sara Magliacane

Dealing with non-stationarity in environments (e. g., in the transition dynamics) and objectives (e. g., in the reward functions) is a challenging problem that is crucial in real-world applications of reinforcement learning (RL).

reinforcement-learning Reinforcement Learning +1

Action-Sufficient State Representation Learning for Control with Structural Constraints

no code implementations12 Oct 2021 Biwei Huang, Chaochao Lu, Liu Leqi, José Miguel Hernández-Lobato, Clark Glymour, Bernhard Schölkopf, Kun Zhang

Perceived signals in real-world scenarios are usually high-dimensional and noisy, and finding and using their representation that contains essential and sufficient information required by downstream decision-making tasks will help improve computational efficiency and generalization ability in the tasks.

Computational Efficiency Decision Making +1

AdaRL: What, Where, and How to Adapt in Transfer Reinforcement Learning

1 code implementation ICLR 2022 Biwei Huang, Fan Feng, Chaochao Lu, Sara Magliacane, Kun Zhang

We show that by explicitly leveraging this compact representation to encode changes, we can efficiently adapt the policy to the target domain, in which only a few samples are needed and further policy optimization is avoided.

Atari Games reinforcement-learning +2

FRITL: A Hybrid Method for Causal Discovery in the Presence of Latent Confounders

no code implementations26 Mar 2021 Wei Chen, Kun Zhang, Ruichu Cai, Biwei Huang, Joseph Ramsey, Zhifeng Hao, Clark Glymour

The first step of our method uses the FCI procedure, which allows confounders and is able to produce asymptotically correct results.

Causal Discovery

Score-based Causal Discovery from Heterogeneous Data

no code implementations1 Jan 2021 Chenwei Ding, Biwei Huang, Mingming Gong, Kun Zhang, Tongliang Liu, DaCheng Tao

Most algorithms in causal discovery consider a single domain with a fixed distribution.

Causal Discovery

Generalized Independent Noise Condition for Estimating Latent Variable Causal Graphs

no code implementations NeurIPS 2020 Feng Xie, Ruichu Cai, Biwei Huang, Clark Glymour, Zhifeng Hao, Kun Zhang

Despite its success in certain domains, most existing methods focus on causal relations between observed variables, while in many scenarios the observed ones may not be the underlying causal variables (e. g., image pixels), but are generated by latent causal variables or confounders that are causally related.

Causal Discovery

Domain Adaptation as a Problem of Inference on Graphical Models

1 code implementation NeurIPS 2020 Kun Zhang, Mingming Gong, Petar Stojanov, Biwei Huang, Qingsong Liu, Clark Glymour

Such a graphical model distinguishes between constant and varied modules of the distribution and specifies the properties of the changes across domains, which serves as prior knowledge of the changing modules for the purpose of deriving the posterior of the target variable $Y$ in the target domain.

Bayesian Inference Unsupervised Domain Adaptation

Causal Discovery and Forecasting in Nonstationary Environments with State-Space Models

no code implementations26 May 2019 Biwei Huang, Kun Zhang, Mingming Gong, Clark Glymour

In many scientific fields, such as economics and neuroscience, we are often faced with nonstationary time series, and concerned with both finding causal relations and forecasting the values of variables of interest, both of which are particularly challenging in such nonstationary environments.

Bayesian Inference Causal Discovery +3

Causal Discovery from Heterogeneous/Nonstationary Data with Independent Changes

no code implementations5 Mar 2019 Biwei Huang, Kun Zhang, Jiji Zhang, Joseph Ramsey, Ruben Sanchez-Romero, Clark Glymour, Bernhard Schölkopf

In this paper, we develop a framework for causal discovery from such data, called Constraint-based causal Discovery from heterogeneous/NOnstationary Data (CD-NOD), to find causal skeleton and directions and estimate the properties of mechanism changes.

Causal Discovery

Diagnosis of Autism Spectrum Disorder by Causal Influence Strength Learned from Resting-State fMRI Data

no code implementations27 Jan 2019 Biwei Huang, Kun Zhang, Ruben Sanchez-Romero, Joseph Ramsey, Madelyn Glymour, Clark Glymour

A substantial body of researches use Pearson's correlation coefficients, mutual information, or partial correlation to investigate the differences in brain connectivities between ASD and typical controls from functional Magnetic Resonance Imaging (fMRI).

Causal Discovery Diagnostic +1

Multi-domain Causal Structure Learning in Linear Systems

no code implementations NeurIPS 2018 Amiremad Ghassami, Negar Kiyavash, Biwei Huang, Kun Zhang

We study the problem of causal structure learning in linear systems from observational data given in multiple domains, across which the causal coefficients and/or the distribution of the exogenous noises may vary.

Causal Generative Domain Adaptation Networks

no code implementations12 Apr 2018 Mingming Gong, Kun Zhang, Biwei Huang, Clark Glymour, DaCheng Tao, Kayhan Batmanghelich

For this purpose, we first propose a flexible Generative Domain Adaptation Network (G-DAN) with specific latent variables to capture changes in the generating process of features across domains.

Computational Efficiency Domain Adaptation

Cannot find the paper you are looking for? You can Submit a new open access paper.