Search Results for author:
Found 14 papers, 5 papers with code
Implicit Bilevel Optimization: Differentiating through Bilevel Optimization Programming
Integrating bilevel mathematical programming within deep learning is thus an essential objective for the Machine Learning community.
PDEBENCH: An Extensive Benchmark for Scientific Machine Learning
With those metrics we identify tasks which are challenging for recent ML methods and propose these tasks as future challenges for the community.
Human-Centric Research for NLP: Towards a Definition and Guiding Questions
With Human-Centric Research (HCR) we can steer research activities so that the research outcome is beneficial for human stakeholders, such as end users.
Principle of Relevant Information for Graph Sparsification
Graph sparsification aims to reduce the number of edges of a graph while maintaining its structural properties.
BiGrad: Differentiating through Bilevel Optimization Programming
We describe a class of gradient estimators for the combinatorial case which reduces the requirements in term of computation complexity; for the continuous variables case the gradient computation takes advantage of push-back approach (i. e. vector-jacobian product) for an efficient implementation.
Gated Information Bottleneck for Generalization in Sequential Environments
By learning minimum sufficient representations from training data, the information bottleneck (IB) approach has demonstrated its effectiveness to improve generalization in different AI applications.
Adversarial Robustness
Out of Distribution (OOD) Detection
+1
Measuring Dependence with Matrix-based Entropy Functional
Measuring the dependence of data plays a central role in statistics and machine learning.
Continual Invariant Risk Minimization
Empirical risk minimization can lead to poor generalization behaviour on unseen environments if the learned model does not capture invariant feature represen- tations.
Modular-Relatedness for Continual Learning
In this paper, we propose a continual learning (CL) technique that is beneficial to sequential task learners by improving their retained accuracy and reducing catastrophic forgetting.
Bilevel Continual Learning
This paper presents Bilevel Continual Learning (BiCL), a general framework for continual learning that fuses bilevel optimization and recent advances in meta-learning for deep neural networks.
Learning an Interpretable Graph Structure in Multi-Task Learning
We present a novel methodology to jointly perform multi-task learning and infer intrinsic relationship among tasks by an interpretable and sparse graph.
Towards Interpretable Multi-Task Learning Using Bilevel Programming
Interpretable Multi-Task Learning can be expressed as learning a sparse graph of the task relationship based on the prediction performance of the learned models.
Measuring the Discrepancy between Conditional Distributions: Methods, Properties and Applications
We propose a simple yet powerful test statistic to quantify the discrepancy between two conditional distributions.
Efficient and Scalable Multi-task Regression on Massive Number of Tasks
Scaling up MTL methods to problems with a tremendous number of tasks is a big challenge.
