Search Results for author:
Found 82 papers, 38 papers with code
ClimateBench-M: A Multi-Modal Climate Data Benchmark with a Simple Generative Method
Climate science studies the structure and dynamics of Earth's climate system and seeks to understand how climate changes over time, where the data is usually stored in the format of time series, recording the climate features, geolocation, time attributes, etc.
GTR: Graph-Table-RAG for Cross-Table Question Answering
Beyond pure text, a substantial amount of knowledge is stored in tables.
ResMoE: Space-efficient Compression of Mixture of Experts LLMs via Residual Restoration
Mixture-of-Experts (MoE) Transformer, the backbone architecture of multiple phenomenal language models, leverages sparsity by activating only a fraction of model parameters for each input token.
Language in the Flow of Time: Time-Series-Paired Texts Weaved into a Unified Temporal Narrative
While many advances in time series models focus exclusively on numerical data, research on multimodal time series, particularly those involving contextual textual information commonly encountered in real-world scenarios, remains in its infancy.
PyG-SSL: A Graph Self-Supervised Learning Toolkit
Graph Self-Supervised Learning (SSL) has emerged as a pivotal area of research in recent years.
APEX$^2$: Adaptive and Extreme Summarization for Personalized Knowledge Graphs
Furthermore, when the size constraint of PKG is extremely small, the existing methods cannot distinguish which facts are more of immediate interest and guarantee the utility of the summarized PKG.
Trustworthy Transfer Learning: A Survey
In addition to knowledge transferability, we review the impact of trustworthiness on transfer learning, e. g., whether the transferred knowledge is adversarially robust or algorithmically fair, how to transfer the knowledge under privacy-preserving constraints, etc.
Can Graph Neural Networks Learn Language with Extremely Weak Text Supervision?
In this work, to address these issues, we leverage multi-modal prompt learning to effectively adapt pre-trained GNN to downstream tasks and data, given only a few semantically labeled samples, each with extremely weak text supervision.
Provably Extending PageRank-based Local Clustering Algorithm to Weighted Directed Graphs with Self-Loops and to Hypergraphs
Specifically, leveraging PageRank, we propose two algorithms: GeneralACL for graphs and HyperACL for hypergraphs.
Transforming the Hybrid Cloud for Emerging AI Workloads
This white paper, developed through close collaboration between IBM Research and UIUC researchers within the IIDAI Institute, envisions transforming hybrid cloud systems to meet the growing complexity of AI workloads through innovative, full-stack co-design approaches, emphasizing usability, manageability, affordability, adaptability, efficiency, and scalability.
PageRank Bandits for Link Prediction
Link prediction is a critical problem in graph learning with broad applications such as recommender systems and knowledge graph completion.
Co-clustering for Federated Recommender System
In this paper, we delve into the inefficiencies of the K-Means method in client grouping, attributing failures due to the high dimensionality as well as data sparsity occurring in FRS, and propose CoFedRec, a novel Co-clustering Federated Recommendation mechanism, to address clients heterogeneity and enhance the collaborative filtering within the federated framework.
LLM-Forest: Ensemble Learning of LLMs with Graph-Augmented Prompts for Data Imputation
Missing data imputation is a critical challenge in various domains, such as healthcare and finance, where data completeness is vital for accurate analysis.
Hypergraphs as Weighted Directed Self-Looped Graphs: Spectral Properties, Clustering, Cheeger Inequality
Then, we prove that the normalized hypergraph Laplacian is associated with the NCut value, which inspires our HyperClus-G algorithm for spectral clustering on EDVW hypergraphs.
What Do LLMs Need to Understand Graphs: A Survey of Parametric Representation of Graphs
We believe this kind of parametric representation of graphs, graph laws, can be a solution for making LLMs understand graph data as the input.
Online Multi-modal Root Cause Analysis
In this paper, we introduce OCEAN, a novel online multi-modal causal structure learning method for root cause localization.
AdaRC: Mitigating Graph Structure Shifts during Test-Time
However, existing TTA algorithms are primarily designed for attribute shifts in vision tasks, where samples are independent.
Fair Anomaly Detection For Imbalanced Groups
Due to the imbalanced nature between protected and unprotected groups and the imbalanced distributions of normal examples and anomalies, the learning objectives of most existing anomaly detection methods tend to solely concentrate on the dominating unprotected group.
Towards Multi-view Graph Anomaly Detection with Similarity-Guided Contrastive Clustering
Theoretically, we show that the proposed similarity-guided loss is a variant of contrastive learning loss, and how it alleviates the issue of unreliable pseudo-labels with the connection to graph spectral clustering.
Meta Clustering of Neural Bandits
The contextual bandit has been identified as a powerful framework to formulate the recommendation process as a sequential decision-making process, where each item is regarded as an arm and the objective is to minimize the regret of $T$ rounds.
Generating Fine-Grained Causality in Climate Time Series Data for Forecasting and Anomaly Detection
Understanding the causal interaction of time series variables can contribute to time series data analysis for many real-world applications, such as climate forecasting and extreme weather alerts.
SpherE: Expressive and Interpretable Knowledge Graph Embedding for Set Retrieval
We show that the set retrieval highly depends on expressive modeling of many-to-many relations, and propose a new KG embedding model SpherE to address this problem.
Neural Active Learning Beyond Bandits
We study both stream-based and pool-based active learning with neural network approximations.
Heterogeneous Contrastive Learning for Foundation Models and Beyond
In the era of big data and Artificial Intelligence, an emerging paradigm is to utilize contrastive self-supervised learning to model large-scale heterogeneous data.
VCR-Graphormer: A Mini-batch Graph Transformer via Virtual Connections
Therefore, mini-batch training for graph transformers is a promising direction, but limited samples in each mini-batch can not support effective dense attention to encode informative representations.
Automated Contrastive Learning Strategy Search for Time Series
In this paper, we present an Automated Machine Learning (AutoML) practice at Microsoft, which automatically learns CLS for time series datasets and tasks, namely Automated Contrastive Learning (AutoCL).
Logic Query of Thoughts: Guiding Large Language Models to Answer Complex Logic Queries with Knowledge Graphs
Through the utilization of both knowledge graph reasoning and LLMs, it successfully derives answers for each subquestion.
Towards Unified Multi-Modal Personalization: Large Vision-Language Models for Generative Recommendation and Beyond
Developing a universal model that can effectively harness heterogeneous resources and respond to a wide range of personalized needs has been a longstanding community aspiration.
Multi-modal Causal Structure Learning and Root Cause Analysis
Effective root cause analysis (RCA) is vital for swiftly restoring services, minimizing losses, and ensuring the smooth operation and management of complex systems.
Neural Contextual Bandits for Personalized Recommendation
Different from existing related tutorials, (1) we focus on the exploration perspective of contextual bandits to alleviate the ``Matthew Effect'' in the recommender systems, i. e., the rich get richer and the poor get poorer, concerning the popularity of items; (2) in addition to the conventional linear contextual bandits, we will also dedicated to neural contextual bandits which have emerged as an important branch in recent years, to investigate how neural networks benefit contextual bandits for personalized recommendation both empirically and theoretically; (3) we will cover the latest topic, collaborative neural contextual bandits, to incorporate both user heterogeneity and user correlations customized for recommender system; (4) we will provide and discuss the new emerging challenges and open questions for neural contextual bandits with applications in the personalized recommendation, especially for large neural models.
Contextual Bandits with Online Neural Regression
Based on such a perturbed prediction, we show a ${\mathcal{O}}(\log T)$ regret for online regression with both squared loss and KL loss, and subsequently convert these respectively to $\tilde{\mathcal{O}}(\sqrt{KT})$ and $\tilde{\mathcal{O}}(\sqrt{KL^*} + K)$ regret for NeuCB, where $L^*$ is the loss of the best policy.
Dataset Distillation via the Wasserstein Metric
Dataset Distillation (DD) emerges as a powerful strategy to encapsulate the expansive information of large datasets into significantly smaller, synthetic equivalents, thereby preserving model performance with reduced computational overhead.
Robust Basket Recommendation via Noise-tolerated Graph Contrastive Learning
Next, to further inhibit the within-behavior noise of the user and basket interactions, we propose to exploit invariant properties of the recommenders w. r. t augmentations through within-behavior contrastive learning.
Adaptive Test-Time Personalization for Federated Learning
To tackle this challenge, we propose a novel algorithm called ATP to adaptively learns the adaptation rates for each module in the model from distribution shifts among source domains.
Class-Imbalanced Graph Learning without Class Rebalancing
In this work, we approach the root cause of class-imbalance bias from an topological paradigm.
Graph Neural Bandits
Contextual bandits algorithms aim to choose the optimal arm with the highest reward out of a set of candidates based on the contextual information.
MLP Fusion: Towards Efficient Fine-tuning of Dense and Mixture-of-Experts Language Models
Fine-tuning a pre-trained language model (PLM) emerges as the predominant strategy in many natural language processing applications.
Privacy-Preserving Graph Machine Learning from Data to Computation: A Survey
We systematically review related works from the data to the computational aspects.
Optimizing the Collaboration Structure in Cross-Silo Federated Learning
In federated learning (FL), multiple clients collaborate to train machine learning models together while keeping their data decentralized.
Neural Exploitation and Exploration of Contextual Bandits
In recent literature, a series of neural bandit algorithms have been proposed to adapt to the non-linear reward function, combined with TS or UCB strategies for exploration.
FairGen: Towards Fair Graph Generation
In addition, we propose a generic context sampling strategy for graph generative models, which is proven to be capable of fairly capturing the contextual information of each group with a high probability.
Fairness-aware Multi-view Clustering
We also derive insights regarding the relative performance of the proposed regularizers in various scenarios.
Non-IID Transfer Learning on Graphs
To bridge the gap, in this paper, we propose rigorous generalization bounds and algorithms for cross-network transfer learning from a source graph to a target graph.
Augmentations in Hypergraph Contrastive Learning: Fabricated and Generative
This paper targets at improving the generalizability of hypergraph neural networks in the low-label regime, through applying the contrastive learning approach from images/graphs (we refer to it as HyperGCL).
Improved Algorithms for Neural Active Learning
We improve the theoretical and empirical performance of neural-network(NN)-based active learning algorithms for the non-parametric streaming setting.
BOBA: Byzantine-Robust Federated Learning with Label Skewness
In federated learning, most existing robust aggregation rules (AGRs) combat Byzantine attacks in the IID setting, where client data is assumed to be independent and identically distributed.
MentorGNN: Deriving Curriculum for Pre-Training GNNs
To comprehend heterogeneous graph signals at different granularities, we propose a curriculum learning paradigm that automatically re-weighs graph signals in order to ensure a good generalization in the target domain.
A Unified Meta-Learning Framework for Dynamic Transfer Learning
Transfer learning refers to the transfer of knowledge or information from a relevant source task to a target task.
Privacy-preserving Graph Analytics: Secure Generation and Federated Learning
Directly motivated by security-related applications from the Homeland Security Enterprise, we focus on the privacy-preserving analysis of graph data, which provides the crucial capacity to represent rich attributes and relationships.
Fairness-aware Model-agnostic Positive and Unlabeled Learning
Our framework is proven to be statistically consistent in terms of both the classification error and the fairness metric.
Comprehensive Fair Meta-learned Recommender System
The core idea is to learn global shared meta-initialization parameters for all users and rapidly adapt them into local parameters for each user respectively.
Neural Bandit with Arm Group Graph
Contextual bandits aim to identify among a set of arms the optimal one with the highest reward based on their contextual information.
DISCO: Comprehensive and Explainable Disinformation Detection
Disinformation refers to false information deliberately spread to influence the general public, and the negative impact of disinformation on society can be observed in numerous issues, such as political agendas and manipulating financial markets.
Neural Collaborative Filtering Bandits via Meta Learning
Contextual multi-armed bandits provide powerful tools to solve the exploitation-exploration dilemma in decision making, with direct applications in the personalized recommendation.
FairIF: Boosting Fairness in Deep Learning via Influence Functions with Validation Set Sensitive Attributes
Most fair machine learning methods either highly rely on the sensitive information of the training samples or require a large modification on the target models, which hinders their practical application.
Adaptive Transfer Learning for Plant Phenotyping
Plant phenotyping (Guo et al. 2021; Pieruschka et al. 2019) focuses on studying the diverse traits of plants related to the plants' growth.
From Intrinsic to Counterfactual: On the Explainability of Contextualized Recommender Systems
With the prevalence of deep learning based embedding approaches, recommender systems have become a proven and indispensable tool in various information filtering applications.
Deeper-GXX: Deepening Arbitrary GNNs
However, two major problems hinder the deeper GNNs to obtain satisfactory performance, i. e., vanishing gradient and over-smoothing.
Ranked #15 on
Node Classification
on Reddit
Deep Active Learning by Leveraging Training Dynamics
Active learning theories and methods have been extensively studied in classical statistical learning settings.
EE-Net: Exploitation-Exploration Neural Networks in Contextual Bandits
To overcome this challenge, a series of neural bandit algorithms have been proposed, where a neural network is used to learn the underlying reward function and TS or UCB are adapted for exploration.
Metric Learning on Temporal Graphs via Few-Shot Examples
Graph metric learning methods aim to learn the distance metric over graphs such that similar graphs are closer and dissimilar graphs are farther apart.
DPPIN: A Biological Repository of Dynamic Protein-Protein Interaction Network Data
In the big data era, the relationship between entries becomes more and more complex.
Convolutional Neural Bandit for Visual-aware Recommendation
Online recommendation/advertising is ubiquitous in web business.
Multi-facet Contextual Bandits: A Neural Network Perspective
In this paper, we study a novel problem of multi-facet bandits involving a group of bandits, each characterizing the users' needs from one unique aspect.
Controllable Gradient Item Retrieval
A better way is to present a sequence of products with increasingly floral attributes based on the white dress, and allow the customer to select the most satisfactory one from the sequence.
Heterogeneous Contrastive Learning
We first provide a theoretical analysis showing that the vanilla contrastive learning loss easily leads to the sub-optimal solution in the presence of false negative pairs, whereas the proposed weighted loss could automatically adjust the weight based on the similarity of the learned representations to mitigate this issue.
Local Clustering in Contextual Multi-Armed Bandits
We study identifying user clusters in contextual multi-armed bandits (MAB).
Deep Co-Attention Network for Multi-View Subspace Learning
For example, given the diagnostic result that a model provided based on the X-ray images of a patient at different poses, the doctor needs to know why the model made such a prediction.
Robust Federated Learning for Neural Networks
In federated learning, data is distributed among local clients which collaboratively train a prediction model using secure aggregation.
Continuous Transfer Learning
One major challenge associated with continuous transfer learning is the time evolving relatedness of the source domain and the current target domain as the target domain evolves over time.
GAN-based Recommendation with Positive-Unlabeled Sampling
Recommender systems are popular tools for information retrieval tasks on a large variety of web applications and personalized products.
Adversarial Robustness through Bias Variance Decomposition: A New Perspective for Federated Learning
In this work, we show that this paradigm might inherit the adversarial vulnerability of the centralized neural network, i. e., it has deteriorated performance on adversarial examples when the model is deployed.
A Visual Analytics Framework for Explaining and Diagnosing Transfer Learning Processes
Transfer Learning is intended to relax this assumption by modeling relationships between domains, and is often applied in deep learning applications to reduce the demand for labeled data and training time.
Generic Outlier Detection in Multi-Armed Bandit
In this paper, we study the problem of outlier arm detection in multi-armed bandit settings, which finds plenty of applications in many high-impact domains such as finance, healthcare, and online advertising.
Continuous Transfer Learning with Label-informed Distribution Alignment
To bridge this gap, in this paper, we study a novel continuous transfer learning setting with a time evolving target domain.
DEMO-Net: Degree-specific Graph Neural Networks for Node and Graph Classification
Graph data widely exist in many high-impact applications.
Ranked #1 on
Node Classification
on Wiki-Vote
Visual Analytics of Anomalous User Behaviors: A Survey
The increasing accessibility of data provides substantial opportunities for understanding user behaviors.
Deep Multimodality Model for Multi-task Multi-view Learning
However, there is no existing deep learning algorithm that jointly models task and view dual heterogeneity, particularly for a data set with multiple modalities (text and image mixed data set or text and video mixed data set, etc.).
Optimizing the Wisdom of the Crowd: Inference, Learning, and Teaching
The unprecedented demand for large amount of data has catalyzed the trend of combining human insights with machine learning techniques, which facilitate the use of crowdsourcing to enlist label information both effectively and efficiently.
ImVerde: Vertex-Diminished Random Walk for Learning Network Representation from Imbalanced Data
Then, based on VDRW, we propose a semi-supervised network representation learning framework named ImVerde for imbalanced networks, in which context sampling uses VDRW and the label information to create node-context pairs, and balanced-batch sampling adopts a simple under-sampling method to balance these pairs in different classes.
Social and Information Networks
Unlearn What You Have Learned: Adaptive Crowd Teaching with Exponentially Decayed Memory Learners
With the increasing demand for large amount of labeled data, crowdsourcing has been used in many large-scale data mining applications.
GenDeR: A Generic Diversified Ranking Algorithm
In this paper, we consider a generic setting where we aim to diversify the top-k ranking list based on an arbitrary relevance function and an arbitrary similarity function among all the examples.
