Search Results for author:
Found 86 papers, 31 papers with code
Exact first passage time distribution for second-order reactions in chemical networks
The first passage time (FPT) is a generic measure that quantifies when a random quantity reaches a specific state.
LARR: Large Language Model Aided Real-time Scene Recommendation with Semantic Understanding
Finally, LLM's separate outputs for different scene features are aggregated by an encoder, aligning to collaborative signals in RS, enhancing the performance of recommendation model.
First Activations Matter: Training-Free Methods for Dynamic Activation in Large Language Models
Dynamic activation (DA) techniques, such as DejaVu and MoEfication, have demonstrated their potential to significantly enhance the inference efficiency of large language models (LLMs).
Vision-Language Guidance for LiDAR-based Unsupervised 3D Object Detection
To overcome these limitations, we propose a vision-language-guided unsupervised 3D detection approach that operates exclusively on LiDAR point clouds.
Adaptive Self-supervised Robust Clustering for Unstructured Data with Unknown Cluster Number
ASRC obtains the final clustering results by applying RCC to the learned feature representations with their consistent graph structure and edge weights.
Enhancing CTR Prediction through Sequential Recommendation Pre-training: Introducing the SRP4CTR Framework
However, these approaches tend to ignore the additional inference costs to the downstream tasks, and they do not consider how to transfer the effective information from the pre-trained models for specific estimated items in CTR prediction.
Adaptive Utilization of Cross-scenario Information for Multi-scenario Recommendation
Recommender system of the e-commerce platform usually serves multiple business scenarios.
Aligning Explanations for Recommendation with Rating and Feature via Maximizing Mutual Information
However, as current explanation generation methods are commonly trained with an objective to mimic existing user reviews, the generated explanations are often not aligned with the predicted ratings or some important features of the recommended items, and thus, are suboptimal in helping users make informed decision on the recommendation platform.
Decision Focused Causal Learning for Direct Counterfactual Marketing Optimization
Decision Focused Learning (DFL) integrates ML and OR into an end-to-end framework, which takes the objective of the downstream task as the decision loss function and guarantees the consistency of the optimization direction between ML and OR.
Enhancing Vehicle Re-identification and Matching for Weaving Analysis
Vehicle weaving on highways contributes to traffic congestion, raises safety issues, and underscores the need for sophisticated traffic management systems.
Unified Dual-Intent Translation for Joint Modeling of Search and Recommendation
It is therefore feasible to utilize the interaction data from both scenarios to reinforce the dual intents for joint intent-aware modeling.
Deciphering interventional dynamical causality from non-intervention systems
Detecting and quantifying causality is a focal topic in the fields of science, engineering, and interdisciplinary studies.
QQQ: Quality Quattuor-Bit Quantization for Large Language Models
Quantization is a proven effective method for compressing large language models.
Comparison Visual Instruction Tuning
Comparing two images in terms of Commonalities and Differences (CaD) is a fundamental human capability that forms the basis of advanced visual reasoning and interpretation.
ConMe: Rethinking Evaluation of Compositional Reasoning for Modern VLMs
Compositional Reasoning (CR) entails grasping the significance of attributes, relations, and word order.
A Statistical Theory of Regularization-Based Continual Learning
Moreover, the estimation error of the optimal algorithm is derived explicitly, which is of the same order as that of the oracle estimator.
Learning Hamiltonian neural Koopman operator and simultaneously sustaining and discovering conservation law
Our results suggest that feeding the prior knowledge of the underlying system and the mathematical theory appropriately to the learning framework can reinforce the capability of machine learning in solving physical problems.
PertEval: Unveiling Real Knowledge Capacity of LLMs with Knowledge-Invariant Perturbations
To rectify this, we present PertEval, a toolkit devised for in-depth probing of LLMs' knowledge capacity through knowledge-invariant perturbations.
Switched Flow Matching: Eliminating Singularities via Switching ODEs
Continuous-time generative models, such as Flow Matching (FM), construct probability paths to transport between one distribution and another through the simulation-free learning of the neural ordinary differential equations (ODEs).
From Fourier to Neural ODEs: Flow Matching for Modeling Complex Systems
We then incorporate the estimated spatial gradients as additional inputs to a neural network.
Network Structure Governs Drosophila Brain Functionality
The results revealed that even with rudimentary neuronal activation mechanisms, models grounded in real neural network structures can generate activation patterns strikingly similar to those observed in the actual brain.
AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Framework
The task of financial analysis primarily encompasses two key areas: stock trend prediction and the corresponding financial question answering.
Towards Multimodal In-Context Learning for Vision & Language Models
State-of-the-art Vision-Language Models (VLMs) ground the vision and the language modality primarily via projecting the vision tokens from the encoder to language-like tokens, which are directly fed to the Large Language Model (LLM) decoder.
Context-based Fast Recommendation Strategy for Long User Behavior Sequence in Meituan Waimai
We first identify contexts that share similar user preferences with the target context and then locate the corresponding PoIs based on these identified contexts.
Meta-Prompting for Automating Zero-shot Visual Recognition with LLMs
Prompt ensembling of Large Language Model (LLM) generated category-specific prompts has emerged as an effective method to enhance zero-shot recognition ability of Vision-Language Models (VLMs).
A Fixed-Point Approach to Unified Prompt-Based Counting
Additionally, a contrastive training scheme is implemented to mitigate dataset bias inherent in current class-agnostic counting datasets, a strategy whose effectiveness is confirmed by our ablation study.
Don't Half-listen: Capturing Key-part Information in Continual Instruction Tuning
Recent methods try to alleviate the CF problem by modifying models or replaying data, which may only remember the surface-level pattern of instructions and get confused on held-out tasks.
Robust Zero-Shot Crowd Counting and Localization With Adaptive Resolution SAM
The existing crowd counting models require extensive training data, which is time-consuming to annotate.
Target Recognition Algorithm for Monitoring Images in Electric Power Construction Process
To enhance precision and comprehensiveness in identifying targets in electric power construction monitoring video, a novel target recognition algorithm utilizing infrared imaging is explored.
Arithmetic Feature Interaction Is Necessary for Deep Tabular Learning
Our extensive experiments on real-world data also validate the consistent effectiveness, efficiency, and rationale of AMFormer, suggesting it has established a strong inductive bias for deep learning on tabular data.
Quantifying energy landscape of oscillatory systems: Explosion, pre-solution, and diffusion decomposition
Although the weighted summation of the Gaussian approximation (WSGA) approach has been proposed for quantifying the energy landscape in multistable systems by solving the diffusion equation approximately from moment equations, we are still lacking an accurate approach for quantifying the energy landscape of the periodic oscillatory systems.
Towards Robust Learning to Optimize with Theoretical Guarantees
Based on our proposed methodology of aligning OOD problems to InD problems we also demonstrate that the L2O model's convergence rate in OOD scenarios will deteriorate by an equation of the L2O model's input features.
PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalization
Moreover, these methods often grapple with identity distortion and limited expression diversity.
ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models
Knowledge Base Question Answering (KBQA) aims to answer natural language questions over large-scale knowledge bases (KBs), which can be summarized into two crucial steps: knowledge retrieval and semantic parsing.
Ranked #1 on
Knowledge Base Question Answering
on WebQuestionsSP
Text2NKG: Fine-Grained N-ary Relation Extraction for N-ary relational Knowledge Graph Construction
To address these restrictions, we propose Text2NKG, a novel fine-grained n-ary relation extraction framework for n-ary relational knowledge graph construction.
Event-based N-ary Relaiton Extraction
Hypergraph-based N-ary Relaiton Extraction
+3
Accelerating Large Batch Training via Gradient Signal to Noise Ratio (GSNR)
As models for nature language processing (NLP), computer vision (CV) and recommendation systems (RS) require surging computation, a large number of GPUs/TPUs are paralleled as a large batch (LB) to improve training throughput.
Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
Therefore, we propose Flash-LLM for enabling low-cost and highly-efficient large generative model inference with the sophisticated support of unstructured sparsity on high-performance but highly restrictive Tensor Cores.
TAP: Targeted Prompting for Task Adaptive Generation of Textual Training Instances for Visual Classification
Vision and Language Models (VLMs), such as CLIP, have enabled visual recognition of a potentially unlimited set of categories described by text prompts.
CARE: Large Precision Matrix Estimation for Compositional Data
High-dimensional compositional data are prevalent in many applications.
Accurate Prediction of Antibody Function and Structure Using Bio-Inspired Antibody Language Model
Remarkably, BALMFold outperforms those well-established methods like AlphaFold2, IgFold, ESMFold, and OmegaFold in the antibody benchmark, demonstrating significant potential to advance innovative engineering and streamline therapeutic antibody development by reducing the need for unnecessary trials.
Heterogeneous Knowledge Fusion: A Novel Approach for Personalized Recommendation via LLM
The analysis and mining of user heterogeneous behavior are of paramount importance in recommendation systems.
Modeling Dual Period-Varying Preferences for Takeaway Recommendation
Different from traditional recommendation, takeaway recommendation faces two main challenges: (1) Dual Interaction-Aware Preference Modeling.
Sit Back and Relax: Learning to Drive Incrementally in All Weather Conditions
We propose to store these affine parameters as a memory bank for each weather condition and plug-in their weather-specific parameters during driving (i. e. test time) when the respective weather conditions are encountered.
HAHE: Hierarchical Attention for Hyper-Relational Knowledge Graphs in Global and Local Level
The global-level attention can model the graphical structure of HKG using hypergraph dual-attention layers, while the local-level attention can learn the sequential structure inside H-Facts via heterogeneous self-attention layers.
Ranked #1 on
Link Prediction
on Wikipeople
Dual Intent Enhanced Graph Neural Network for Session-based New Item Recommendation
We design a dual-intent network to learn user intent from an attention mechanism and the distribution of historical data respectively, which can simulate users' decision-making process in interacting with a new item.
Neural Delay Differential Equations: System Reconstruction and Image Classification
Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with representative datasets.
AIR-DA: Adversarial Image Reconstruction for Unsupervised Domain Adaptive Object Detection
This results in an imbalance of the adversarial training between the domain discriminator and the feature extractor.
Embedding Theory of Reservoir Computing and Reducing Reservoir Network Using Time Delays
Reservoir computing (RC), a particular form of recurrent neural network, is under explosive development due to its exceptional efficacy and high performance in reconstruction or/and prediction of complex physical systems.
MAtch, eXpand and Improve: Unsupervised Finetuning for Zero-Shot Action Recognition with Language Knowledge
We adapt a VL model for zero-shot and few-shot action recognition using a collection of unlabeled videos and an unpaired action dictionary.
Ranked #3 on
Zero-Shot Action Recognition
on Charades
TAEC: Unsupervised Action Segmentation with Temporal-Aware Embedding and Clustering
Temporal action segmentation in untrimmed videos has gained increased attention recently.
Auto-Parallelizing Large Models with Rhino: A Systematic Approach on Production AI Platform
We present Rhino, a system for accelerating tensor programs with automatic parallelization on AI platform for real production environment.
Expediting Distributed DNN Training with Device Topology-Aware Graph Deployment
This paper presents TAG, an automatic system to derive optimized DNN training graph and its deployment onto any device topology, for expedited training in device- and topology- heterogeneous ML clusters.
TAP: Accelerating Large-Scale DNN Training Through Tensor Automatic Parallelisation
However, finding a suitable model parallel schedule for an arbitrary neural network is a non-trivial task due to the exploding search space.
Optimal Transport Minimization: Crowd Localization on Density Maps for Semi-Supervised Counting
In this paper, we propose the optimal transport minimization (OT-M) algorithm for crowd localization with density maps.
Scale-Prior Deformable Convolution for Exemplar-Guided Class-Agnostic Counting
Here we propose a scale-sensitive generalized loss to tackle this problem.
Ranked #9 on
Object Counting
on FSC147
SKDBERT: Compressing BERT via Stochastic Knowledge Distillation
In this paper, we propose Stochastic Knowledge Distillation (SKD) to obtain compact BERT-style language model dubbed SKDBERT.
Video Test-Time Adaptation for Action Recognition
Our proposed method demonstrates a substantial performance gain over existing test-time adaptation approaches in both evaluations of a single distribution shift and the challenging case of random distribution shifts.
ActMAD: Activation Matching to Align Distributions for Test-Time-Training
Test-Time-Training (TTT) is an approach to cope with out-of-distribution (OOD) data by adapting a trained model to distribution shifts occurring at test-time.
MATE: Masked Autoencoders are Online 3D Test-Time Learners
Our MATE is the first Test-Time-Training (TTT) method designed for 3D data, which makes deep networks trained for point cloud classification robust to distribution shifts occurring in test data.
Multi-Frequency-Aware Patch Adversarial Learning for Neural Point Cloud Rendering
The proposed approach aims to improve the rendering realness by minimizing the spectrum discrepancy between real and synthesized images, especially on the high-frequency localized sharpness information which causes image blur visually.
Heterogeneous Federated Learning on a Graph
In this work, we consider parameter estimation in federated learning with data distribution and communication heterogeneity, as well as limited computational capacity of local devices.
RAW-GNN: RAndom Walk Aggregation based Graph Neural Network
Due to the homophily assumption of Graph Convolutional Networks (GCNs) that these methods use, they are not suitable for heterophily graphs where nodes with different labels or dissimilar attributes tend to be adjacent.
CGMN: A Contrastive Graph Matching Network for Self-Supervised Graph Similarity Learning
As most of the existing graph neural networks yield effective graph representations of a single graph, little effort has been made for jointly learning two graph representations and calculating their similarity score.
Cross-View Cross-Scene Multi-View Crowd Counting
Multi-view crowd counting has been previously proposed to utilize multi-cameras to extend the field-of-view of a single camera, capturing more people in the scene, and improve counting performance for occluded people or those in low resolution.
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing
The success of Pre-Trained Models (PTMs) has reshaped the development of Natural Language Processing (NLP).
PICASSO: Unleashing the Potential of GPU-centric Training for Wide-and-deep Recommender Systems
However, we observe that GPU devices in training recommender systems are underutilized, and they cannot attain an expected throughput improvement as what it has achieved in CV and NLP areas.
CycDA: Unsupervised Cycle Domain Adaptation from Image to Video
To address these challenges, we propose Cycle Domain Adaptation (CycDA), a cycle-based approach for unsupervised image-to-video domain adaptation by leveraging the joint spatial information in images and videos on the one hand and, on the other hand, training an independent spatio-temporal model to bridge the modality gap.
AC-Feasible Power Transfer Regions of Virtual Power Plants: Characterization and Application
Distributed energy resources (DERs) in distribution networks can be aggregated as a virtual power plant (VPP) for transmission-level operations.
Tie-line Security Regions in High Dimension for Renewable Accommodations
However, a tie-line security region is a high-dimension polytope due to multiple time periods and border buses inherently in power system operations, leading to the considerable computational burden.
Neural Piecewise-Constant Delay Differential Equations
Continuous-depth neural networks, such as the Neural Ordinary Differential Equations (ODEs), have aroused a great deal of interest from the communities of machine learning and data science in recent years, which bridge the connection between deep neural networks and dynamical systems.
Cost Functions over Feasible Power Transfer Regions of Virtual Power Plants
To address this challenge, a characterization method is presented in this paper for the intraday operation of a VPP based on the concepts of nonanticipativity and robustness to DERs' uncertainties.
M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining
Recent expeditious developments in deep learning algorithms, distributed training, and even hardware design for large models have enabled training extreme-scale models, say GPT-3 and Switch Transformer possessing hundreds of billions or even trillions of parameters.
Learning Effective and Efficient Embedding via an Adaptively-Masked Twins-based Layer
Each feature value is mapped to an embedding vector via an embedding learning process.
Binary Code based Hash Embedding for Web-scale Applications
In these applications, embedding learning of categorical features is crucial to the success of deep learning models.
Boosting the Convergence of Reinforcement Learning-based Auto-pruning Using Historical Data
Reinforcement learning (RL)-based auto-pruning has been further proposed to automate the DNN pruning process to avoid expensive hand-crafted work.
Nonasymptotic theory for two-layer neural networks: Beyond the bias-variance trade-off
Large neural networks have proved remarkably effective in modern deep learning practice, even in the overparametrized regime where the number of active parameters is large relative to the sample size.
M6-T: Exploring Sparse Expert Models and Beyond
Mixture-of-Experts (MoE) models can achieve promising results with outrageous large amount of parameters but constant computation cost, and thus it has become a trend in model scaling.
Explicit Semantic Cross Feature Learning via Pre-trained Graph Neural Networks for CTR Prediction
Most of the existing methods adopt a DNN-based model to capture the cross features in an implicit manner.
Towards a Better Tradeoff between Effectiveness and Efficiency in Pre-Ranking: A Learnable Feature Selection based Approach
In real-world search, recommendation, and advertising systems, the multi-stage ranking architecture is commonly adopted.
Joule-Thomson expansion of the torus-like black hole
Furthermore, we investigate similarities and differences between the Van der Waals fluid, the torus-like black hole and the charged AdS black holes for the expansion.
General Relativity and Quantum Cosmology
M6: A Chinese Multimodal Pretrainer
In this work, we construct the largest dataset for multimodal pretraining in Chinese, which consists of over 1. 9TB images and 292GB texts that cover a wide range of domains.
Neural Delay Differential Equations
Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with some representative datasets.
EasyTransfer -- A Simple and Scalable Deep Transfer Learning Platform for NLP Applications
The literature has witnessed the success of leveraging Pre-trained Language Models (PLMs) and Transfer Learning (TL) algorithms to a wide range of Natural Language Processing (NLP) applications, yet it is not easy to build an easy-to-use and scalable TL toolkit for this purpose.
INT8 Winograd Acceleration for Conv1D Equipped ASR Models Deployed on Mobile Devices
The intensive computation of Automatic Speech Recognition (ASR) models obstructs them from being deployed on mobile devices.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
A bi-diffusion based layer-wise sampling method for deep learning in large graphs
The Graph Convolutional Network (GCN) and its variants are powerful models for graph representation learning and have recently achieved great success on many graph-based applications.
