Search Results for author:
Found 140 papers, 50 papers with code
Focus-Driven Contrastive Learning for Medical Question Summarization
Automatic medical question summarization can significantly help the system to understand consumer health questions and retrieve correct answers.
UniKER: A Unified Framework for Combining Embedding and Definite Horn Rule Reasoning for Knowledge Graph Inference
Knowledge graph inference has been studied extensively due to its wide applications.
Pathway2Text: Dataset and Method for Biomedical Pathway Description Generation
Collectively, we envision our method will become an important benchmark for evaluating Graph2Text methods and advance biomedical research for complex diseases.
Rank and Align: Towards Effective Source-free Graph Domain Adaptation
To this end, we investigate an underexplored yet practical problem of source-free graph domain adaptation, which transfers knowledge from source models instead of source graphs to a target domain.
AquilaMoE: Efficient Training for MoE Models with Scale-Up and Scale-Out Strategies
In this paper, we present AquilaMoE, a cutting-edge bilingual 8*16B Mixture of Experts (MoE) language model that has 8 experts with 16 billion parameters each and is developed using an innovative training methodology called EfficientScale.
TransferTOD: A Generalizable Chinese Multi-Domain Task-Oriented Dialogue System with Transfer Capabilities
Task-oriented dialogue (TOD) systems aim to efficiently handle task-oriented conversations, including information collection.
DisenSemi: Semi-supervised Graph Classification via Disentangled Representation Learning
To ensure the meaningful transfer of knowledge from the unsupervised encoder to the supervised one, we further define an MI-based disentangled consistency regularization between two models and identify the corresponding rationale that aligns well with the current graph classification task.
Vision-Braille: An End-to-End Tool for Chinese Braille Image-to-Text Translation
By incorporating the braille recognition algorithm, this project is the first publicly available braille translation system and can benefit lots of visually impaired students and families who are preparing for the Chinese College Test and help to propel their college dreams in the future.
What's Wrong with Your Code Generated by Large Language Models? An Extensive Study
The increasing development of large language models (LLMs) in code generation has drawn significant attention among researchers.
MMEvalPro: Calibrating Multimodal Benchmarks Towards Trustworthy and Efficient Evaluation
Large Multimodal Models (LMMs) exhibit impressive cross-modal understanding and reasoning abilities, often assessed through multiple-choice questions (MCQs) that include an image, a question, and several options.
Towards Graph Contrastive Learning: A Survey and Beyond
In recent years, deep learning on graphs has achieved remarkable success in various domains.
Hypergraph-enhanced Dual Semi-supervised Graph Classification
In this paper, we study semi-supervised graph classification, which aims at accurately predicting the categories of graphs in scenarios with limited labeled graphs and abundant unlabeled graphs.
All in One Framework for Multimodal Re-identification in the Wild
In Re-identification (ReID), recent advancements yield noteworthy progress in both unimodal and cross-modal retrieval tasks.
Measuring Social Norms of Large Language Models
This enables the direct comparison of the social understanding of large language models to humans, more specifically, elementary students.
Multi-modal Semantic Understanding with Contrastive Cross-modal Feature Alignment
Multi-modal semantic understanding requires integrating information from different modalities to extract users' real intention behind words.
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
In this report, we introduce the Gemini 1. 5 family of models, representing the next generation of highly compute-efficient multimodal models capable of recalling and reasoning over fine-grained information from millions of tokens of context, including multiple long documents and hours of video and audio.
Ranked #1 on
Zero-Shot Video Question Answer
on Video-MME
A Survey of Graph Neural Networks in Real world: Imbalance, Noise, Privacy and OOD Challenges
To tackle these issues, substantial efforts have been devoted to improving the performance of GNN models in practical real-world scenarios, as well as enhancing their reliability and robustness.
ESM All-Atom: Multi-scale Protein Language Model for Unified Molecular Modeling
In this paper, we propose ESM-AA (ESM All-Atom), a novel approach that enables atom-scale and residue-scale unified molecular modeling.
COOL: A Conjoint Perspective on Spatio-Temporal Graph Neural Network for Traffic Forecasting
Toward this end, this paper proposes Conjoint Spatio-Temporal graph neural network (abbreviated as COOL), which models heterogeneous graphs from prior and posterior information to conjointly capture high-order spatio-temporal relationships.
Measuring Vision-Language STEM Skills of Neural Models
Compared to existing datasets that often focus on examining expert-level ability, our dataset includes fundamental skills and questions designed based on the K-12 curriculum.
CURSOR: Scalable Mixed-Order Hypergraph Matching with CUR Decomposition
To achieve greater accuracy, hypergraph matching algorithms require exponential increases in computational resources.
RJUA-MedDQA: A Multimodal Benchmark for Medical Document Question Answering and Clinical Reasoning
Recent advancements in Large Language Models (LLMs) and Large Multi-modal Models (LMMs) have shown potential in various medical applications, such as Intelligent Medical Diagnosis.
A Survey of Data-Efficient Graph Learning
Graph-structured data, prevalent in domains ranging from social networks to biochemical analysis, serve as the foundation for diverse real-world systems.
MouSi: Poly-Visual-Expert Vision-Language Models
This technique introduces a fusion network to unify the processing of outputs from different visual experts, while bridging the gap between image encoders and pre-trained LLMs.
Ranked #61 on
Visual Question Answering
on MM-Vet
GPS: Graph Contrastive Learning via Multi-scale Augmented Views from Adversarial Pooling
Self-supervised graph representation learning has recently shown considerable promise in a range of fields, including bioinformatics and social networks.
From GPT-4 to Gemini and Beyond: Assessing the Landscape of MLLMs on Generalizability, Trustworthiness and Causality through Four Modalities
Multi-modal Large Language Models (MLLMs) have shown impressive abilities in generating reasonable responses with respect to multi-modal contents.
PolyCF: Towards the Optimal Spectral Graph Filters for Collaborative Filtering
Collaborative Filtering (CF) is a pivotal research area in recommender systems that capitalizes on collaborative similarities between users and items to provide personalized recommendations.
Preparing Lessons for Progressive Training on Language Models
The rapid progress of Transformers in artificial intelligence has come at the cost of increased resource consumption and greenhouse gas emissions due to growing model sizes.
Reframing Tax Law Entailment as Analogical Reasoning
We re-frame statutory reasoning as an analogy task, where each instance of the analogy task involves a combination of two instances of statutory reasoning.
A Survey on Graph Neural Networks in Intelligent Transportation Systems
However, most of the research in this area is still concentrated on traffic forecasting, while other ITS domains, such as autonomous vehicles and urban planning, still require more attention.
A Survey of Reasoning with Foundation Models
Reasoning, a crucial ability for complex problem-solving, plays a pivotal role in various real-world settings such as negotiation, medical diagnosis, and criminal investigation.
RJUA-QA: A Comprehensive QA Dataset for Urology
We introduce RJUA-QA, a novel medical dataset for question answering (QA) and reasoning with clinical evidence, contributing to bridge the gap between general large language models (LLMs) and medical-specific LLM applications.
LLMEval: A Preliminary Study on How to Evaluate Large Language Models
The three crucial questions for LLM evaluation are ``what, where, and how to evaluate''.
PGODE: Towards High-quality System Dynamics Modeling
In this paper, we propose a new approach named Prototypical Graph ODE (PGODE) to address the problem.
TRIGO: Benchmarking Formal Mathematical Proof Reduction for Generative Language Models
Automated theorem proving (ATP) has become an appealing domain for exploring the reasoning ability of the recent successful generative language models.
ALEX: Towards Effective Graph Transfer Learning with Noisy Labels
Nevertheless, the majority of GNN-based approaches have been examined using well-annotated benchmark datasets, leading to suboptimal performance in real-world graph learning scenarios.
Dynamic Hypergraph Structure Learning for Traffic Flow Forecasting
This paper studies the problem of traffic flow forecasting, which aims to predict future traffic conditions on the basis of road networks and traffic conditions in the past.
The Rise and Potential of Large Language Model Based Agents: A Survey
Many efforts have been made to develop intelligent agents, but they mainly focus on advancement in algorithms or training strategies to enhance specific capabilities or performance on particular tasks.
Redundancy-Free Self-Supervised Relational Learning for Graph Clustering
Graph clustering, which learns the node representations for effective cluster assignments, is a fundamental yet challenging task in data analysis and has received considerable attention accompanied by graph neural networks in recent years.
FIMO: A Challenge Formal Dataset for Automated Theorem Proving
We present FIMO, an innovative dataset comprising formal mathematical problem statements sourced from the International Mathematical Olympiad (IMO) Shortlisted Problems.
Towards Long-Tailed Recognition for Graph Classification via Collaborative Experts
Graph classification, aiming at learning the graph-level representations for effective class assignments, has received outstanding achievements, which heavily relies on high-quality datasets that have balanced class distribution.
RAHNet: Retrieval Augmented Hybrid Network for Long-tailed Graph Classification
Recent approaches mainly focus on re-balancing different classes during model training, which fails to explicitly introduce new knowledge and sacrifices the performance of the head classes.
Learning on Graphs under Label Noise
Since this regularization term cannot utilize label information, it can enhance the robustness of node representations to label noise.
Towards Semi-supervised Universal Graph Classification
To tackle class shifts, we estimate the certainty of unlabeled graphs using multiple subgraphs, which facilities the discovery of unlabeled data from unknown categories.
MolXPT: Wrapping Molecules with Text for Generative Pre-training
Considering that text is the most important record for scientific discovery, in this paper, we propose MolXPT, a unified language model of text and molecules pre-trained on SMILES (a sequence representation of molecules) wrapped by text.
Ranked #1 on
Molecular Property Prediction
on BACE
TGNN: A Joint Semi-supervised Framework for Graph-level Classification
The two twin modules collaborate with each other by exchanging instance similarity knowledge to fully explore the structure information of both labeled and unlabeled data.
A Diffusion model for POI recommendation
In this paper, we propose Diff-POI: a Diffusion-based model that samples the user's spatial preference for the next POI recommendation.
Learning Graph ODE for Continuous-Time Sequential Recommendation
Technically, GDERec is characterized by an autoregressive graph ordinary differential equation consisting of two components, which are parameterized by two tailored graph neural networks (GNNs) respectively to capture user preference from the perspective of hybrid dynamical systems.
A Comprehensive Survey on Deep Graph Representation Learning
Graph representation learning aims to effectively encode high-dimensional sparse graph-structured data into low-dimensional dense vectors, which is a fundamental task that has been widely studied in a range of fields, including machine learning and data mining.
Robust Dancer: Long-term 3D Dance Synthesis Using Unpaired Data
How to automatically synthesize natural-looking dance movements based on a piece of music is an incrementally popular yet challenging task.
Disruption Precursor Onset Time Study Based on Semi-supervised Anomaly Detection
Finally, we optimize precursor labeling using the onset times inferred by the anomaly detection predictor and test the optimized labels on supervised learning disruption predictors.
Semi-supervised Anomaly Detection
Supervised Anomaly Detection
GraphVF: Controllable Protein-Specific 3D Molecule Generation with Variational Flow
In particular, GraphVF represents the first controllable geometry-aware, protein-specific molecule generation method, which can generate binding 3D molecules with tailored sub-structures and physio-chemical properties.
2D Human Pose Estimation with Explicit Anatomical Keypoints Structure Constraints
Recently, human pose estimation mainly focuses on how to design a more effective and better deep network structure as human features extractor, and most designed feature extraction networks only introduce the position of each anatomical keypoint to guide their training process.
TIER-A: Denoising Learning Framework for Information Extraction
Our framework consists of several neural models with identical structures.
DisenPOI: Disentangling Sequential and Geographical Influence for Point-of-Interest Recommendation
Point-of-Interest (POI) recommendation plays a vital role in various location-aware services.
PALT: Parameter-Lite Transfer of Language Models for Knowledge Graph Completion
For instance, we outperform the fully finetuning approaches on a KG completion benchmark by tuning only 1% of the parameters.
Ranked #5 on
Link Prediction
on UMLS
GLCC: A General Framework for Graph-Level Clustering
In this paper, we propose a general graph-level clustering framework named Graph-Level Contrastive Clustering (GLCC) given multiple graphs.
MetaFill: Text Infilling for Meta-Path Generation on Heterogeneous Information Networks
Meta-path, a sequence of node types and edge types, is the core technique to embed HINs.
Kernel-based Substructure Exploration for Next POI Recommendation
To tackle the above issues, we propose a Kernel-Based Graph Neural Network (KBGNN) for next POI recommendation, which combines the characteristics of both geographical and sequential influences in a collaborative way.
Focus-Driven Contrastive Learniang for Medical Question Summarization
Automatic medical question summarization can significantly help the system to understand consumer health questions and retrieve correct answers.
Transferable Cross-Tokamak Disruption Prediction with Deep Hybrid Neural Network Feature Extractor
Based on the feature extractor trained on J-TEXT, the disruption prediction model was transferred to EAST data with mere 20 discharges from EAST experiment.
Taxonomy and evolution predicting using deep learning in images
Molecular and morphological characters, as important parts of biological taxonomy, are contradictory but need to be integrated.
A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphs
Experiments on both transductive and inductive knowledge graph reasoning benchmarks show that A*Net achieves competitive performance with existing state-of-the-art path-based methods, while merely visiting 10% nodes and 10% edges at each iteration.
Ranked #10 on
Link Property Prediction
on ogbl-wikikg2
KGNN: Harnessing Kernel-based Networks for Semi-supervised Graph Classification
This problem is typically solved by using graph neural networks (GNNs), which yet rely on a large number of labeled graphs for training and are unable to leverage unlabeled graphs.
End-to-End Rubbing Restoration Using Generative Adversarial Networks
Specifically, we collect characters from the Zhang Menglong Bei and build up the first rubbing restoration dataset.
A Probabilistic Model-Based Robust Waveform Design for MIMO Radar Detection
This paper addresses robust waveform design for multiple-input-multiple-output (MIMO) radar detection.
Graphine: A Dataset for Graph-aware Terminology Definition Generation
Unfortunately, the lack of large-scale terminology definition dataset hinders the process toward definition generation.
Generate & Rank: A Multi-task Framework for Math Word Problems
Math word problem (MWP) is a challenging and critical task in natural language processing.
Ranked #2 on
Math Word Problem Solving
on Math23K
Orthonormal Product Quantization Network for Scalable Face Image Retrieval
Experiments are conducted on four commonly-used face datasets under both seen and unseen identities retrieval settings.
DisenHAN: Disentangled Heterogeneous Graph Attention Network for Recommendation
In this paper, we propose a novel disentangled heterogeneous graph attention network DisenHAN for top-$N$ recommendation, which learns disentangled user/item representations from different aspects in a heterogeneous information network.
Partial Feature Selection and Alignment for Multi-Source Domain Adaptation
By assuming that the source and target domains share consistent key feature representations and identical label space, existing studies on MSDA typically utilize the entire union set of features from both the source and target domains to obtain the feature map and align the map for each category and domain.
RangeIoUDet: Range Image Based Real-Time 3D Object Detector Optimized by Intersection Over Union
Benefiting from the dense representation of the range image, RangeIoUDet is entirely constructed based on 2D convolution, making it possible to have a fast inference speed.
Criterion-based Heterogeneous Collaborative Filtering for Multi-behavior Implicit Recommendation
Besides, CHCF integrates criterion learning and user preference learning into a unified framework, which can be trained jointly for the interaction prediction of the target behavior.
FNAS: Uncertainty-Aware Fast Neural Architecture Search
Further, an architecture knowledge pool together with a block similarity function is proposed to utilize parameter knowledge and reduces the searching time by 2 times.
IMU Data Processing For Inertial Aided Navigation: A Recurrent Neural Network Based Approach
In this work, we propose a novel method for performing inertial aided navigation, by using deep neural networks (DNNs).
Improved Deep Classwise Hashing With Centers Similarity Learning for Image Retrieval
Recently, deep classwise hashing introduced a classwise loss supervised by class labels information alternatively; however, we find it still has its drawback.
Topologically protected valley-dependent quantum photonic circuits
Topological photonics has been introduced as a powerful platform for integrated optics, since it can deal with robust light transport, and be further extended to the quantum world.
Quantum Physics Optics
Time-dependent Clearance of Cyclosporine in Adult Renal Transplant Recipients: A Population Pharmacokinetic Perspective
The CL/F of the non-CGC haplotype carrier was 14. 4% lower than that of the CGC haplotype carrier at 3 months post operation.
$P-V$ criticality and Joule-Thomson Expansion of Hayward-AdS black holes in 4D Einstein-Gauss-Bonnet gravity
In this paper, the $P-V$ criticality and Joule-Thomson Expansion of Hayward-AdS black holes in 4D Einstein-Gauss-Bonnet gravity are studied in the extended phase space.
Action Detection
High Energy Physics - Theory
MoDL-QSM: Model-based Deep Learning for Quantitative Susceptibility Mapping
However, there exists a mismatch between the observed phase and the theoretical forward phase estimated by the susceptibility label.
Fast MNAS: Uncertainty-aware Neural Architecture Search with Lifelong Learning
Further, a life-long knowledge pool together with a block similarity function is proposed to utilize the lifelong parameter knowledge and reduces the searching time by 2 times.
Tomographic imaging of complete quantum state of matter by ultrafast diffraction
With the ability to directly obtain the Wigner function and density matrix of photon states, quantum tomography (QT) has had a significant impact on quantum optics, quantum computing and quantum information.
Quantum Physics
Learning Hybrid Representations for Automatic 3D Vessel Centerline Extraction
The main idea is to use CNNs to learn local appearances of vessels in image crops while using another point-cloud network to learn the global geometry of vessels in the entire image.
$K$-theoretic quasimap wall-crossing
In this paper, we prove a K-theoretic wall-crossing formula for $\epsilon$-stable quasimaps for all GIT targets in all genera.
Algebraic Geometry Mathematical Physics Mathematical Physics 14N35
Multi-agent Trajectory Prediction with Fuzzy Query Attention
Trajectory prediction for scenes with multiple agents and entities is a challenging problem in numerous domains such as traffic prediction, pedestrian tracking and path planning.
Partial FC: Training 10 Million Identities on a Single Machine
The experiment demonstrates no loss of accuracy when training with only 10\% randomly sampled classes for the softmax-based loss functions, compared with training with full classes using state-of-the-art models on mainstream benchmarks.
Ranked #2 on
Face Identification
on MegaFace
Rethinking the Extraction and Interaction of Multi-Scale Features for Vessel Segmentation
Analyzing the morphological attributes of blood vessels plays a critical role in the computer-aided diagnosis of many cardiovascular and ophthalmologic diseases.
MAFF-Net: Filter False Positive for 3D Vehicle Detection with Multi-modal Adaptive Feature Fusion
Experimental results on the KITTI dataset demonstrate significant improvement in filtering false positive over the approach using only point cloud data.
New gedanken experiment on higher-dimensional asymptotically AdS Reissner-Nordström black hole
Viewing the negative cosmological constant as a dynamical quantity derived from the matter field, we study the weak cosmic censorship conjecture for the higher-dimensional asymptotically AdS Reissner-Nordstr\"om black hole.
General Relativity and Quantum Cosmology High Energy Physics - Theory
Snowmass 2021 LoI: Determination of cosmic ray properties in the local interstellar medium with all-sky anisotropy observations
Propagation of Galactic cosmic rays (CR) in the interstellar medium (ISM) is among the unsolved problems in particle astrophysics.
High Energy Astrophysical Phenomena
RangeRCNN: Towards Fast and Accurate 3D Object Detection with Range Image Representation
We present RangeRCNN, a novel and effective 3D object detection framework based on the range image representation.
Augmented Bi-path Network for Few-shot Learning
Finally, the model learns to compare global and local features separately, i. e., in two paths, before merging the similarities.
EasyQuant: Post-training Quantization via Scale Optimization
The 8 bits quantization has been widely applied to accelerate network inference in various deep learning applications.
Wasserstein Distance guided Adversarial Imitation Learning with Reward Shape Exploration
The generative adversarial imitation learning (GAIL) has provided an adversarial learning framework for imitating expert policy from demonstrations in high-dimensional continuous tasks.
When does MAML Work the Best? An Empirical Study on Model-Agnostic Meta-Learning in NLP Applications
Model-Agnostic Meta-Learning (MAML), a model-agnostic meta-learning method, is successfully employed in NLP applications including few-shot text classification and multi-domain low-resource language generation.
Multi-task Learning via Adaptation to Similar Tasks for Mortality Prediction of Diverse Rare Diseases
Mortality prediction of diverse rare diseases using electronic health record (EHR) data is a crucial task for intelligent healthcare.
A Graph to Graphs Framework for Retrosynthesis Prediction
A fundamental problem in computational chemistry is to find a set of reactants to synthesize a target molecule, a. k. a.
Ranked #29 on
Single-step retrosynthesis
on USPTO-50k
GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generation
Molecular graph generation is a fundamental problem for drug discovery and has been attracting growing attention.
Ranked #1 on
Molecular Graph Generation
on MOSES
Learning to Answer Ambiguous Questions with Knowledge Graph
In the task of factoid question answering over knowledge base, many questions have more than one plausible interpretation.
Predictive Multi-level Patient Representations from Electronic Health Records
Most related studies transform EHR data of a patient into a sequence of clinical events in temporal order and then use sequential models to learn patient representations for outcome prediction.
PoD: Positional Dependency-Based Word Embedding for Aspect Term Extraction
Dependency context-based word embedding jointly learns the representations of word and dependency context, and has been proved effective in aspect term extraction.
Learning to Customize Model Structures for Few-shot Dialogue Generation Tasks
Training the generative models with minimal corpus is one of the critical challenges for building open-domain dialogue systems.
Early Prediction of Sepsis From Clinical Datavia Heterogeneous Event Aggregation
Rather than directly applying the LSTM model to the event sequences, our proposed model firstly aggregates heterogeneous clinical events in a short period and then captures temporal interactions of the aggregated representations with LSTM.
NoiGAN: NOISE AWARE KNOWLEDGE GRAPH EMBEDDING WITH GAN
Knowledge graph has gained increasing attention in recent years for its successful applications of numerous tasks.
Neural Correction Model for Open-Domain Named Entity Recognition
In this work, to address the low precision and recall problems, we first utilize DBpedia as the source of distant supervision to annotate abstracts from Wikipedia and design a neural correction model trained with a human-annotated NER dataset, DocRED, to correct the false entity labels.
Ekar: An Explainable Method for Knowledge Aware Recommendation
Recently, a variety of methods have been developed for this problem, which generally try to learn effective representations of users and items and then match items to users according to their representations.
Ranked #1 on
Recommendation Systems
on Last.FM
Learning Hierarchical Representations of Electronic Health Records for Clinical Outcome Prediction
Our model learns hierarchical representationsof event sequences, to adaptively distinguish between short-range and long-range events, and accurately capture coretemporal dependencies.
Session-based Social Recommendation via Dynamic Graph Attention Networks
However, recommendation in online communities is a challenging problem: 1) users' interests are dynamic, and 2) users are influenced by their friends.
Ranked #1 on
Recommendation Systems
on Douban
(NDCG metric)