Search Results for author:
Found 17 papers, 7 papers with code
Q*: Improving Multi-step Reasoning for LLMs with Deliberative Planning
Large Language Models (LLMs) have demonstrated impressive capability in many natural language tasks.
Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
In this technical report, we introduce the training methodologies implemented in the development of Skywork-MoE, a high-performance mixture-of-experts (MoE) large language model (LLM) with 146 billion parameters and 16 experts.
LongSkywork: A Training Recipe for Efficiently Extending Context Length in Large Language Models
We introduce LongSkywork, a long-context Large Language Model (LLM) capable of processing up to 200, 000 tokens.
KeNet:Knowledge-enhanced Doc-Label Attention Network for Multi-label text classification
It is imperative to additionally acknowledge that the significance of knowledge is substantiated in the realm of MLTC.
When Spatio-Temporal Meet Wavelets: Disentangled Traffic Forecasting via Efficient Spectral Graph Attention Networks
To capture these intricate dependencies, spatio-temporal networks, such as recurrent neural networks with graph convolution networks, graph convolution networks with temporal convolution networks, and temporal attention networks with full graph attention networks, are applied.
Ranked #2 on
Traffic Prediction
on PeMSD8
MolKD: Distilling Cross-Modal Knowledge in Chemical Reactions for Molecular Property Prediction
This paper studies this problem and proposes to incorporate chemical domain knowledge, specifically related to chemical reactions, for learning effective molecular representations.
Copy-Pasting Coherent Depth Regions Improves Contrastive Learning for Urban-Scene Segmentation
For unsupervised semantic segmentation of urban scenes, our method surpasses the previous state-of-the-art baseline by +7. 14% in mIoU on Cityscapes and +6. 65% on KITTI.
ImDrug: A Benchmark for Deep Imbalanced Learning in AI-aided Drug Discovery
The last decade has witnessed a prosperous development of computational methods and dataset curation for AI-aided drug discovery (AIDD).
ImGCL: Revisiting Graph Contrastive Learning on Imbalanced Node Classification
Motivated by this observation, we propose a principled GCL framework on Imbalanced node classification (ImGCL), which automatically and adaptively balances the representations learned from GCL without labels.
Spatio-Temporal meets Wavelet: Disentangled Traffic Flow Forecasting via Efficient Spectral Graph Attention Network
Traffic forecasting is crucial for public safety and resource optimization, yet is very challenging due to three aspects: i) current existing works mostly exploit intricate temporal patterns (e. g., the short-term thunderstorm and long-term daily trends) within a single method, which fail to accurately capture spatio-temporal dependencies under different schemas; ii) the under-exploration of the graph positional encoding limit the extraction of spatial information in the commonly used full graph attention network; iii) the quadratic complexity of the full graph attention introduces heavy computational needs.
CDGNet: A Cross-Time Dynamic Graph-based Deep Learning Model for Traffic Forecasting
Besides, we propose a novel encoder-decoder architecture to incorporate the cross-time dynamic graph-based GCN for multi-step traffic forecasting.
Inductive Matrix Completion Using Graph Autoencoder
However, without node content (i. e., side information) for training, the user (or item) specific representation can not be learned in the inductive setting, that is, a model trained on one group of users (or items) cannot adapt to new users (or items).
Ranked #3 on
Recommendation Systems
on MovieLens 1M
Trade When Opportunity Comes: Price Movement Forecasting via Locality-Aware Attention and Iterative Refinement Labeling
Price movement forecasting, aimed at predicting financial asset trends based on current market information, has achieved promising advancements through machine learning (ML) methods.
AKE-GNN: Effective Graph Learning with Adaptive Knowledge Exchange
In this paper, we propose to substitute these redundant channels with other informative channels to achieve this goal.
Context-Aware Sparse Deep Coordination Graphs
Learning sparse coordination graphs adaptive to the coordination dynamics among agents is a long-standing problem in cooperative multi-agent learning.
AnatomyNet: Deep Learning for Fast and Fully Automated Whole-volume Segmentation of Head and Neck Anatomy
Methods: Our deep learning model, called AnatomyNet, segments OARs from head and neck CT images in an end-to-end fashion, receiving whole-volume HaN CT images as input and generating masks of all OARs of interest in one shot.
