Search Results for author:
Found 21 papers, 7 papers with code
ROMA: a Read-Only-Memory-based Accelerator for QLoRA-based On-Device LLM
In this work, we propose ROMA, a QLoRA accelerator with a hybrid storage architecture that uses ROM for quantized base models and SRAM for LoRA weights and KV cache.
RFUAV: A Benchmark Dataset for Unmanned Aerial Vehicle Detection and Identification
In addition to the dataset, RFUAV provides a baseline preprocessing method and model evaluation tools.
Cognitive-Aligned Document Selection for Retrieval-augmented Generation
Large language models (LLMs) inherently display hallucinations since the precision of generated texts cannot be guaranteed purely by the parametric knowledge they include.
STAHGNet: Modeling Hybrid-grained Heterogenous Dependency Efficiently for Traffic Prediction
Traffic flow prediction plays a critical role in the intelligent transportation system, and it is also a challenging task because of the underlying complex Spatio-temporal patterns and heterogeneities evolving across time.
UMSPU: Universal Multi-Size Phase Unwrapping via Mutual Self-Distillation and Adaptive Boosting Ensemble Segmenters
To address this issue, we propose a mutual self-distillation (MSD) mechanism and adaptive boosting ensemble segmenters to construct a universal multi-size phase unwrapping network (UMSPU).
Automating Energy-Efficient GPU Kernel Generation: A Fast Search-Based Compilation Approach
Furthermore, we introduce a dynamic updating strategy for the energy cost model, reducing the need for on-device energy measurements and accelerating the search process.
Reprogramming Pretrained Target-Specific Diffusion Models for Dual-Target Drug Design
Considering the tremendous success that deep generative models have achieved in structure-based drug design in recent years, we formulate dual-target drug design as a generative task and curate a novel dataset of potential target pairs based on synergistic drug combinations.
Swin-BERT: A Feature Fusion System designed for Speech-based Alzheimer's Dementia Detection
For the acoustic part, the shifted windows multi-head attention that proposed to extract local and global information from images, is used for designing our acoustic-based system.
Diff4VS: HIV-inhibiting Molecules Generation with Classifier Guidance Diffusion for Virtual Screening
The DrugIndex is the ratio of the proportion of candidate drug molecules in the generated molecule to the proportion of candidate drug molecules in the training set.
BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation
The upscaling of Large Language Models (LLMs) has yielded impressive advances in natural language processing, yet it also poses significant deployment challenges.
CharacterGLM: Customizing Chinese Conversational AI Characters with Large Language Models
In this paper, we present CharacterGLM, a series of models built upon ChatGLM, with model sizes ranging from 6B to 66B parameters.
AFPQ: Asymmetric Floating Point Quantization for LLMs
Large language models (LLMs) show great performance in various tasks, but face deployment challenges from limited memory capacity and bandwidth.
A Transformer-Based Model With Self-Distillation for Multimodal Emotion Recognition in Conversations
Emotion recognition in conversations (ERC), the task of recognizing the emotion of each utterance in a conversation, is crucial for building empathetic machines.
Ranked #1 on
Emotion Recognition in Conversation
on IEMOCAP
Emotion Recognition in Conversation
Multimodal Emotion Recognition
TKwinFormer: Top k Window Attention in Vision Transformers for Feature Matching
Local feature matching remains a challenging task, primarily due to difficulties in matching sparse keypoints and low-texture regions.
Adam Accumulation to Reduce Memory Footprints of both Activations and Gradients for Large-scale DNN Training
We find that previous gradient accumulation reduces activation memory but fails to be compatible with gradient memory reduction due to a contradiction between preserving gradients and releasing gradients.
Integer or Floating Point? New Outlooks for Low-Bit Quantization on Large Language Models
In this study, we conduct a comparative analysis of INT and FP quantization with the same bit-width, revealing that the optimal quantization format varies across different layers due to the complexity and diversity of tensor distribution.
TC-GAT: Graph Attention Network for Temporal Causality Discovery
The present study explores the intricacies of causal relationship extraction, a vital component in the pursuit of causality knowledge.
A Unified Review of Deep Learning for Automated Medical Coding
Automated medical coding, an essential task for healthcare operation and delivery, makes unstructured data manageable by predicting medical codes from clinical documents.
Drug–drug interaction extraction via hierarchical RNNs on sequence and shortest dependency paths
Results In this article, we present a hierarchical recurrent neural networks (RNNs)-based method to integrate the SDP and sentence sequence for DDI extraction task.
A graph kernel based on context vectors for extracting drug–drug interactions
Especially for the Medline-2013 dataset, our system outperforms the top-ranking DDIs systems by F-scores of 10. 7 and 12. 2 in detection and classification, respectively.
