Search Results for author:
Found 24 papers, 10 papers with code
SALO: An Efficient Spatial Accelerator Enabling Hybrid Sparse Attention Mechanisms for Long Sequences
However, the quadratic complexity of self-attention w. r. t the sequence length incurs heavy computational and memory burdens, especially for tasks with long sequences.
Transkimmer: Transformer Learns to Layer-wise Skim
To address the above limitations, we propose the Transkimmer architecture, which learns to identify hidden state tokens that are not required by each layer.
SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation
This paper proposes an on-the-fly DFQ framework with sub-second quantization time, called SQuant, which can quantize networks on inference-only devices with low computation and memory requirements.
Block-Skim: Efficient Question Answering for Transformer
We further prune the hidden states corresponding to the unnecessary positions early in lower layers, achieving significant inference-time speedup.
Dubhe: Towards Data Unbiasedness with Homomorphic Encryption in Federated Learning Client Selection
Federated learning (FL) is a distributed machine learning paradigm that allows clients to collaboratively train a model over their own local data.
TempNet: Online Semantic Segmentation on Large-Scale Point Cloud Series
In this paper, we propose a light-weight semantic segmentation framework for large-scale point cloud series, called TempNet, which can improve both the accuracy and the stability of existing semantic segmentation models by combining a novel frame aggregation scheme.
Block Skim Transformer for Efficient Question Answering
Following this idea, we proposed Block Skim Transformer (BST) to improve and accelerate the processing of transformer QA models.
How Far Does BERT Look At: Distance-based Clustering and Analysis of BERT's Attention
Recent research on the multi-head attention mechanism, especially that in pre-trained models such as BERT, has shown us heuristics and clues in analyzing various aspects of the mechanism.
How Far Does BERT Look At:Distance-based Clustering and Analysis of BERT$'$s Attention
Recent research on the multi-head attention mechanism, especially that in pre-trained models such as BERT, has shown us heuristics and clues in analyzing various aspects of the mechanism.
Architectural Implications of Graph Neural Networks
Graph neural networks (GNN) represent an emerging line of deep learning models that operate on graph structures.
Accelerating Sparse DNN Models without Hardware-Support via Tile-Wise Sparsity
Network pruning can reduce the high computation cost of deep neural network (DNN) models.
Balancing Efficiency and Flexibility for DNN Acceleration via Temporal GPU-Systolic Array Integration
We propose Simultaneous Multi-mode Architecture (SMA), a novel architecture design and execution model that offers general-purpose programmability on DNN accelerators in order to accelerate end-to-end applications.
Adversarial Defense Through Network Profiling Based Path Extraction
Recently, researchers have started decomposing deep neural network models according to their semantics or functions.
Position-Aware Convolutional Networks for Traffic Prediction
Our approach employs the inception backbone network to capture rich features of traffic distribution on the whole area.
Knowledge Graph Convolutional Networks for Recommender Systems
To alleviate sparsity and cold start problem of collaborative filtering based recommender systems, researchers and engineers usually collect attributes of users and items, and design delicate algorithms to exploit these additional information.
Ranked #1 on
Click-Through Rate Prediction
on Book-Crossing
Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendation
Collaborative filtering often suffers from sparsity and cold start problems in real recommendation scenarios, therefore, researchers and engineers usually use side information to address the issues and improve the performance of recommender systems.
Effective Path: Know the Unknowns of Neural Network
Despite their enormous success, there is still no solid understanding of deep neural network’s working mechanism.
RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systems
To address the sparsity and cold start problem of collaborative filtering, researchers usually make use of side information, such as social networks or item attributes, to improve recommendation performance.
Ranked #2 on
Click-Through Rate Prediction
on Book-Crossing
Personalized Exposure Control Using Adaptive Metering and Reinforcement Learning
We propose a reinforcement learning approach for real-time exposure control of a mobile camera that is personalizable.
DKN: Deep Knowledge-Aware Network for News Recommendation
To solve the above problems, in this paper, we propose a deep knowledge-aware network (DKN) that incorporates knowledge graph representation into news recommendation.
Ranked #4 on
News Recommendation
on MIND
Joint Topic-Semantic-aware Social Recommendation for Online Voting
JTS-MF model calculates similarity among users and votings by combining their TEWE representation and structural information of social networks, and preserves this topic-semantic-social similarity during matrix factorization.
SHINE: Signed Heterogeneous Information Network Embedding for Sentiment Link Prediction
First, due to the lack of explicit sentiment links in mainstream social networks, we establish a labeled heterogeneous sentiment dataset which consists of users' sentiment relation, social relation and profile knowledge by entity-level sentiment extraction method.
GraphGAN: Graph Representation Learning with Generative Adversarial Nets
The goal of graph representation learning is to embed each vertex in a graph into a low-dimensional vector space.
Ranked #1 on
Node Classification
on Wikipedia
Unsupervised Extraction of Video Highlights Via Robust Recurrent Auto-encoders
With the growing popularity of short-form video sharing platforms such as \em{Instagram} and \em{Vine}, there has been an increasing need for techniques that automatically extract highlights from video.
