Search Results for author:
Found 6 papers, 2 papers with code
USDC: Unified Static and Dynamic Compression for Visual Transformer
To alleviate two disadvantages of two categories of methods, we propose to unify the static compression and dynamic compression techniques jointly to obtain an input-adaptive compressed model, which can further better balance the total compression ratios and the model performances.
ASP: Automatic Selection of Proxy dataset for efficient AutoML
Deep neural networks have gained great success due to the increasing amounts of data, and diverse effective neural network designs.
KwaiYiiMath: Technical Report
Recent advancements in large language models (LLMs) have demonstrated remarkable abilities in handling a variety of natural language processing (NLP) downstream tasks, even on mathematical tasks requiring multi-step reasoning.
Ranked #93 on
Arithmetic Reasoning
on GSM8K
(using extra training data)
Unified Language-Vision Pretraining in LLM with Dynamic Discrete Visual Tokenization
Specifically, we introduce a well-designed visual tokenizer to translate the non-linguistic image into a sequence of discrete tokens like a foreign language that LLM can read.
LPFS: Learnable Polarizing Feature Selection for Click-Through Rate Prediction
When training is finished, some gates are exact zero, while others are around one, which is particularly favored by the practical hot-start training in the industry, due to no damage to the model performance before and after removing the features corresponding to exact-zero gates.
Adversarial Contrastive Self-Supervised Learning
Recently, learning from vast unlabeled data, especially self-supervised learning, has been emerging and attracted widespread attention.
