Search Results for author: Shan Huang

Found 17 papers, 6 papers with code

Enabling Fast 2-bit LLM on GPUs: Memory Alignment and Asynchronous Dequantization

no code implementations28 Nov 2023 Jinhao Li, Shiyao Li, Jiaming Xu, Shan Huang, Yaoxiu Lian, Jun Liu, Yu Wang, Guohao Dai

Weights are quantized by groups, while the ranges of weights are large in some groups, resulting in large quantization errors and nonnegligible accuracy loss (e. g. >3% for Llama2-7b with 2-bit quantization in GPTQ and Greenbit).

Quantization

Estimating Effects of Long-Term Treatments

no code implementations16 Aug 2023 Shan Huang, Chen Wang, Yuan Yuan, Jinglong Zhao, Jingjing Zhang

We describe the identification assumptions, the estimation strategies, and the inference technique under this framework.

TransMRSR: Transformer-based Self-Distilled Generative Prior for Brain MRI Super-Resolution

1 code implementation11 Jun 2023 Shan Huang, Xiaohong Liu, Tao Tan, Menghan Hu, Xiaoer Wei, TingLi Chen, Bin Sheng

We perform a generative task to encapsulate diverse priors into a generative network (GAN), which is the decoder sub-module of the deep non-local feature capture part, in the first stage.

Image Reconstruction Image Super-Resolution

A Novel Interpretable and Generalizable Re-synchronization Model for Cued Speech based on a Multi-Cuer Corpus

1 code implementation5 Jun 2023 Lufei Gao, Shan Huang, Li Liu

Cued Speech (CS) is a multi-modal visual coding system combining lip reading with several hand cues at the phonetic level to make the spoken language visible to the hearing impaired.

Lip Reading

Federated Learning for Metaverse: A Survey

no code implementations23 Mar 2023 Yao Chen, Shan Huang, Wensheng Gan, Gengsen Huang, Yongdong Wu

In this paper, we review some of the early advances of FL4M, which will be a research direction with unlimited development potential.

Edge-computing Federated Learning +1

TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities

3 code implementations13 Dec 2022 Zhe Zhao, Yudong Li, Cheng Hou, Jing Zhao, Rong Tian, Weijie Liu, Yiren Chen, Ningyuan Sun, Haoyan Liu, Weiquan Mao, Han Guo, Weigang Guo, Taiqiang Wu, Tao Zhu, Wenhang Shi, Chen Chen, Shan Huang, Sihong Chen, Liqun Liu, Feifei Li, Xiaoshuai Chen, Xingwu Sun, Zhanhui Kang, Xiaoyong Du, Linlin Shen, Kimmo Yan

The proposed pre-training models of different modalities are showing a rising trend of homogeneity in their model structures, which brings the opportunity to implement different pre-training models within a uniform framework.

Contrastive Credibility Propagation for Reliable Semi-Supervised Learning

1 code implementation17 Nov 2022 Brody Kutt, Pralay Ramteke, Xavier Mignot, Pamela Toman, Nandini Ramanan, Sujit Rokka Chhetri, Shan Huang, Min Du, William Hewlett

CCP unifies semi-supervised learning and noisy label learning for the goal of reliably outperforming a supervised baseline in any data scenario.

Pseudo Label

Dynamic optical contrast imaging for real-time delineation of tumor resection margins using head and neck cancer as a model

no code implementations15 Feb 2022 Yong Hu, Shan Huang, Albert Y. Han, Seong Moon, Jeffrey F. Krane, Oscar Stafsudd, Warren Grundfest, Maie A. St. John

Complete surgical resection of the tumor for Head and neck squamous cell carcinoma (HNSCC) remains challenging, given the devastating side effects of aggressive surgery and the anatomic proximity to vital structures.

Specificity

WebUAV-3M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Tracking

1 code implementation19 Jan 2022 Chunhui Zhang, Guanjie Huang, Li Liu, Shan Huang, Yinan Yang, Xiang Wan, Shiming Ge, DaCheng Tao

In this work, we propose WebUAV-3M, the largest public UAV tracking benchmark to date, to facilitate both the development and evaluation of deep UAV trackers.

Factor Representation and Decision Making in Stock Markets Using Deep Reinforcement Learning

no code implementations3 Aug 2021 Zhaolu Dong, Shan Huang, Simiao Ma, Yining Qian

Deep Reinforcement learning is a branch of unsupervised learning in which an agent learns to act based on environment state in order to maximize its total reward.

Decision Making Management +2

Two Stochastic Control Problems In Capital Structure and Portfolio Choice

no code implementations5 Jul 2021 Shan Huang

In the first problem, we derive a stochastic control model to optimize banks' dividend and recapitalization policies and calibrate that to a sample of U. S. banks in the situation where we model banks' true accounting asset values as partially observed variables due to the opaqueness in banks' assets.

Vocal Bursts Valence Prediction

Emotions in Online Content Diffusion

no code implementations17 Nov 2020 Yifan Yu, Shan Huang, Yuchen Liu, Yong Tan

We apply a partial-linear instrumental variable approach with a double machine learning framework to causally identify the impact of the negative discrete emotions on online content diffusion.

Marketing

Predicting nucleation near the spinodal in the Ising model using machine learning

no code implementations20 Apr 2020 Shan Huang, William Klein, Harvey Gould

We use a Convolutional Neural Network (CNN) and two logistic regression models to predict the probability of nucleation in the two-dimensional Ising model.

BIG-bench Machine Learning regression

A Study of Pyramid Structure for Code Correction

no code implementations28 Jan 2020 Shan Huang, Xiao Zhou, Sang Chin

We demonstrate the implementations of pyramid encoders in both multi-layer GRU and Transformer for seq2seq tasks.

Software Engineering

Cannot find the paper you are looking for? You can Submit a new open access paper.