Search Results for author: Tiancheng Wu

Found 3 papers, 1 papers with code

Provably Convergent Federated Trilevel Learning

no code implementations19 Dec 2023 Yang Jiao, Kai Yang, Tiancheng Wu, Chengtao Jian, Jianwei Huang

To address the aforementioned challenges, this paper proposes an asynchronous federated trilevel optimization method to solve TLO problems.

Decision Making Domain Adaptation +2

Asynchronous Distributed Bilevel Optimization

1 code implementation20 Dec 2022 Yang Jiao, Kai Yang, Tiancheng Wu, Dongjin Song, Chengtao Jian

Bilevel optimization plays an essential role in many machine learning tasks, ranging from hyperparameter optimization to meta-learning.

Bilevel Optimization Hyperparameter Optimization +1

KDLSQ-BERT: A Quantized Bert Combining Knowledge Distillation with Learned Step Size Quantization

no code implementations15 Jan 2021 Jing Jin, Cai Liang, Tiancheng Wu, Liqin Zou, Zhiliang Gan

The main idea of our method is that the KD technique is leveraged to transfer the knowledge from a "teacher" model to a "student" model when exploiting LSQ to quantize that "student" model during the quantization training process.

Knowledge Distillation Language Modelling +1

Cannot find the paper you are looking for? You can Submit a new open access paper.