Search Results for author: Yuchen Liu

Found 48 papers, 20 papers with code

A Joint Gradient and Loss Based Clustered Federated Learning Design

no code implementations22 Nov 2023 Licheng Lin, Mingzhe Chen, Zhaohui Yang, Yusen Wu, Yuchen Liu

In particular, our designed clustered FL algorithm must overcome two challenges associated with FL training.

Clustering Federated Learning

BLSP: Bootstrapping Language-Speech Pre-training via Behavior Alignment of Continuation Writing

1 code implementation2 Sep 2023 Chen Wang, Minpeng Liao, Zhongqiang Huang, Jinliang Lu, Junhong Wu, Yuchen Liu, Chengqing Zong, Jiajun Zhang

One is a cascaded approach where outputs (tokens or states) of a separately trained speech recognition system are used as inputs for LLMs, which limits their potential in modeling alignment between speech and text.

speech-recognition Speech Recognition +1

Gentopia: A Collaborative Platform for Tool-Augmented LLMs

1 code implementation8 Aug 2023 Binfeng Xu, Xukun Liu, Hua Shen, Zeyu Han, Yuhan Li, Murong Yue, Zhiyuan Peng, Yuchen Liu, Ziyu Yao, Dongkuan Xu

We present gentopia, an ALM framework enabling flexible customization of agents through simple configurations, seamlessly integrating various language models, task formats, prompting modules, and plugins into a unified paradigm.

How to Detect Unauthorized Data Usages in Text-to-image Diffusion Models

no code implementations6 Jul 2023 Zhenting Wang, Chen Chen, Yuchen Liu, Lingjuan Lyu, Dimitris Metaxas, Shiqing Ma

In this paper, we propose a method for detecting such unauthorized data usage by planting injected memorization into the text-to-image diffusion models trained on the protected dataset.


NBMOD: Find It and Grasp It in Noisy Background

1 code implementation17 Jun 2023 Boyuan Cao, Xinyu Zhou, Congmin Guo, Baohua Zhang, Yuchen Liu, Qianqiu Tan

In the past few years, researchers have proposed many methods to address the above-mentioned issues and achieved very good results on publicly available datasets such as the Cornell dataset and the Jacquard dataset.

 Ranked #1 on Robotic Grasping on NBMOD (using extra training data)

Robotic Grasping

Few-shot Multi-domain Knowledge Rearming for Context-aware Defence against Advanced Persistent Threats

no code implementations13 Jun 2023 Gaolei Li, YuanYuan Zhao, Wenqi Wei, Yuchen Liu

Secondly, to rearm current security strategies, an finetuning-based deployment mechanism is proposed to transfer learned knowledge into the student model, while minimizing the defense cost.

Meta-Learning Scheduling

ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models

2 code implementations23 May 2023 Binfeng Xu, Zhiyuan Peng, Bowen Lei, Subhabrata Mukherjee, Yuchen Liu, Dongkuan Xu

Augmented Language Models (ALMs) blend the reasoning capabilities of Large Language Models (LLMs) with tools that allow for knowledge retrieval and action execution.


MMViT: Multiscale Multiview Vision Transformers

no code implementations28 Apr 2023 Yuchen Liu, Natasha Ong, Kaiyan Peng, Bo Xiong, Qifan Wang, Rui Hou, Madian Khabsa, Kaiyue Yang, David Liu, Donald S. Williamson, Hanchao Yu

Our model encodes different views of the input signal and builds several channel-resolution feature stages to process the multiple views of the input at different resolutions in parallel.

Image Classification

Ethylene Leak Detection Based on Infrared Imaging: A Benchmark

no code implementations4 Apr 2023 Xuanchao Ma, Yuchen Liu

We find that the detection criteria used in infrared imaging ethylene leakage detection research cannot fully reflect real-world production conditions, which is not conducive to evaluate the performance of current image-based target detection methods.

Multi-modal Expression Recognition with Ensemble Method

no code implementations17 Mar 2023 Chuanhe Liu, Xinjie Zhang, Xiaolong Liu, Tenggan Zhang, Liyu Meng, Yuchen Liu, Yuanyuan Deng, Wenqiang Jiang

This paper presents our submission to the Expression Classification Challenge of the fifth Affective Behavior Analysis in-the-wild (ABAW) Competition.

Byzantine-Robust Learning on Heterogeneous Data via Gradient Splitting

1 code implementation13 Feb 2023 Yuchen Liu, Chen Chen, Lingjuan Lyu, Fangzhao Wu, Sai Wu, Gang Chen

In order to address this issue, we propose GAS, a \shorten approach that can successfully adapt existing robust AGRs to non-IID settings.

Federated Learning

A Composite T60 Regression and Classification Approach for Speech Dereverberation

no code implementations9 Feb 2023 Yuying Li, Yuchen Liu, Donald S. Williamson

More specifically, we develop a joint learning approach that uses a composite T60 module and a separate dereverberation module to simultaneously perform reverberation time estimation and dereverberation.

regression Speech Dereverberation

Towards Unsupervised Domain Generalization for Face Anti-Spoofing

no code implementations ICCV 2023 Yuchen Liu, Yabo Chen, Mengran Gou, Chun-Ting Huang, Yaoming Wang, Wenrui Dai, Hongkai Xiong

In this paper, we propose the first Unsupervised Domain Generalization framework for Face Anti-Spoofing, namely UDG-FAS, which could exploit large amounts of easily accessible unlabeled data to learn generalizable features for enhancing the low-data regime of FAS.

Domain Generalization Face Anti-Spoofing

Adapting Shortcut With Normalizing Flow: An Efficient Tuning Framework for Visual Recognition

1 code implementation CVPR 2023 Yaoming Wang, Bowen Shi, Xiaopeng Zhang, Jin Li, Yuchen Liu, Wenrui Dai, Chenglin Li, Hongkai Xiong, Qi Tian

To mitigate the computational and storage demands, recent research has explored Parameter-Efficient Fine-Tuning (PEFT), which focuses on tuning a minimal number of parameters for efficient adaptation.

CCATMos: Convolutional Context-aware Transformer Network for Non-intrusive Speech Quality Assessment

no code implementations4 Nov 2022 Yuchen Liu, Li-Chia Yang, Alex Pawlicki, Marko Stamenovic

Speech quality assessment has been a critical component in many voice communication related applications such as telephony and online conferencing.

CodePAD: Sequence-based Code Generation with Pushdown Automaton

1 code implementation2 Nov 2022 Yihong Dong, Xue Jiang, Yuchen Liu, Ge Li, Zhi Jin

CodePAD can leverage existing sequence-based models, and we show that it can achieve 100\% grammatical correctness percentage on these benchmark datasets.

Code Generation Text Generation

Discrete Cross-Modal Alignment Enables Zero-Shot Speech Translation

1 code implementation18 Oct 2022 Chen Wang, Yuchen Liu, Boxing Chen, Jiajun Zhang, Wei Luo, Zhongqiang Huang, Chengqing Zong

Existing zero-shot methods fail to align the two modalities of speech and text into a shared semantic space, resulting in much worse performance compared to the supervised ST methods.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +4

3D-FM GAN: Towards 3D-Controllable Face Manipulation

no code implementations24 Aug 2022 Yuchen Liu, Zhixin Shu, Yijun Li, Zhe Lin, Richard Zhang, S. Y. Kung

While concatenating GAN inversion and a 3D-aware, noise-to-image GAN is a straight-forward solution, it is inefficient and may lead to noticeable drop in editing quality.

Court Judgement Labeling Using Topic Modeling and Syntactic Parsing

1 code implementation3 Aug 2022 Yuchen Liu

In regions that practice common law, relevant historical cases are essential references for sentencing.

Constituency Parsing Dependency Parsing +1

SdAE: Self-distillated Masked Autoencoder

1 code implementation31 Jul 2022 Yabo Chen, Yuchen Liu, Dongsheng Jiang, Xiaopeng Zhang, Wenrui Dai, Hongkai Xiong, Qi Tian

We also analyze how to build good views for the teacher branch to produce latent representation from the perspective of information bottleneck.

Descriptive Self-Supervised Learning

Multi-Task Learning Framework for Emotion Recognition in-the-wild

1 code implementation19 Jul 2022 Tenggan Zhang, Chuanhe Liu, Xiaolong Liu, Yuchen Liu, Liyu Meng, Lei Sun, Wenqiang Jiang, Fengyuan Zhang, Jinming Zhao, Qin Jin

This paper presents our system for the Multi-Task Learning (MTL) Challenge in the 4th Affective Behavior Analysis in-the-wild (ABAW) competition.

Emotion Recognition Multi-Task Learning +1

Scalable Model-based Policy Optimization for Decentralized Networked Systems

2 code implementations13 Jul 2022 Yali Du, Chengdong Ma, Yuchen Liu, Runji Lin, Hao Dong, Jun Wang, Yaodong Yang

Reinforcement learning algorithms require a large amount of samples; this often limits their real-world applications on even simple tasks.

CalFAT: Calibrated Federated Adversarial Training with Label Skewness

1 code implementation30 May 2022 Chen Chen, Yuchen Liu, Xingjun Ma, Lingjuan Lyu

In this paper, we study the problem of FAT under label skewness, and reveal one root cause of the training instability and natural accuracy degradation issues: skewed labels lead to non-identical class probabilities and heterogeneous local models.

Adversarial Robustness Federated Learning

M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Database

1 code implementation ACL 2022 Jinming Zhao, Tenggan Zhang, Jingwen Hu, Yuchen Liu, Qin Jin, Xinchao Wang, Haizhou Li

In this work, we propose a Multi-modal Multi-scene Multi-label Emotional Dialogue dataset, M3ED, which contains 990 dyadic emotional dialogues from 56 different TV series, a total of 9, 082 turns and 24, 449 utterances.

Cultural Vocal Bursts Intensity Prediction Emotion Recognition

Subspace Nonnegative Matrix Factorization for Feature Representation

1 code implementation18 Apr 2022 Junhang Li, Jiao Wei, Can Tong, Tingting Shen, Yuchen Liu, Chen Li, Shouliang Qi, YuDong Yao, Yueyang Teng

Traditional nonnegative matrix factorization (NMF) learns a new feature representation on the whole data space, which means treating all features equally.

Multi-modal Emotion Estimation for in-the-wild Videos

no code implementations24 Mar 2022 Liyu Meng, Yuchen Liu, Xiaolong Liu, Zhaopei Huang, Yuan Cheng, Meng Wang, Chuanhe Liu, Qin Jin

In this paper, we briefly introduce our submission to the Valence-Arousal Estimation Challenge of the 3rd Affective Behavior Analysis in-the-wild (ABAW) competition.

Arousal Estimation

Evolving Transferable Neural Pruning Functions

no code implementations21 Oct 2021 Yuchen Liu, S. Y. Kung, David Wentzlaff

While most prior works in evolutionary learning aim at directly searching the structure of a network, few attempts have been made on another promising track, channel pruning, which recently has made major headway in designing efficient deep learning models.

Class-Discriminative CNN Compression

no code implementations21 Oct 2021 Yuchen Liu, David Wentzlaff, S. Y. Kung

We then propose a novel layer-adaptive hierarchical pruning approach, where we use a coarse class discrimination scheme for early layers and a fine one for later layers.

MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversation

1 code implementation ACL 2021 Jingwen Hu, Yuchen Liu, Jinming Zhao, Qin Jin

Emotion recognition in conversation (ERC) is a crucial component in affective dialogue systems, which helps the system understand users' emotions and generate empathetic responses.

Emotion Recognition in Conversation

Content-Aware GAN Compression

1 code implementation CVPR 2021 Yuchen Liu, Zhixin Shu, Yijun Li, Zhe Lin, Federico Perazzi, S. Y. Kung

We then propose a novel content-aware method to guide the processes of both pruning and distillation.

Image Generation Image Manipulation +1

Finite generation for valuations computing stability thresholds and applications to K-stability

no code implementations18 Feb 2021 Yuchen Liu, Chenyang Xu, Ziquan Zhuang

We prove that on any log Fano pair of dimension $n$ whose stability threshold is less than $\frac{n+1}{n}$, any valuation computing the stability threshold has a finitely generated associated graded ring.

Algebraic Geometry Differential Geometry

Learning Latent Architectural Distribution in Differentiable Neural Architecture Search via Variational Information Maximization

no code implementations ICCV 2021 Yaoming Wang, Yuchen Liu, Wenrui Dai, Chenglin Li, Junni Zou, Hongkai Xiong

Existing differentiable neural architecture search approaches simply assume the architectural distribution on each edge is independent of each other, which conflicts with the intrinsic properties of architecture.

Neural Architecture Search

Emotions in Online Content Diffusion

no code implementations17 Nov 2020 Yifan Yu, Shan Huang, Yuchen Liu, Yong Tan

We apply a partial-linear instrumental variable approach with a double machine learning framework to causally identify the impact of the negative discrete emotions on online content diffusion.


Bridging the Modality Gap for Speech-to-Text Translation

no code implementations28 Oct 2020 Yuchen Liu, Junnan Zhu, Jiajun Zhang, Chengqing Zong

End-to-end speech translation aims to translate speech in one language into text in another language via an end-to-end way.

Speech-to-Text Translation Translation

Rethinking Class-Discrimination Based CNN Channel Pruning

no code implementations29 Apr 2020 Yuchen Liu, David Wentzlaff, S. Y. Kung

To this end, we initiate the first study on the effectiveness of a broad range of discriminant functions on channel pruning.

Synchronous Speech Recognition and Speech-to-Text Translation with Interactive Decoding

1 code implementation16 Dec 2019 Yuchen Liu, Jiajun Zhang, Hao Xiong, Long Zhou, Zhongjun He, Hua Wu, Haifeng Wang, Cheng-qing Zong

Speech-to-text translation (ST), which translates source language speech into target language text, has attracted intensive attention in recent years.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +4

Synchronously Generating Two Languages with Interactive Decoding

no code implementations IJCNLP 2019 Yining Wang, Jiajun Zhang, Long Zhou, Yuchen Liu, Cheng-qing Zong

In this paper, we introduce a novel interactive approach to translate a source language into two different languages simultaneously and interactively.

Machine Translation NMT +2

End-to-End Speech Translation with Knowledge Distillation

no code implementations17 Apr 2019 Yuchen Liu, Hao Xiong, Zhongjun He, Jiajun Zhang, Hua Wu, Haifeng Wang, Cheng-qing Zong

End-to-end speech translation (ST), which directly translates from source language speech into target language text, has attracted intensive attentions in recent years.

Knowledge Distillation speech-recognition +2

Language-Independent Representor for Neural Machine Translation

no code implementations1 Nov 2018 Long Zhou, Yuchen Liu, Jiajun Zhang, Cheng-qing Zong, Guoping Huang

Current Neural Machine Translation (NMT) employs a language-specific encoder to represent the source sentence and adopts a language-specific decoder to generate target translation.

Machine Translation Multi-Task Learning +2

Unsupervised Learning of Neural Networks to Explain Neural Networks

no code implementations18 May 2018 Quanshi Zhang, Yu Yang, Yuchen Liu, Ying Nian Wu, Song-Chun Zhu

Given feature maps of a certain conv-layer of the CNN, the explainer performs like an auto-encoder, which first disentangles the feature maps into object-part features and then inverts object-part features back to features of higher conv-layers of the CNN.


Human Curation and Convnets: Powering Item-to-Item Recommendations on Pinterest

no code implementations12 Nov 2015 Dmitry Kislyuk, Yuchen Liu, David Liu, Eric Tzeng, Yushi Jing

This paper presents Pinterest Related Pins, an item-to-item recommendation system that combines collaborative filtering with content-based ranking.

Collaborative Filtering

Cannot find the paper you are looking for? You can Submit a new open access paper.