Search Results for author: Zhiyuan Peng

Found 15 papers, 7 papers with code

Q-PEFT: Query-dependent Parameter Efficient Fine-tuning for Text Reranking with Large Language Models

no code implementations6 Apr 2024 Zhiyuan Peng, Xuyang Wu, Qifan Wang, Sravanthi Rajanala, Yi Fang

Parameter Efficient Fine-Tuning (PEFT) methods have been extensively utilized in Large Language Models (LLMs) to improve the down-streaming tasks without the cost of fine-tuing the whole LLMs.

Text Reranking

ToolNet: Connecting Large Language Models with Massive Tools via Tool Graph

no code implementations29 Feb 2024 Xukun Liu, Zhiyuan Peng, Xiaoyuan Yi, Xing Xie, Lirong Xiang, Yuchen Liu, Dongkuan Xu

While achieving remarkable progress in a broad range of tasks, large language models (LLMs) remain significantly limited in properly using massive external tools.

In-Context Learning

CLAPSep: Leveraging Contrastive Pre-trained Models for Multi-Modal Query-Conditioned Target Sound Extraction

1 code implementation27 Feb 2024 Hao Ma, Zhiyuan Peng, Mingjie Shao, Ju Liu, Xu Li, Xixin Wu

Such systems consist of two components: a query network that converts user queries into conditional embeddings, and a separation network that extracts the target sound based on conditional embeddings.

Target Sound Extraction

FNSPID: A Comprehensive Financial News Dataset in Time Series

1 code implementation9 Feb 2024 Zihan Dong, Xinyu Fan, Zhiyuan Peng

Financial market predictions utilize historical data to anticipate future stock prices and market trends.

Time Series

Explainable Trajectory Representation through Dictionary Learning

no code implementations13 Dec 2023 Yuanbo Tang, Zhiyuan Peng, Yang Li

A hierarchical dictionary learning scheme is also proposed to ensure the algorithm's scalability on large networks, leading to a multi-scale trajectory representation.

Data Compression Dictionary Learning +1

Extending Whisper with prompt tuning to target-speaker ASR

1 code implementation13 Dec 2023 Hao Ma, Zhiyuan Peng, Mingjie Shao, Jing Li, Ju Liu

Target-speaker automatic speech recognition (ASR) aims to transcribe the desired speech of a target speaker from multi-talker overlapped utterances.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +1

CoMFLP: Correlation Measure based Fast Search on ASR Layer Pruning

1 code implementation21 Sep 2023 Wei Liu, Zhiyuan Peng, Tan Lee

The search process is carried out in two steps: (1) coarse search: to determine top $K$ candidates by pruning the most redundant layers based on the correlation matrix; (2) fine search: to select the best pruning proposal among $K$ candidates using a task-specific evaluation metric.

speech-recognition Speech Recognition

Gentopia: A Collaborative Platform for Tool-Augmented LLMs

1 code implementation8 Aug 2023 Binfeng Xu, Xukun Liu, Hua Shen, Zeyu Han, Yuhan Li, Murong Yue, Zhiyuan Peng, Yuchen Liu, Ziyu Yao, Dongkuan Xu

We present gentopia, an ALM framework enabling flexible customization of agents through simple configurations, seamlessly integrating various language models, task formats, prompting modules, and plugins into a unified paradigm.

Soft Prompt Tuning for Augmenting Dense Retrieval with Large Language Models

1 code implementation17 Jul 2023 Zhiyuan Peng, Xuyang Wu, Qifan Wang, Yi Fang

We design a filter to select high-quality example document-query pairs in the prompt to further improve the quality of weak tagged queries.

Retrieval TAG +1

ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models

2 code implementations23 May 2023 Binfeng Xu, Zhiyuan Peng, Bowen Lei, Subhabrata Mukherjee, Yuchen Liu, Dongkuan Xu

Augmented Language Models (ALMs) blend the reasoning capabilities of Large Language Models (LLMs) with tools that allow for knowledge retrieval and action execution.

Retrieval

DIANES: A DEI Audit Toolkit for News Sources

no code implementations21 Mar 2022 Xiaoxiao Shang, Zhiyuan Peng, Qiming Yuan, Sabiq Khan, Lauren Xie, Yi Fang, Subramaniam Vincent

Professional news media organizations have always touted the importance that they give to multiple perspectives.

Cultural Vocal Bursts Intensity Prediction

Mixture factorized auto-encoder for unsupervised hierarchical deep factorization of speech signal

no code implementations30 Oct 2019 Zhiyuan Peng, Siyuan Feng, Tan Lee

The USM experiments on ZeroSpeech 2017 dataset verify that the frame tokenizer is able to capture linguistic content and the utterance embedder can acquire speaker-related information.

Clustering Speaker Verification

Combining Adversarial Training and Disentangled Speech Representation for Robust Zero-Resource Subword Modeling

no code implementations17 Jun 2019 Siyuan Feng, Tan Lee, Zhiyuan Peng

Experimental results on ZeroSpeech 2017 show that both approaches are effective while the latter is more prominent, and that their combination brings further marginal improvement in across-speaker condition.

Representation Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.