Search Results for author: Tao Feng

Found 42 papers, 15 papers with code

ZeroFlow: Overcoming Catastrophic Forgetting is Easier than You Think

no code implementations2 Jan 2025 Tao Feng, Wei Li, Didi Zhu, Hangjie Yuan, Wendi Zheng, Dan Zhang, Jie Tang

This work provides essential insights and tools for advancing forward pass methods to overcome forgetting.

Continual Learning

ResearchTown: Simulator of Human Research Community

1 code implementation23 Dec 2024 Haofei Yu, Zhaochen Hong, Zirui Cheng, Kunlun Zhu, Keyang Xuan, Jinwei Yao, Tao Feng, Jiaxuan You

Our experiments reveal three key findings: (1) ResearchTown can provide a realistic simulation of collaborative research activities, including paper writing and review writing; (2) ResearchTown can maintain robust simulation with multiple researchers and diverse papers; (3) ResearchTown can generate interdisciplinary research ideas that potentially inspire novel research directions.

PointTalk: Audio-Driven Dynamic Lip Point Cloud for 3D Gaussian-based Talking Head Synthesis

no code implementations11 Dec 2024 Yifan Xie, Tao Feng, Xin Zhang, Xiangyang Luo, Zixuan Guo, Weijiang Yu, Heng Chang, Fei Ma, Fei Richard Yu

Furthermore, we integrate the audio-point enhancement module, which not only ensures the synchronization of the audio signal with the corresponding lip point cloud within the feature space, but also facilitates a deeper understanding of the interrelations among cross-modal conditional features.

CCIS-Diff: A Generative Model with Stable Diffusion Prior for Controlled Colonoscopy Image Synthesis

no code implementations19 Nov 2024 Yifan Xie, Jingge Wang, Tao Feng, Fei Ma, Yang Li

Our method offers precise control over both the spatial attributes (polyp location and shape) and clinical characteristics of polyps that align with clinical descriptions.

Image Generation

Graph of Records: Boosting Retrieval Augmented Generation for Long-context Summarization with Graphs

1 code implementation14 Oct 2024 Haozhen Zhang, Tao Feng, Jiaxuan You

In this paper, we propose \textit{graph of records} (\textbf{GoR}), which leverages historical responses generated by LLMs to enhance RAG for long-context global summarization.

Graph Neural Network RAG +1

GraphRouter: A Graph-based Router for LLM Selections

no code implementations4 Oct 2024 Tao Feng, Yanzhen Shen, Jiaxuan You

The rapidly growing number and variety of Large Language Models (LLMs) present significant challenges in efficiently selecting the appropriate LLM for a given query, especially considering the trade-offs between performance and computational cost.

Transductive Learning

Paper Copilot: A Self-Evolving and Efficient LLM System for Personalized Academic Assistance

no code implementations6 Sep 2024 GuanYu Lin, Tao Feng, Pengrui Han, Ge Liu, Jiaxuan You

As scientific research proliferates, researchers face the daunting task of navigating and reading vast amounts of literature.

Retrieval

Learning in Order! A Sequential Strategy to Learn Invariant Features for Multimodal Sentiment Analysis

no code implementations5 Sep 2024 Xianbing Zhao, Lizhen Qu, Tao Feng, Jianfei Cai, Buzhou Tang

This work proposes a novel and simple sequential learning strategy to train models on videos and texts for multimodal sentiment analysis.

feature selection Multimodal Sentiment Analysis

BattleAgentBench: A Benchmark for Evaluating Cooperation and Competition Capabilities of Language Models in Multi-Agent Systems

no code implementations28 Aug 2024 Wei Wang, Dan Zhang, Tao Feng, Boyan Wang, Jie Tang

Compared to single agents, multi-agent systems have higher requirements for the collaboration capabilities of language models.

From Pre-training Corpora to Large Language Models: What Factors Influence LLM Performance in Causal Discovery Tasks?

no code implementations29 Jul 2024 Tao Feng, Lizhen Qu, Niket Tandon, Zhuang Li, Xiaoxi Kang, Gholamreza Haffari

Recent advances in artificial intelligence have seen Large Language Models (LLMs) demonstrate notable proficiency in causal discovery tasks.

Causal Discovery

Solving the Model Unavailable MARE using Q-Learning Algorithm

no code implementations18 Jul 2024 Fei Yan, Jie Gao, Tao Feng, Jianxing Liu

In this paper, the discrete-time modified algebraic Riccati equation (MARE) is solved when the system model is completely unavailable.

Q-Learning

CausalScore: An Automatic Reference-Free Metric for Assessing Response Relevance in Open-Domain Dialogue Systems

no code implementations25 Jun 2024 Tao Feng, Lizhen Qu, Xiaoxi Kang, Gholamreza Haffari

Automatically evaluating the quality of responses in open-domain dialogue systems is a challenging but crucial task.

Causal Discovery Inspired Unsupervised Domain Adaptation for Emotion-Cause Pair Extraction

no code implementations18 Jun 2024 Yuncheng Hua, Yujin Huang, Shuo Huang, Tao Feng, Lizhen Qu, Chris Bain, Richard Bassed, Gholamreza Haffari

Inspired by causal discovery, we propose a novel deep latent model in the variational autoencoder (VAE) framework, which not only captures the underlying latent structures of data but also utilizes the easily transferable knowledge of emotions as the bridge to link the distributions of events in different domains.

Causal Discovery Emotion-Cause Pair Extraction +2

How Far Are We From AGI: Are LLMs All We Need?

1 code implementation16 May 2024 Tao Feng, Chuanyang Jin, Jingyu Liu, Kunlun Zhu, Haoqin Tu, Zirui Cheng, GuanYu Lin, Jiaxuan You

The evolution of artificial intelligence (AI) has profoundly impacted human society, driving significant advancements in multiple sectors.

Revisiting Neural Networks for Continual Learning: An Architectural Perspective

1 code implementation23 Apr 2024 Aojun Lu, Tao Feng, Hangjie Yuan, Xiaotian Song, Yanan sun

This paper seeks to bridge this gap between network architecture design and CL, and to present a holistic study on the impact of network architectures on CL.

Class Incremental Learning Incremental Learning

Constructing Data Transaction Chains Based on Opportunity Cost Exploration

no code implementations8 Apr 2024 Jie Liu, Tao Feng, Yan Jiang, Peizheng Wang, Chao Wu

However, the inherent replicability and privacy concerns of data make it challenging to directly apply traditional trading theories to data markets.

Make Continual Learning Stronger via C-Flat

1 code implementation1 Apr 2024 Ang Bian, Wei Li, Hangjie Yuan, Chengrong Yu, Mang Wang, Zixiang Zhao, Aojun Lu, Pengliang Ji, Tao Feng

A general framework of C-Flat applied to all CL categories and a thorough comparison with loss minima optimizer and flat minima based CL approaches is presented in this paper, showing that our method can boost CL performance in almost all cases.

Continual Learning

Deep Reinforcement Learning for Modelling Protein Complexes

no code implementations11 Mar 2024 Ziqi Gao, Tao Feng, Jiaxuan You, Chenyi Zi, Yan Zhou, Chen Zhang, Jia Li

In this work, by taking each chain as a node and assembly actions as edges, we show that an acyclic undirected connected graph can be used to predict the structure of multi-chain protein complexes (a. k. a., protein complex modelling, PCM).

Combinatorial Optimization Deep Reinforcement Learning +2

RENOVI: A Benchmark Towards Remediating Norm Violations in Socio-Cultural Conversations

no code implementations17 Feb 2024 Haolan Zhan, Zhuang Li, Xiaoxi Kang, Tao Feng, Yuncheng Hua, Lizhen Qu, Yi Ying, Mei Rianto Chandra, Kelly Rosalin, Jureynolds Jureynolds, Suraj Sharma, Shilin Qu, Linhao Luo, Lay-Ki Soon, Zhaleh Semnani Azad, Ingrid Zukerman, Gholamreza Haffari

While collecting sufficient human-authored data is costly, synthetic conversations provide suitable amounts of data to help mitigate the scarcity of training data, as well as the chance to assess the alignment between LLMs and humans in the awareness of social norms.

InstructVideo: Instructing Video Diffusion Models with Human Feedback

1 code implementation CVPR 2024 Hangjie Yuan, Shiwei Zhang, Xiang Wang, Yujie Wei, Tao Feng, Yining Pan, Yingya Zhang, Ziwei Liu, Samuel Albanie, Dong Ni

To tackle this problem, we propose InstructVideo to instruct text-to-video diffusion models with human feedback by reward fine-tuning.

Video Generation

RDBench: ML Benchmark for Relational Databases

no code implementations25 Oct 2023 Zizhao Zhang, Yi Yang, Lutong Zou, He Wen, Tao Feng, Jiaxuan You

Benefiting from high-quality datasets and standardized evaluation metrics, machine learning (ML) has achieved sustained progress and widespread applications.

Benchmarking

Molecular De Novo Design through Transformer-based Reinforcement Learning

no code implementations9 Oct 2023 Pengcheng Xu, Tao Feng, Tianfan Fu, Siddhartha Laghuvarapu, Jimeng Sun

In contrast to the traditional RNN-based models, our proposed method exhibits superior performance in generating compounds predicted to be active against various biological targets, capturing long-term dependencies in the molecular structure sequence.

reinforcement-learning Reinforcement Learning

CITING: Large Language Models Create Curriculum for Instruction Tuning

no code implementations4 Oct 2023 Tao Feng, Zifeng Wang, Jimeng Sun

Specifically, we employ a teacher LLM to create a curriculum for instruction tuning of the student LLM, namely Curriculum Instruction TunING (CITING).

RLIPv2: Fast Scaling of Relational Language-Image Pre-training

3 code implementations ICCV 2023 Hangjie Yuan, Shiwei Zhang, Xiang Wang, Samuel Albanie, Yining Pan, Tao Feng, Jianwen Jiang, Dong Ni, Yingya Zhang, Deli Zhao

In this paper, we propose RLIPv2, a fast converging model that enables the scaling of relational pre-training to large-scale pseudo-labelled scene graph data.

 Ranked #1 on Zero-Shot Human-Object Interaction Detection on HICO-DET (using extra training data)

Graph Generation Human-Object Interaction Detection +6

Towards Efficient Deep Hashing Retrieval: Condensing Your Data via Feature-Embedding Matching

1 code implementation29 May 2023 Tao Feng, Jie Zhang, Peizheng Wang, Zhijie Wang

The expenses involved in training state-of-the-art deep hashing retrieval models have witnessed an increase due to the adoption of more sophisticated models and large-scale datasets.

Dataset Condensation Dataset Distillation +2

Refined Response Distillation for Class-Incremental Player Detection

no code implementations1 May 2023 Liang Bai, Hangjie Yuan, Tao Feng, Hong Song, Jian Yang

Furthermore, we present the NBA-IOD and Volleyball-IOD datasets as the benchmark and investigate the IOD tasks of the players systematically.

Knowledge Distillation object-detection +1

Less is More: Mitigate Spurious Correlations for Open-Domain Dialogue Response Generation Models by Causal Discovery

1 code implementation2 Mar 2023 Tao Feng, Lizhen Qu, Gholamreza Haffari

In this paper, we conduct the first study on spurious correlations for open-domain response generation models based on a corpus CGDIALOG curated in our work.

Causal Discovery Informativeness +1

Let's Negotiate! A Survey of Negotiation Dialogue Systems

no code implementations18 Dec 2022 Haolan Zhan, YuFei Wang, Tao Feng, Yuncheng Hua, Suraj Sharma, Zhuang Li, Lizhen Qu, Gholamreza Haffari

Negotiation is one of the crucial abilities in human communication, and there has been a resurgent research interest in negotiation dialogue systems recently, which goal is to empower intelligent agents with such ability that can efficiently help humans resolve conflicts or reach beneficial agreements.

Survey

Progressive Learning without Forgetting

no code implementations28 Nov 2022 Tao Feng, Hangjie Yuan, Mang Wang, Ziyuan Huang, Ang Bian, Jianzhou Zhang

Learning from changing tasks and sequential experience without forgetting the obtained knowledge is a challenging problem for artificial neural networks.

Continual Learning

Efficient Demand Response Location Targeting for Price Spike Mitigation by Exploiting Price-demand Relationship

no code implementations27 Nov 2022 Yufan Zhang, Honglin Wen, Tao Feng, Yize Chen

We formulate a bilevel program where the upper level determines the DR locations and demand reductions while ensuring the average nodal prices meet a predetermined target.

Benchmarking

RLIP: Relational Language-Image Pre-training for Human-Object Interaction Detection

3 code implementations5 Sep 2022 Hangjie Yuan, Jianwen Jiang, Samuel Albanie, Tao Feng, Ziyuan Huang, Dong Ni, Mingqian Tang

The task of Human-Object Interaction (HOI) detection targets fine-grained visual parsing of humans interacting with their environment, enabling a broad range of applications.

Human-Object Interaction Detection Relation +1

Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation

1 code implementation CVPR 2022 Tao Feng, Mang Wang, Hangjie Yuan

In this paper, we propose a response-based incremental distillation method, dubbed Elastic Response Distillation (ERD), which focuses on elastically learning responses from the classification head and the regression head.

Class-Incremental Object Detection Incremental Learning +3

Response-based Distillation for Incremental Object Detection

no code implementations26 Oct 2021 Tao Feng, Mang Wang

However, fine-tuning directly on a well-trained detection model with only new data will leads to catastrophic forgetting.

Incremental Learning Knowledge Distillation +4

Few-Shot Conversational Dense Retrieval

1 code implementation10 May 2021 Shi Yu, Zhenghao Liu, Chenyan Xiong, Tao Feng, Zhiyuan Liu

In this paper, we present a Conversational Dense Retrieval system, ConvDR, that learns contextualized embeddings for multi-turn conversational queries and retrieves documents solely using embedding dot products.

Conversational Search Retrieval

Reinforced Contact Tracing and Epidemic Intervention

no code implementations4 Feb 2021 Tao Feng, Sirui Song, Tong Xia, Yong Li

In this paper, we develop an Individual-based Reinforcement Learning Epidemic Control Agent (IDRLECA) to search for smart epidemic control strategies that can simultaneously minimize infections and the cost of mobility intervention.

On codes in the projective linear group $PGL(2,q)$

no code implementations2 Sep 2020 Tao Feng, Weicong Li, Jingkun Zhou

In this paper, we resolve a conjecture of Green and Liebeck [Disc.

Combinatorics

Cannot find the paper you are looking for? You can Submit a new open access paper.