Search Results for author: Chi Wang

Found 56 papers, 23 papers with code

Autellix: An Efficient Serving Engine for LLM Agents as General Programs

no code implementations19 Feb 2025 Michael Luo, Xiaoxiang Shi, Colin Cai, Tianjun Zhang, Justin Wong, Yichuan Wang, Chi Wang, Yanping Huang, Zhifeng Chen, Joseph E. Gonzalez, Ion Stoica

Large language model (LLM) applications are evolving beyond simple chatbots into dynamic, general-purpose agentic programs, which scale LLM calls and output tokens to help AI agents reason, explore, and solve complex tasks.

Blocking Language Modeling +3

Automating Prompt Leakage Attacks on Large Language Models Using Agentic Approach

1 code implementation18 Feb 2025 Tvrtko Sternak, Davor Runje, Dorian Granoša, Chi Wang

We define prompt leakage as a critical threat to secure LLM deployment and introduce a framework for testing the robustness of LLMs using agentic teams.

NLGR: Utilizing Neighbor Lists for Generative Rerank in Personalized Recommendation Systems

no code implementations10 Feb 2025 Shuli Wang, Xue Wei, Senjie Kou, Chi Wang, Wenshuai Chen, Qi Tang, Yinhua Zhu, Xiong Xiao, Xingxing Wang

To address these issues, we propose a utilizing Neighbor Lists model for Generative Reranking (NLGR), which aims to improve the performance of the generator in the combinatorial space.

Recommendation Systems

Detail-Preserving Latent Diffusion for Stable Shadow Removal

no code implementations23 Dec 2024 Jiamin Xu, Yuxin Zheng, Zelong Li, Chi Wang, Renshu Gu, Weiwei Xu, Gang Xu

The cross-dataset evaluation further demonstrates that our method generalizes effectively to unseen data, enhancing the applicability of shadow removal methods.

Decoder Diversity +1

AnimateAnything: Consistent and Controllable Animation for Video Generation

no code implementations16 Nov 2024 Guojun Lei, Chi Wang, Hong Li, Rong Zhang, Yikai Wang, Weiwei Xu

We present a unified controllable video generation approach AnimateAnything that facilitates precise and consistent video manipulation across various conditions, including camera trajectories, text prompts, and user motion annotations.

Video Generation

EcoAct: Economic Agent Determines When to Register What Action

no code implementations3 Nov 2024 Shaokun Zhang, Jieyu Zhang, Dujian Ding, Mirian Hipolito Garcia, Ankur Mallick, Daniel Madrigal, Menglin Xia, Victor Rühle, Qingyun Wu, Chi Wang

Recent advancements have enabled Large Language Models (LLMs) to function as agents that can perform actions using external tools.

Steering Large Language Models between Code Execution and Textual Reasoning

1 code implementation4 Oct 2024 Yongchao Chen, Harsh Jhamtani, Srinagesh Sharma, Chuchu Fan, Chi Wang

Textual reasoning has inherent limitations in solving tasks with challenges in math, logics, optimization, and searching, which is unlikely to be solved by simply scaling up the model and data size.

Code Generation Math +1

Interactive Speculative Planning: Enhance Agent Efficiency through Co-design of System and User Interface

no code implementations30 Sep 2024 Wenyue Hua, Mengting Wan, Shashank Vadrevu, Ryan Nadel, Yongfeng Zhang, Chi Wang

Agents, as user-centric tools, are increasingly deployed for human task delegation, assisting with a broad spectrum of requests by generating thoughts, engaging with user proxies, and producing action plans.

AutoGen Studio: A No-Code Developer Tool for Building and Debugging Multi-Agent Systems

1 code implementation9 Aug 2024 Victor Dibia, Jingya Chen, Gagan Bansal, Suff Syed, Adam Fourney, Erkang Zhu, Chi Wang, Saleema Amershi

Multi-agent systems, where multiple agents (generative AI models + tools) collaborate, are emerging as an effective pattern for solving long-running, complex tasks in numerous domains.

Adaptive In-conversation Team Building for Language Model Agents

1 code implementation29 May 2024 Linxin Song, Jiale Liu, Jieyu Zhang, Shaokun Zhang, Ao Luo, Shijian Wang, Qingyun Wu, Chi Wang

Leveraging multiple large language model (LLM) agents has shown to be a promising approach for tackling complex tasks, while the effective design of multiple agents for a particular application remains an art.

Diversity Language Modeling +3

Assessing and Verifying Task Utility in LLM-Powered Applications

no code implementations3 May 2024 Negar Arabzadeh, Siqing Huo, Nikhil Mehta, Qinqyun Wu, Chi Wang, Ahmed Awadallah, Charles L. A. Clarke, Julia Kiseleva

The rapid development of Large Language Models (LLMs) has led to a surge in applications that facilitate collaboration among multiple agents, assisting humans in their daily tasks.

Math

Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing

no code implementations22 Apr 2024 Dujian Ding, Ankur Mallick, Chi Wang, Robert Sim, Subhabrata Mukherjee, Victor Ruhle, Laks V. S. Lakshmanan, Ahmed Hassan Awadallah

Large language models (LLMs) excel in most NLP tasks but also require expensive cloud servers for deployment due to their size, while smaller models that can be deployed on lower cost (e. g., edge) devices, tend to lag behind in terms of response quality.

Budget-aware Query Tuning: An AutoML Perspective

no code implementations29 Mar 2024 Wentao Wu, Chi Wang

We further extend our study from tuning a single query to tuning a workload with multiple queries, and we call this generalized problem budget-aware workload tuning (WT), which aims for minimizing the execution time of the entire workload.

AutoML

Mora: Enabling Generalist Video Generation via A Multi-Agent Framework

1 code implementation20 Mar 2024 Zhengqing Yuan, Yixin Liu, Yihan Cao, Weixiang Sun, Haolong Jia, Ruoxi Chen, Zhaoxu Li, Bin Lin, Li Yuan, Lifang He, Chi Wang, Yanfang Ye, Lichao Sun

Existing open-source methods struggle to achieve comparable performance, often hindered by ineffective agent collaboration and inadequate training data quality.

Image to Video Generation Text-to-Video Generation +1

StateFlow: Enhancing LLM Task-Solving through State-Driven Workflows

3 code implementations17 Mar 2024 Yiran Wu, Tianwei Yue, Shaokun Zhang, Chi Wang, Qingyun Wu

In StateFlow, we distinguish between "process grounding" (via state and state transitions) and "sub-task solving" (through actions within a state), enhancing control and interpretability of the task-solving procedure.

Management

Offline Training of Language Model Agents with Functions as Learnable Weights

1 code implementation17 Feb 2024 Shaokun Zhang, Jieyu Zhang, Jiale Liu, Linxin Song, Chi Wang, Ranjay Krishna, Qingyun Wu

Researchers and practitioners have recently reframed powerful Large Language Models (LLMs) as agents, enabling them to automate complex tasks largely via the use of specialized functions.

Language Modeling Language Modelling

Towards better Human-Agent Alignment: Assessing Task Utility in LLM-Powered Applications

no code implementations14 Feb 2024 Negar Arabzadeh, Julia Kiseleva, Qingyun Wu, Chi Wang, Ahmed Awadallah, Victor Dibia, Adam Fourney, Charles Clarke

The rapid development in the field of Large Language Models (LLMs) has led to a surge in applications that facilitate collaboration among multiple agents to assist humans in their daily tasks.

Math

EcoAssistant: Using LLM Assistant More Affordably and Accurately

1 code implementation3 Oct 2023 Jieyu Zhang, Ranjay Krishna, Ahmed H. Awadallah, Chi Wang

Today, users ask Large language models (LLMs) as assistants to answer queries that require external knowledge; they ask about the weather in a specific city, about stock prices, and even about where specific locations are within their neighborhood.

Instruction Mining: Instruction Data Selection for Tuning Large Language Models

no code implementations12 Jul 2023 Yihan Cao, Yanbin Kang, Chi Wang, Lichao Sun

Large language models (LLMs) are initially pretrained for broad capabilities and then finetuned with instruction-following datasets to improve their performance in interacting with humans.

Instruction Following Language Modeling +2

MathChat: Converse to Tackle Challenging Math Problems with LLM Agents

2 code implementations2 Jun 2023 Yiran Wu, Feiran Jia, Shaokun Zhang, Hangyu Li, Erkang Zhu, Yue Wang, Yin Tat Lee, Richard Peng, Qingyun Wu, Chi Wang

Employing Large Language Models (LLMs) to address mathematical problems is an intriguing research endeavor, considering the abundance of math problems expressed in natural language across numerous science and engineering fields.

Elementary Mathematics Math +1

HyperTime: Hyperparameter Optimization for Combating Temporal Distribution Shifts

no code implementations28 May 2023 Shaokun Zhang, Yiran Wu, Zhonghua Zheng, Qingyun Wu, Chi Wang

In this work, we propose a hyperparameter optimization method named \emph{HyperTime} to find hyperparameters robust to potential temporal distribution shifts in the unseen test data.

Hyperparameter Optimization Philosophy

Cost-Effective Hyperparameter Optimization for Large Language Model Generation Inference

3 code implementations8 Mar 2023 Chi Wang, Susan Xueqing Liu, Ahmed H. Awadallah

Large Language Models (LLMs) have sparked significant interest in their generative capabilities, leading to the development of various commercial applications.

Hyperparameter Optimization Language Modeling +3

ACE: Adaptive Constraint-aware Early Stopping in Hyperparameter Optimization

no code implementations4 Aug 2022 Yi-Wei Chen, Chi Wang, Amin Saied, Rui Zhuang

Deploying machine learning models requires high model quality and needs to comply with application constraints.

Fairness Hyperparameter Optimization

Mining Robust Default Configurations for Resource-constrained AutoML

no code implementations20 Feb 2022 Moe Kayali, Chi Wang

Automatic machine learning (AutoML) is a key enabler of the mass deployment of the next generation of machine learning systems.

AutoML BIG-bench Machine Learning

Bounding the Last Mile: Efficient Learned String Indexing

no code implementations29 Nov 2021 Benjamin Spector, Andreas Kipf, Kapil Vaidya, Chi Wang, Umar Farooq Minhas, Tim Kraska

RSS achieves this by using the minimal string prefix to sufficiently distinguish the data unlike most learned approaches which index the entire string.

FairAutoML: Embracing Unfairness Mitigation in AutoML

no code implementations11 Nov 2021 Qingyun Wu, Chi Wang

In this work, we propose an Automated Machine Learning (AutoML) system to search for models not only with good prediction accuracy but also fair.

AutoML BIG-bench Machine Learning +1

Geometry Attention Transformer with Position-aware LSTMs for Image Captioning

1 code implementation1 Oct 2021 Chi Wang, Yulin Shen, Luping Ji

In recent years, transformer structures have been widely applied in image captioning with impressive performance.

Decoder Image Captioning +1

An Empirical Study on Hyperparameter Optimization for Fine-Tuning Pre-trained Language Models

1 code implementation ACL 2021 Xueqing Liu, Chi Wang

We find that using the same time budget, HPO often fails to outperform grid search due to two reasons: insufficient time budget and overfitting.

Hyperparameter Optimization

ChaCha for Online AutoML

1 code implementation9 Jun 2021 Qingyun Wu, Chi Wang, John Langford, Paul Mineiro, Marco Rossi

We propose the ChaCha (Champion-Challengers) algorithm for making an online choice of hyperparameters in online learning settings.

AutoML Scheduling

Attention-guided Temporally Coherent Video Object Matting

1 code implementation24 May 2021 Yunke Zhang, Chi Wang, Miaomiao Cui, Peiran Ren, Xuansong Xie, Xian-Sheng Hua, Hujun Bao, QiXing Huang, Weiwei Xu

Experimental results show that our method can generate high-quality alpha mattes for various videos featuring appearance change, occlusion, and fast motion.

Image Matting Object +4

DynaTune: Dynamic Tensor Program Optimization in Deep Neural Network Compilation

no code implementations ICLR 2021 Minjia Zhang, Menghao Li, Chi Wang, Mingqin Li

Recently, the DL compiler, together with Learning to Compile has proven to be a powerful technique for optimizing deep learning models.

Decision Making Uncertainty Quantification

ECONOMIC HYPERPARAMETER OPTIMIZATION WITH BLENDED SEARCH STRATEGY

no code implementations ICLR 2021 Chi Wang, Qingyun Wu, Silu Huang, Amin Saied

We study the problem of using low cost to search for hyperparameter configurations in a large search space with heterogeneous evaluation cost and model quality.

Hyperparameter Optimization

AdaTune: Adaptive Tensor Program Compilation Made Efficient

no code implementations NeurIPS 2020 Menghao Li, Minjia Zhang, Chi Wang, Mingqin Li

Deep learning models are computationally intense, and implementations often have to be highly optimized by experts or hardware vendors to be usable in practice.

A Matrix Chernoff Bound for Markov Chains and Its Application to Co-occurrence Matrices

no code implementations NeurIPS 2020 Jiezhong Qiu, Chi Wang, Ben Liao, Richard Peng, Jie Tang

Our result gives the first bound on the convergence rate of the co-occurrence matrix and the first sample complexity analysis in graph representation learning.

Graph Learning Graph Representation Learning

Faster Graph Embeddings via Coarsening

1 code implementation ICML 2020 Matthew Fahrbach, Gramoz Goranci, Richard Peng, Sushant Sachdeva, Chi Wang

As computing Schur complements is expensive, we give a nearly-linear time algorithm that generates a coarsened graph on the relevant vertices that provably matches the Schur complement in expectation in each iteration.

Link Prediction Node Classification

Qd-tree: Learning Data Layouts for Big Data Analytics

no code implementations22 Apr 2020 Zongheng Yang, Badrish Chandramouli, Chi Wang, Johannes Gehrke, Yi-Nan Li, Umar Farooq Minhas, Per-Åke Larson, Donald Kossmann, Rajeev Acharya

For a given workload, however, such techniques are unable to optimize for the important metric of the number of blocks accessed by a query.

Blocking Deep Reinforcement Learning

FLAML: A Fast and Lightweight AutoML Library

2 code implementations12 Nov 2019 Chi Wang, Qingyun Wu, Markus Weimer, Erkang Zhu

We study the problem of using low computational cost to automate the choices of learners and hyperparameters for an ad-hoc training dataset and error metric, by conducting trials of different configurations on the given training data.

Hyperparameter Optimization

NetSMF: Large-Scale Network Embedding as Sparse Matrix Factorization

1 code implementation26 Jun 2019 Jiezhong Qiu, Yuxiao Dong, Hao Ma, Jian Li, Chi Wang, Kuansan Wang, Jie Tang

Previous research shows that 1) popular network embedding benchmarks, such as DeepWalk, are in essence implicitly factorizing a matrix with a closed form, and 2)the explicit factorization of such matrix generates more powerful embeddings than existing methods.

Network Embedding

ALEX: An Updatable Adaptive Learned Index

no code implementations21 May 2019 Jialin Ding, Umar Farooq Minhas, JIA YU, Chi Wang, Jaeyoung Do, Yi-Nan Li, Hantian Zhang, Badrish Chandramouli, Johannes Gehrke, Donald Kossmann, David Lomet, Tim Kraska

The original work by Kraska et al. shows that a learned index beats a B+Tree by a factor of up to three in search time and by an order of magnitude in memory footprint.

ABC: Efficient Selection of Machine Learning Configuration on Large Dataset

no code implementations8 Nov 2018 Silu Huang, Chi Wang, Bolin Ding, Surajit Chaudhuri

A machine learning configuration refers to a combination of preprocessor, learner, and hyperparameters.

BIG-bench Machine Learning

Identifying Outlier Arms in Multi-Armed Bandit

no code implementations NeurIPS 2017 Honglei Zhuang, Chi Wang, Yifan Wang

Outlier detection is a powerful method to narrow down the attention to a few objects after the data for them are collected.

Outlier Detection

Identifying Semantically Deviating Outlier Documents

no code implementations EMNLP 2017 Honglei Zhuang, Chi Wang, Fangbo Tao, Lance Kaplan, Jiawei Han

A document outlier is a document that substantially deviates in semantics from the majority ones in a corpus.

Outlier Detection

Scalable Topical Phrase Mining from Text Corpora

no code implementations24 Jun 2014 Ahmed El-Kishky, Yanglei Song, Chi Wang, Clare Voss, Jiawei Han

Our solution combines a novel phrase mining framework to segment a document into single and multi-word phrases, and a new topic model that operates on the induced document partition.

Topic Models

Scalable and Robust Construction of Topical Hierarchies

no code implementations13 Mar 2014 Chi Wang, Xueqing Liu, Yanglei Song, Jiawei Han

Automated generation of high-quality topical hierarchies for a text collection is a dream problem in knowledge engineering with many valuable applications.

Cannot find the paper you are looking for? You can Submit a new open access paper.