Search Results for author: Ziyu Zhao

Found 15 papers, 5 papers with code

Merging LoRAs like Playing LEGO: Pushing the Modularity of LoRA to Extremes Through Rank-Wise Clustering

no code implementations24 Sep 2024 Ziyu Zhao, Tao Shen, Didi Zhu, Zexi Li, Jing Su, Xuwu Wang, Kun Kuang, Fei Wu

The centroid of each cluster serves as a representative MSU, enabling the assembly of a merged LoRA with an adjusted rank of $k$.

IntOPE: Off-Policy Evaluation in the Presence of Interference

no code implementations24 Aug 2024 Yuqi Bai, Ziyu Zhao, Minqin Zhu, Kun Kuang

Off-Policy Evaluation (OPE) is employed to assess the potential impact of a hypothetical policy using logged contextual bandit feedback, which is crucial in areas such as personalized medicine and recommender systems, where online interactions are associated with significant risks and costs.

Off-policy evaluation Recommendation Systems

Causal Agent based on Large Language Model

1 code implementation13 Aug 2024 Kairong Han, Kun Kuang, Ziyu Zhao, Junjian Ye, Fei Wu

In the tools module, the causal agent applies causal methods to align tabular data with natural language.

Language Modelling Large Language Model

Leveraging Adaptive Implicit Representation Mapping for Ultra High-Resolution Image Segmentation

no code implementations31 Jul 2024 Ziyu Zhao, Xiaoguang Li, Pingping Cai, Canyu Zhang, Song Wang

To address these limitations, we propose a novel approach that leverages the newly proposed Adaptive Implicit Representation Mapping (AIRM) for ultra-high-resolution Image Segmentation.

Image Segmentation Segmentation +1

Sub-SA: Strengthen In-context Learning via Submodular Selective Annotation

1 code implementation8 Jul 2024 Jian Qian, Miao Sun, Sifan Zhou, Ziyu Zhao, Ruizhi Hun, Patrick Chiang

In Sub-SA, we design a submodular function that facilitates effective subset selection for annotation and demonstrates the characteristics of monotonically and submodularity from the theoretical perspective.

Diversity In-Context Learning

Retrieval-Augmented Mixture of LoRA Experts for Uploadable Machine Learning

no code implementations24 Jun 2024 Ziyu Zhao, Leilei Gan, Guoyin Wang, Yuwei Hu, Tao Shen, Hongxia Yang, Kun Kuang, Fei Wu

In UML, contributors use decentralized data to train specialized adapters, which are then uploaded to a central platform to improve LLMs.

Retrieval

PillarHist: A Quantization-aware Pillar Feature Encoder based on Height-aware Histogram

no code implementations29 May 2024 Sifan Zhou, Zhihang Yuan, Dawei Yang, Xubin Wen, Xing Hu, Yuguang Shi, Ziyu Zhao, Xiaobo Lu

To address above issue, we first unveil the importance of different input information during PFE and identify the height dimension as a key factor in enhancing 3D detection performance.

3D Object Detection Autonomous Driving +2

Unbridled Icarus: A Survey of the Potential Perils of Image Inputs in Multimodal Large Language Model Security

no code implementations8 Apr 2024 Yihe Fan, Yuxin Cao, Ziyu Zhao, Ziyao Liu, Shaofeng Li

Multimodal Large Language Models (MLLMs) demonstrate remarkable capabilities that increasingly influence various aspects of our daily lives, constantly defining the new boundary of Artificial General Intelligence (AGI).

Language Modelling Large Language Model +1

LoraRetriever: Input-Aware LoRA Retrieval and Composition for Mixed Tasks in the Wild

no code implementations15 Feb 2024 Ziyu Zhao, Leilei Gan, Guoyin Wang, Wangchunshu Zhou, Hongxia Yang, Kun Kuang, Fei Wu

Low-Rank Adaptation (LoRA) provides an effective yet efficient solution for fine-tuning large language models (LLM).

Retrieval

LiDAR-PTQ: Post-Training Quantization for Point Cloud 3D Object Detection

1 code implementation29 Jan 2024 Sifan Zhou, Liang Li, Xinyu Zhang, Bo Zhang, Shipeng Bai, Miao Sun, Ziyu Zhao, Xiaobo Lu, Xiangxiang Chu

To our knowledge, for the very first time in lidar-based 3D detection tasks, the PTQ INT8 model's accuracy is almost the same as the FP32 model while enjoying $3\times$ inference speedup.

3D Object Detection Autonomous Vehicles +3

InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks

1 code implementation10 Jan 2024 Xueyu Hu, Ziyu Zhao, Shuang Wei, Ziwei Chai, Qianli Ma, Guoyin Wang, Xuwu Wang, Jing Su, Jingjing Xu, Ming Zhu, Yao Cheng, Jianbo Yuan, Jiwei Li, Kun Kuang, Yang Yang, Hongxia Yang, Fei Wu

In this paper, we introduce InfiAgent-DABench, the first benchmark specifically designed to evaluate LLM-based agents on data analysis tasks.

Benchmarking

LogoStyleFool: Vitiating Video Recognition Systems via Logo Style Transfer

1 code implementation15 Dec 2023 Yuxin Cao, Ziyu Zhao, Xi Xiao, Derui Wang, Minhui Xue, Jin Lu

We separate the attack into three stages: style reference selection, reinforcement-learning-based logo style transfer, and perturbation optimization.

reinforcement-learning Reinforcement Learning +2

Modeling Transient Changes in Circadian Rhythms

no code implementations14 Apr 2023 Ziyu Zhao, Dae-Sung Hwangbo, Sumit Saurabh, Clark Rosensweig, Ravi Allada, William L. Kath, Rosemary Braun

The circadian clock can adapt itself to external cues, but the molecular mechanisms and regulatory networks governing circadian oscillations' transient adjustments are still largely unknown.

Model Selection quantile regression

Few-Shot 3D Point Cloud Semantic Segmentation via Stratified Class-Specific Attention Based Transformer Network

no code implementations28 Mar 2023 Canyu Zhang, Zhenyao Wu, Xinyi Wu, Ziyu Zhao, Song Wang

While a few-shot learning method was proposed recently to address these two problems, it suffers from high computational complexity caused by graph construction and inability to learn fine-grained relationships among points due to the use of pooling operations.

Few-shot 3D Point Cloud Semantic Segmentation Few-Shot Learning +4

Learning Individual Treatment Effects under Heterogeneous Interference in Networks

no code implementations25 Oct 2022 Ziyu Zhao, Yuqi Bai, Kun Kuang, Ruoxuan Xiong, Fei Wu

In network data, due to interference, the outcome of a unit is influenced not only by its treatment (i. e., direct effects) but also by others' treatments (i. e., spillover effects).

Cannot find the paper you are looking for? You can Submit a new open access paper.