Search Results for author: Jiaqi Li

Found 40 papers, 13 papers with code

Single Image Unlearning: Efficient Machine Unlearning in Multimodal Large Language Models

no code implementations21 May 2024 Jiaqi Li, Qianshan Wei, Chuanyi Zhang, Guilin Qi, Miaozeng Du, Yongrui Chen, Sheng Bi

Alongside our method, we establish MMUBench, a new benchmark for MU in MLLMs and introduce a collection of metrics for its evaluation.

VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding

no code implementations18 Mar 2024 Yue Fan, Xiaojian Ma, Rujie Wu, Yuntao Du, Jiaqi Li, Zhi Gao, Qing Li

We explore how reconciling several foundation models (large language models and vision-language models) with a novel unified memory mechanism could tackle the challenging video understanding problem, especially capturing the long-term temporal relations in lengthy videos.

Video Understanding

RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation

no code implementations8 Mar 2024 ZiHao Wang, Anji Liu, Haowei Lin, Jiaqi Li, Xiaojian Ma, Yitao Liang

We explore how iterative revising a chain of thoughts with the help of information retrieval significantly improves large language models' reasoning and generation ability in long-horizon generation tasks, while hugely mitigating hallucination.

Code Generation Hallucination +3

MIKE: A New Benchmark for Fine-grained Multimodal Entity Knowledge Editing

no code implementations18 Feb 2024 Jiaqi Li, Miaozeng Du, Chuanyi Zhang, Yongrui Chen, Nan Hu, Guilin Qi, Haiyun Jiang, Siyuan Cheng, Bozhong Tian

Multimodal knowledge editing represents a critical advancement in enhancing the capabilities of Multimodal Large Language Models (MLLMs).

knowledge editing

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

6 code implementations8 Feb 2024 Zhuo Chen, Yichi Zhang, Yin Fang, Yuxia Geng, Lingbing Guo, Xiang Chen, Qian Li, Wen Zhang, Jiaoyan Chen, Yushan Zhu, Jiaqi Li, Xiaoze Liu, Jeff Z. Pan, Ningyu Zhang, Huajun Chen

In this survey, we carefully review over 300 articles, focusing on KG-aware research in two principal aspects: KG-driven Multi-Modal (KG4MM) learning, where KGs support multi-modal tasks, and Multi-Modal Knowledge Graph (MM4KG), which extends KG studies into the MMKG realm.

Entity Alignment Image Classification +4

Probabilistic Guarantees of Stochastic Recursive Gradient in Non-Convex Finite Sum Problems

no code implementations29 Jan 2024 Yanjie Zhong, Jiaqi Li, Soumendra Lahiri

This paper develops a new dimension-free Azuma-Hoeffding type bound on summation norm of a martingale difference sequence with random individual bounds.

Digital Life Project: Autonomous 3D Characters with Social Intelligence

no code implementations7 Dec 2023 Zhongang Cai, Jianping Jiang, Zhongfei Qing, Xinying Guo, Mingyuan Zhang, Zhengyu Lin, Haiyi Mei, Chen Wei, Ruisi Wang, Wanqi Yin, Xiangyu Fan, Han Du, Liang Pan, Peng Gao, Zhitao Yang, Yang Gao, Jiaqi Li, Tianxiang Ren, Yukun Wei, Xiaogang Wang, Chen Change Loy, Lei Yang, Ziwei Liu

In this work, we present Digital Life Project, a framework utilizing language as the universal medium to build autonomous 3D characters, who are capable of engaging in social interactions and expressing with articulated body motions, thereby simulating life in a digital environment.

Motion Captioning Motion Synthesis

Hessian Aware Low-Rank Weight Perturbation for Continual Learning

1 code implementation26 Nov 2023 Jiaqi Li, Rui Wang, Yuanhao Lai, Changjian Shui, Sabyasachi Sahoo, Charles X. Ling, Shichun Yang, Boyu Wang, Christian Gagné, Fan Zhou

We conduct extensive experiments on various benchmarks, including a dataset with large-scale tasks, and compare our method against some recent state-of-the-art methods to demonstrate the effectiveness and scalability of our proposed method.

Continual Learning

LooGLE: Can Long-Context Language Models Understand Long Contexts?

1 code implementation8 Nov 2023 Jiaqi Li, Mengmeng Wang, Zilong Zheng, Muhan Zhang

In this paper, we present LooGLE, a Long Context Generic Language Evaluation benchmark for LLMs' long context understanding.

In-Context Learning Long-Context Understanding +1

Stochastic Optimization of Coupled Power Distribution-Urban Transportation Network Operations with Autonomous Mobility on Demand Systems

no code implementations20 Aug 2023 Han Wang, Xiaoyuan Xu, Yue Chen, Zheng Yan, Mohammad Shahidehpour, Jiaqi Li, Shaolun Xu

Then, a bi-level power-traffic flow (PTF) model is proposed to characterize the interaction of power distribution networks (PDNs) and urban transportation networks (UTNs).

Stochastic Optimization

Diffusion-Augmented Depth Prediction with Sparse Annotations

no code implementations4 Aug 2023 Jiaqi Li, Yiran Wang, Zihao Huang, Jinghong Zheng, Ke Xian, Zhiguo Cao, Jianming Zhang

We leverage the structural characteristics of diffusion model to enforce depth structures of depth models in a plug-and-play manner.

Autonomous Driving Depth Estimation +3

Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasoners

1 code implementation24 May 2023 Xiaojuan Tang, Zilong Zheng, Jiaqi Li, Fanxu Meng, Song-Chun Zhu, Yitao Liang, Muhan Zhang

On the whole, our analysis provides a novel perspective on the role of semantics in developing and evaluating language models' reasoning abilities.

When Source-Free Domain Adaptation Meets Learning with Noisy Labels

no code implementations31 Jan 2023 Li Yi, Gezheng Xu, Pengcheng Xu, Jiaqi Li, Ruizhi Pu, Charles Ling, A. Ian McLeod, Boyu Wang

We also prove that such a difference makes existing LLN methods that rely on their distribution assumptions unable to address the label noise in SFDA.

Learning with noisy labels Source-Free Domain Adaptation

Towards Accurate Acne Detection via Decoupled Sequential Detection Head

no code implementations28 Jan 2023 Xin Wei, Lei Zhang, Jianwei Zhang, Junyou Wang, Wenjie Liu, Jiaqi Li, Xian Jiang

In addition, we build a high-quality acne detection dataset named ACNE-DET to verify the effectiveness of DSDH.

MNER-QG: An End-to-End MRC framework for Multimodal Named Entity Recognition with Query Grounding

no code implementations27 Nov 2022 Meihuizi Jia, Lei Shen, Xin Shen, Lejian Liao, Meng Chen, Xiaodong He, Zhendong Chen, Jiaqi Li

Multimodal named entity recognition (MNER) is a critical step in information extraction, which aims to detect entity spans and classify them to corresponding entity types given a sentence-image pair.

named-entity-recognition Named Entity Recognition +4

On Learning Fairness and Accuracy on Multiple Subgroups

1 code implementation19 Oct 2022 Changjian Shui, Gezheng Xu, Qi Chen, Jiaqi Li, Charles Ling, Tal Arbel, Boyu Wang, Christian Gagné

In the upper-level, the fair predictor is updated to be close to all subgroup specific predictors.

Fairness

CrossHuman: Learning Cross-Guidance from Multi-Frame Images for Human Reconstruction

no code implementations20 Jul 2022 Liliang Chen, Jiaqi Li, Han Huang, Yandong Guo

We propose CrossHuman, a novel method that learns cross-guidance from parametric human model and multi-frame RGB images to achieve high-quality 3D human reconstruction.

3D Human Reconstruction

Learning High-quality Proposals for Acne Detection

1 code implementation8 Jul 2022 Jianwei Zhang, Lei Zhang, Junyou Wang, Xin Wei, Jiaqi Li, Xian Jiang, Dan Du

Acne detection is crucial for interpretative diagnosis and precise treatment of skin disease.

Classification Region Proposal +2

Evolving Domain Generalization

no code implementations31 May 2022 William Wei Wang, Gezheng Xu, Ruizhi Pu, Jiaqi Li, Fan Zhou, Changjian Shui, Charles Ling, Christian Gagné, Boyu Wang

Domain generalization aims to learn a predictive model from multiple different but related source tasks that can generalize well to a target task without the need of accessing any target data.

Evolving Domain Generalization Meta-Learning

Fair Representation Learning through Implicit Path Alignment

no code implementations26 May 2022 Changjian Shui, Qi Chen, Jiaqi Li, Boyu Wang, Christian Gagné

We consider a fair representation learning perspective, where optimal predictors, on top of the data representation, are ensured to be invariant with respect to different sub-groups.

Fairness Representation Learning

Dynamic Flow Equilibrium of Transportation and Power Distribution Networks Considering Flexible Traveling Choices and Voltage Quality Improvement

no code implementations9 Dec 2021 Jiaqi Li, Xiaoyuan Xu, Zheng Yan, Han Wang, Yue Chen

The increasing global spread of electric vehicles (EVs) has introduced significant interdependence between transportation and power networks.

Computational Efficiency

ABCP: Automatic Block-wise and Channel-wise Network Pruning via Joint Search

1 code implementation8 Oct 2021 Jiaqi Li, Haoran Li, Yaran Chen, Zixiang Ding, Nannan Li, Mingjun Ma, Zicheng Duan, Dongbing Zhao

Compared with the traditional rule-based pruning method, this pipeline saves human labor and achieves a higher compression ratio with lower accuracy loss.

Network Pruning

Directional Domain Generalization

no code implementations29 Sep 2021 Wei Wang, Jiaqi Li, Ruizhi Pu, Gezheng Xu, Fan Zhou, Changjian Shui, Charles Ling, Boyu Wang

Domain generalization aims to learn a predictive model from multiple different but related source tasks that can generalize well to a target task without the need of accessing any target data.

Domain Generalization Meta-Learning +1

Aggregating From Multiple Target-Shifted Sources

1 code implementation9 May 2021 Changjian Shui, Zijian Li, Jiaqi Li, Christian Gagné, Charles Ling, Boyu Wang

Multi-source domain adaptation aims at leveraging the knowledge from multiple tasks for predicting a related target domain.

Unsupervised Domain Adaptation

DADgraph: A Discourse-aware Dialogue Graph Neural Network for Multiparty Dialogue Machine Reading Comprehension

no code implementations26 Apr 2021 Jiaqi Li, Ming Liu, Zihao Zheng, Heng Zhang, Bing Qin, Min-Yen Kan, Ting Liu

Multiparty Dialogue Machine Reading Comprehension (MRC) differs from traditional MRC as models must handle the complex dialogue discourse structure, previously unconsidered in traditional MRC.

Machine Reading Comprehension Question Answering

Insights into ventilation hysteresis shift due to flow unsteadiness in ventilated supercavitation

no code implementations2 Feb 2021 Kyungduck Yoon, Jiaqi Li, Siyao Shao, Ashish Karn, Jiarong Hong

Imposing flow unsteadiness on the incoming flow has shown an increment in higher CQf at low free stream velocity and lower CQf at high free stream velocity.

Fluid Dynamics

Unified Principles For Multi-Source Transfer Learning Under Label Shifts

no code implementations1 Jan 2021 Changjian Shui, Zijian Li, Jiaqi Li, Christian Gagné, Charles Ling, Boyu Wang

We study the label shift problem in multi-source transfer learning and derive new generic principles to control the target generalization risk.

Transfer Learning Unsupervised Domain Adaptation

Robust error bounds for quantised and pruned neural networks

1 code implementation30 Nov 2020 Jiaqi Li, Ross Drummond, Stephen R. Duncan

With the rise of smartphones and the internet-of-things, data is increasingly getting generated at the edge on local, personal devices.

Network Pruning

Synchrotron Microtomography and Neutron Radiography Characterization of the Microstruture and Water Absorption of Concrete from Pompeii

no code implementations27 May 2020 Ke Xu, Anton S. Tremsin, Jiaqi Li, Daniela M. Ushizima, Catherine A. Davy, Amine Bouterf, Ying Tsun Su, Milena Marroccoli, Anna Maria Mauro, Massimo Osanna, Antonio Telesca, Paulo J. M. Monteiro

In the present work, samples were drilled from the "Hospitium" in Pompeii and were analyzed by synchrotron microtomography (uCT) and neutron radiography to study how the microstructure, including the presence of induced cracks, affects their water adsorption.

Applied Physics Materials Science Geophysics

An Annotation Scheme of A Large-scale Multi-party Dialogues Dataset for Discourse Parsing and Machine Comprehension

no code implementations8 Nov 2019 Jiaqi Li, Ming Liu, Bing Qin, Zihao Zheng, Ting Liu

In this paper, we propose the scheme for annotating large-scale multi-party chat dialogues for discourse parsing and machine comprehension.

Discourse Parsing Machine Reading Comprehension

AI-based Two-Stage Intrusion Detection for Software Defined IoT Networks

no code implementations7 Jun 2018 Jiaqi Li, Zhifeng Zhao, Rongpeng Li, Honggang Zhang

Software Defined Internet of Things (SD-IoT) Networks profits from centralized management and interactive resource sharing which enhances the efficiency and scalability of IoT applications.

Intrusion Detection Management +1

A Machine Learning Based Intrusion Detection System for Software Defined 5G Network

no code implementations10 Jul 2017 Jiaqi Li, Zhifeng Zhao, Rongpeng Li

As an inevitable trend of future 5G networks, Software Defined architecture has many advantages in providing central- ized control and flexible resource management.

BIG-bench Machine Learning Intrusion Detection +1

Cannot find the paper you are looking for? You can Submit a new open access paper.