Search Results for author: Xijie Huang

Found 23 papers, 15 papers with code

AISafetyLab: A Comprehensive Framework for AI Safety Evaluation and Improvement

2 code implementations24 Feb 2025 Zhexin Zhang, Leqi Lei, Junxiao Yang, Xijie Huang, Yida Lu, Shiyao Cui, Renmiao Chen, Qinglin Zhang, Xinyuan Wang, Hao Wang, Hao Li, Xianqi Lei, Chengwei Pan, Lei Sha, Hongning Wang, Minlie Huang

As AI models are increasingly deployed across diverse real-world scenarios, ensuring their safety remains a critical yet underexplored challenge.

Synth-Empathy: Towards High-Quality Synthetic Empathy Data

1 code implementation31 Jul 2024 Hao Liang, Linzhuang Sun, Jingxuan Wei, Xijie Huang, Linkun Sun, Bihui Yu, Conghui He, Wentao Zhang

In recent years, with the rapid advancements in large language models (LLMs), achieving excellent empathetic response capabilities has become a crucial prerequisite.

Diversity

SynthVLM: High-Efficiency and High-Quality Synthetic Data for Vision Language Models

1 code implementation30 Jul 2024 Zheng Liu, Hao Liang, Xijie Huang, Wentao Xiong, Qinhan Yu, Linzhuang Sun, Chong Chen, Conghui He, Bin Cui, Wentao Zhang

Crucially, our method's reliance on purely generated data ensures the preservation of privacy, achieving SoTA performance with just 100k data points (only 18% of the official dataset size).

Caption Generation Question Answering

RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization

1 code implementation10 Jul 2024 Xijie Huang, Zechun Liu, Shih-Yang Liu, Kwang-Ting Cheng

Low-Rank Adaptation (LoRA), as a representative Parameter-Efficient Fine-Tuning (PEFT)method, significantly enhances the training efficiency by updating only a small portion of the weights in Large Language Models (LLMs).

parameter-efficient fine-tuning Quantization

KeyVideoLLM: Towards Large-scale Video Keyframe Selection

no code implementations3 Jul 2024 Hao Liang, Jiapeng Li, Tianyi Bai, Xijie Huang, Linzhuang Sun, Zhengren Wang, Conghui He, Bin Cui, Chong Chen, Wentao Zhang

Recently, with the rise of web videos, managing and understanding large-scale video datasets has become increasingly important.

Data Compression Management +3

Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Models

1 code implementation26 May 2024 Xijie Huang, Xinyuan Wang, Hantao Zhang, Yinghao Zhu, Jiawen Xi, Jingkun An, Hao Wang, Hao Liang, Chengwei Pan

Security concerns related to Large Language Models (LLMs) have been extensively explored, yet the safety implications for Multimodal Large Language Models (MLLMs), particularly in medical contexts (MedMLLMs), remain insufficiently studied.

Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning

no code implementations14 Dec 2023 Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang

In this work, we propose CoT-Influx, a novel approach that pushes the boundary of few-shot Chain-of-Thoughts (CoT) learning to improve LLM mathematical reasoning.

Arithmetic Reasoning Few-Shot Learning +3

LLM-FP4: 4-Bit Floating-Point Quantized Transformers

1 code implementation25 Oct 2023 Shih-Yang Liu, Zechun Liu, Xijie Huang, Pingcheng Dong, Kwang-Ting Cheng

Our method, for the first time, can quantize both weights and activations in the LLaMA-13B to only 4-bit and achieves an average score of 63. 1 on the common sense zero-shot reasoning tasks, which is only 5. 8 lower than the full-precision model, significantly outperforming the previous state-of-the-art by 12. 7 points.

Common Sense Reasoning Quantization

VideoPro: A Visual Analytics Approach for Interactive Video Programming

no code implementations1 Aug 2023 Jianben He, Xingbo Wang, Kam Kwai Wong, Xijie Huang, Changjian Chen, Zixin Chen, Fengjie Wang, Min Zhu, Huamin Qu

Constructing supervised machine learning models for real-world video analysis require substantial labeled data, which is costly to acquire due to scarce domain expertise and laborious manual inspection.

Quantization Variation: A New Perspective on Training Transformers with Low-Bit Precision

2 code implementations1 Jul 2023 Xijie Huang, Zhiqiang Shen, Pingcheng Dong, Kwang-Ting Cheng

We explore the best practices to alleviate the variation's influence during low-bit transformer QAT and propose a variation-aware quantization scheme for both vision and language transformers.

Knowledge Distillation Model Compression +1

Efficient and Robust Quantization-aware Training via Adaptive Coreset Selection

1 code implementation12 Jun 2023 Xijie Huang, Zechun Liu, Shih-Yang Liu, Kwang-Ting Cheng

Quantization-aware training (QAT) is a representative model compression method to reduce redundancy in weights and activations.

Model Compression Quantization

FedMix: Mixed Supervised Federated Learning for Medical Image Segmentation

1 code implementation4 May 2022 Jeffry Wicaksana, Zengqiang Yan, Dong Zhang, Xijie Huang, Huimin Wu, Xin Yang, Kwang-Ting Cheng

To relax this assumption, in this work, we propose a label-agnostic unified federated learning framework, named FedMix, for medical image segmentation based on mixed image labels.

Federated Learning Image Segmentation +4

Joint stereo 3D object detection and implicit surface reconstruction

1 code implementation25 Nov 2021 Shichao Li, Xijie Huang, Zechun Liu, Kwang-Ting Cheng

We present a new learning-based framework S-3D-RCNN that can recover accurate object orientation in SO(3) and simultaneously predict implicit rigid shapes from stereo RGB images.

3D Object Detection Hallucination +4

NeuronInspect: Detecting Backdoors in Neural Networks via Output Explanations

no code implementations18 Nov 2019 Xijie Huang, Moustafa Alzantot, Mani Srivastava

NeuronInspect first identifies the existence of backdoor attack targets by generating the explanation heatmap of the output layer.

Backdoor Attack Outlier Detection +1

HAKE: Human Activity Knowledge Engine

4 code implementations13 Apr 2019 Yong-Lu Li, Liang Xu, Xinpeng Liu, Xijie Huang, Yue Xu, Mingyang Chen, Ze Ma, Shiyi Wang, Hao-Shu Fang, Cewu Lu

To address these and promote the activity understanding, we build a large-scale Human Activity Knowledge Engine (HAKE) based on the human body part states.

Ranked #2 on Human-Object Interaction Detection on HICO (using extra training data)

Action Detection Human-Object Interaction Detection +1

Transferable Interactiveness Knowledge for Human-Object Interaction Detection

3 code implementations CVPR 2019 Yong-Lu Li, Siyuan Zhou, Xijie Huang, Liang Xu, Ze Ma, Hao-Shu Fang, Yan-Feng Wang, Cewu Lu

On account of the generalization of interactiveness, interactiveness network is a transferable knowledge learner and can be cooperated with any HOI detection models to achieve desirable results.

Human-Object Interaction Detection Object

Cannot find the paper you are looking for? You can Submit a new open access paper.