Search Results for author: Zhihua Jin

Found 11 papers, 3 papers with code

Safeguarding System Prompts for LLMs

1 code implementation18 Dec 2024 Zhifeng Jiang, Zhihua Jin, Guoliang He

Large language models (LLMs) are increasingly utilized in applications where system prompts, which guide model outputs, play a crucial role.

JailbreakHunter: A Visual Analytics Approach for Jailbreak Prompts Discovery from Large-Scale Human-LLM Conversational Datasets

no code implementations3 Jul 2024 Zhihua Jin, Shiyi Liu, Haotian Li, Xun Zhao, Huamin Qu

To tackle these challenges, we introduce JailbreakHunter, a visual analytics approach for identifying jailbreak prompts in large-scale human-LLM conversational datasets.

Adversarial Attack Semantic Similarity +1

HAPI: A Large-scale Longitudinal Dataset of Commercial ML API Predictions

1 code implementation18 Sep 2022 Lingjiao Chen, Zhihua Jin, Sabri Eyuboglu, Christopher Ré, Matei Zaharia, James Zou

HAPI is the first large-scale dataset of ML API usages and is a unique resource for studying ML-as-a-service (MLaaS).

object-detection Object Detection +4

ShortcutLens: A Visual Analytics Approach for Exploring Shortcuts in Natural Language Understanding Dataset

no code implementations17 Aug 2022 Zhihua Jin, Xingbo Wang, Furui Cheng, Chunhui Sun, Qun Liu, Huamin Qu

Since shortcuts vary in coverage, productivity, and semantic meaning, it is challenging for NLU experts to systematically understand and avoid them when creating benchmark datasets.

Natural Language Understanding

NumGPT: Improving Numeracy Ability of Generative Pre-trained Models

no code implementations7 Sep 2021 Zhihua Jin, Xin Jiang, Xingbo Wang, Qun Liu, Yong Wang, Xiaozhe Ren, Huamin Qu

However, those models do not consider the numerical properties of numbers and cannot perform robustly on numerical reasoning tasks (e. g., math word problems and measurement estimation).

Math

M2Lens: Visualizing and Explaining Multimodal Models for Sentiment Analysis

no code implementations17 Jul 2021 Xingbo Wang, Jianben He, Zhihua Jin, Muqiao Yang, Yong Wang, Huamin Qu

Much research focuses on modeling the complex intra- and inter-modal interactions between different communication channels.

Multimodal Sentiment Analysis

GNNLens: A Visual Analytics Approach for Prediction Error Diagnosis of Graph Neural Networks

no code implementations22 Nov 2020 Zhihua Jin, Yong Wang, Qianwen Wang, Yao Ming, Tengfei Ma, Huamin Qu

Two case studies and interviews with domain experts demonstrate the effectiveness of GNNLens in facilitating the understanding of GNN models and their errors.

Node Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.