Search Results for author: Yi Pan

Found 58 papers, 9 papers with code

Causal Mean Field Multi-Agent Reinforcement Learning

no code implementations20 Feb 2025 Hao Ma, Zhiqiang Pu, Yi Pan, Boyin Liu, Junlong Gao, Zhenyu Guo

Causality contains relatively invariant mechanisms behind interactions, though environments are nonstationary.

Multi-agent Reinforcement Learning Q-Learning +2

QueEn: A Large Language Model for Quechua-English Translation

no code implementations6 Dec 2024 JunHao Chen, Peng Shu, Yiwei Li, Huaqin Zhao, Hanqi Jiang, Yi Pan, Yifan Zhou, Zhengliang Liu, Lewis C Howe, Tianming Liu

Recent studies show that large language models (LLMs) are powerful tools for working with natural language, bringing advances in many areas of computational linguistics.

Computational Efficiency Language Modeling +4

OracleSage: Towards Unified Visual-Linguistic Understanding of Oracle Bone Scripts through Cross-Modal Knowledge Fusion

no code implementations26 Nov 2024 Hanqi Jiang, Yi Pan, JunHao Chen, Zhengliang Liu, Yifan Zhou, Peng Shu, Yiwei Li, Huaqin Zhao, Stephen Mihm, Lewis C Howe, Tianming Liu

Oracle bone script (OBS), as China's earliest mature writing system, present significant challenges in automatic recognition due to their complex pictographic structures and divergence from modern Chinese characters.

Transcending Language Boundaries: Harnessing LLMs for Low-Resource Language Translation

no code implementations18 Nov 2024 Peng Shu, JunHao Chen, Zhengliang Liu, Hui Wang, Zihao Wu, Tianyang Zhong, Yiwei Li, Huaqin Zhao, Hanqi Jiang, Yi Pan, Yifan Zhou, Constance Owl, Xiaoming Zhai, Ninghao Liu, Claudio Saunt, Tianming Liu

Our comparison with the zero-shot performance of GPT-4o and LLaMA 3. 1 405B, highlights the significant challenges these models face when translating into low-resource languages.

Retrieval Translation

HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization

no code implementations16 Nov 2024 Huaqin Zhao, Jiaxi Li, Yi Pan, Shizhe Liang, Xiaofeng Yang, Wei Liu, Xiang Li, Fei Dou, Tianming Liu, Jin Lu

Experimental results on RoBERTa-large and OPT-1. 3B across multiple tasks show that HELENE achieves up to a 20x speedup compared to MeZO, with average accuracy improvements of 1. 5%.

parameter-efficient fine-tuning

Large Language Models for Manufacturing

no code implementations28 Oct 2024 Yiwei Li, Huaqin Zhao, Hanqi Jiang, Yi Pan, Zhengliang Liu, Zihao Wu, Peng Shu, Jie Tian, Tianze Yang, Shaochen Xu, Yanjun Lyu, Parker Blenk, Jacob Pence, Jason Rupram, Eliza Banu, Ninghao Liu, Linbing Wang, WenZhan Song, Xiaoming Zhai, Kenan Song, Dajiang Zhu, Beiwen Li, Xianqiao Wang, Tianming Liu

The rapid advances in Large Language Models (LLMs) have the potential to transform manufacturing industry, offering new opportunities to optimize processes, improve efficiency, and drive innovation.

A Survey of Hallucination in Large Visual Language Models

no code implementations20 Oct 2024 Wei Lan, WenYi Chen, Qingfeng Chen, Shirui Pan, Huiyu Zhou, Yi Pan

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs).

Hallucination Hallucination Evaluation +1

Attention-Guided Residual U-Net with SE Connection and ASPP for Watershed-Based Cell Segmentation in Microscopy Images

1 code implementation Journal of Computational Biology 2024 Jovial Niyogisubizo, Keliang Zhao, Jintao Meng, Yi Pan, Rosiyadi Didi, Yanjie Wei

To address these issues, we propose a novel framework called RA-SE-ASPP-Net, which incorporates Residual Blocks, Attention Mechanism, Squeeze-and-Excitation connection, and Atrous Spatial Pyramid Pooling to achieve precise and robust cell segmentation.

Cell Segmentation Electron Microscopy Image Segmentation +4

EG-SpikeFormer: Eye-Gaze Guided Transformer on Spiking Neural Networks for Medical Image Analysis

no code implementations12 Oct 2024 Yi Pan, Hanqi Jiang, JunHao Chen, Yiwei Li, Huaqin Zhao, Yifan Zhou, Peng Shu, Zihao Wu, Zhengliang Liu, Dajiang Zhu, Xiang Li, Yohannes Abate, Tianming Liu

Neuromorphic computing has emerged as a promising energy-efficient alternative to traditional artificial intelligence, predominantly utilizing spiking neural networks (SNNs) implemented on neuromorphic hardware.

Image Classification Medical Image Analysis +1

ECHOPulse: ECG controlled echocardio-grams video generation

1 code implementation4 Oct 2024 Yiwei Li, Sekeun Kim, Zihao Wu, Hanqi Jiang, Yi Pan, Pengfei Jin, Sifan Song, Yucheng Shi, Tianming Liu, Quanzheng Li, Xiang Li

Echocardiography (ECHO) is essential for cardiac assessments, but its video quality and interpretation heavily relies on manual expertise, leading to inconsistent results from clinical and portable devices.

Video Generation

Advancing Medical Radiograph Representation Learning: A Hybrid Pre-training Paradigm with Multilevel Semantic Granularity

no code implementations1 Oct 2024 Hanqi Jiang, Xixuan Hao, Yuzhou Huang, Chong Ma, Jiaxun Zhang, Yi Pan, Ruimao Zhang

Moreover, our framework incorporates a generation decoder that employs two proxy tasks, responsible for generating the impression from (1) images, via a captioning branch, and (2) findings, through a summarization branch.

Decoder Knowledge Distillation +1

Dual-View Pyramid Pooling in Deep Neural Networks for Improved Medical Image Classification and Confidence Calibration

no code implementations6 Aug 2024 Xiaoqing Zhang, Qiushi Nie, Zunjie Xiao, Jilu Zhao, Xiao Wu, Pengxin Guo, Runzhi Li, Jin Liu, Yanjie Wei, Yi Pan

DVPP aims to boost both medical image classification and confidence calibration performance by fully leveraging the merits of SP and CCP operators from a dual-axis perspective.

Image Classification Medical Image Classification

Potential of Multimodal Large Language Models for Data Mining of Medical Images and Free-text Reports

no code implementations8 Jul 2024 Yutong Zhang, Yi Pan, Tianyang Zhong, Peixin Dong, Kangni Xie, Yuxiao Liu, Hanqi Jiang, Zhengliang Liu, Shijie Zhao, Tuo Zhang, Xi Jiang, Dinggang Shen, Tianming Liu, Xin Zhang

Our experimental results demonstrated that Gemini-series models excelled in report generation and lesion detection but faces challenges in disease classification and anatomical localization.

Lesion Detection Lesion Segmentation

Accurate Explanation Model for Image Classifiers using Class Association Embedding

1 code implementation12 Jun 2024 Ruitao Xie, Jingbang Chen, Limai Jiang, Rui Xiao, Yi Pan, Yunpeng Cai

Recombining the individual code of a given sample with altered class-associated code leads to a synthetic real-looking sample with preserved individual characters but modified class-associated features and possibly flipped class assignments.

Classification Explainable Models +2

SVASTIN: Sparse Video Adversarial Attack via Spatio-Temporal Invertible Neural Networks

1 code implementation4 Jun 2024 Yi Pan, Jun-Jie Huang, Zihan Chen, Wentao Zhao, Ziyue Wang

Robust and imperceptible adversarial video attack is challenging due to the spatial and temporal characteristics of videos.

Adversarial Attack

LLMs for Coding and Robotics Education

no code implementations9 Feb 2024 Peng Shu, Huaqin Zhao, Hanqi Jiang, Yiwei Li, Shaochen Xu, Yi Pan, Zihao Wu, Zhengliang Liu, Guoyu Lu, Le Guan, Gong Chen, Xianqiao Wang Tianming Liu

To teach young children how to code and compete in robot challenges, large language models are being utilized for robot code explanation, generation, and modification.

Code Generation Explanation Generation

Review of Large Vision Models and Visual Prompt Engineering

no code implementations3 Jul 2023 Jiaqi Wang, Zhengliang Liu, Lin Zhao, Zihao Wu, Chong Ma, Sigang Yu, Haixing Dai, Qiushi Yang, Yiheng Liu, Songyao Zhang, Enze Shi, Yi Pan, Tuo Zhang, Dajiang Zhu, Xiang Li, Xi Jiang, Bao Ge, Yixuan Yuan, Dinggang Shen, Tianming Liu, Shu Zhang

This review aims to summarize the methods employed in the computer vision domain for large vision models and visual prompt engineering, exploring the latest advancements in visual prompt engineering.

Prompt Engineering

Intelligent gradient amplification for deep neural networks

no code implementations29 May 2023 Sunitha Basodi, Krishna Pusuluri, Xueli Xiao, Yi Pan

Deep learning models offer superior performance compared to other machine learning techniques for a variety of tasks and domains, but pose their own challenges.

Deep Learning

Brain Structure-Function Fusing Representation Learning using Adversarial Decomposed-VAE for Analyzing MCI

no code implementations23 May 2023 Qiankun Zuo, Baiying Lei, Ning Zhong, Yi Pan, Shuqiang Wang

Integrating the brain structural and functional connectivity features is of great significance in both exploring brain science and analyzing cognitive impairment clinically.

Functional Connectivity Representation Learning

Instruction-ViT: Multi-Modal Prompts for Instruction Learning in ViT

no code implementations29 Apr 2023 Zhenxiang Xiao, Yuzhong Chen, Lu Zhang, Junjie Yao, Zihao Wu, Xiaowei Yu, Yi Pan, Lin Zhao, Chong Ma, Xinyu Liu, Wei Liu, Xiang Li, Yixuan Yuan, Dinggang Shen, Dajiang Zhu, Tianming Liu, Xi Jiang

Prompts have been proven to play a crucial role in large language models, and in recent years, vision models have also been using prompts to improve scalability for multiple downstream tasks.

Image Classification

Prompt Engineering for Healthcare: Methodologies and Applications

no code implementations28 Apr 2023 Jiaqi Wang, Enze Shi, Sigang Yu, Zihao Wu, Chong Ma, Haixing Dai, Qiushi Yang, Yanqing Kang, Jinru Wu, Huawen Hu, Chenxi Yue, Haiyang Zhang, Yiheng Liu, Yi Pan, Zhengliang Liu, Lichao Sun, Xiang Li, Bao Ge, Xi Jiang, Dajiang Zhu, Yixuan Yuan, Dinggang Shen, Tianming Liu, Shu Zhang

Prompt engineering is a critical technique in the field of natural language processing that involves designing and optimizing the prompts used to input information into models, aiming to enhance their performance on specific tasks.

Machine Translation Prompt Engineering +3

Multi-modal Multi-kernel Graph Learning for Autism Prediction and Biomarker Discovery

no code implementations3 Mar 2023 Junbin Mao, Jin Liu, Hanhe Lin, Hulin Kuang, Shirui Pan, Yi Pan

To effectively offset the negative impact between modalities in the process of multi-modal integration and extract heterogeneous information from graphs, we propose a novel method called MMKGL (Multi-modal Multi-Kernel Graph Learning).

Disease Prediction Graph Embedding +1

Meta-data Study in Autism Spectrum Disorder Classification Based on Structural MRI

no code implementations9 Jun 2022 Ruimin Ma, Yanlin Wang, Yanjie Wei, Yi Pan

Accurate diagnosis of autism spectrum disorder (ASD) based on neuroimaging data has significant implications, as extracting useful information from neuroimaging data for ASD detection is challenging.

Generative Adversarial Networks: A Survey Towards Private and Secure Applications

no code implementations7 Jun 2021 Zhipeng Cai, Zuobin Xiong, Honghui Xu, Peng Wang, Wei Li, Yi Pan

Generative Adversarial Networks (GAN) have promoted a variety of applications in computer vision, natural language processing, etc.

Survey

Covid-19 Detection from Chest X-ray and Patient Metadata using Graph Convolutional Neural Networks

no code implementations20 May 2021 Thosini Bamunu Mudiyanselage, Nipuna Senanayake, Chunyan Ji, Yi Pan, Yanqing Zhang

The novel corona virus (Covid-19) has introduced significant challenges due to its rapid spreading nature through respiratory transmission.

Transfer Learning

Slashing Communication Traffic in Federated Learning by Transmitting Clustered Model Updates

no code implementations10 May 2021 Laizhong Cui, Xiaoxin Su, Yipeng Zhou, Yi Pan

Then, we further propose the boosted MUCSC (B-MUCSC) algorithm, a biased compression algorithm that can achieve an extremely high compression rate by grouping insignificant model updates into a super cluster.

Federated Learning

Infant Vocal Tract Development Analysis and Diagnosis by Cry Signals with CNN Age Classification

no code implementations23 Apr 2021 Chunyan Ji, Yi Pan

In this paper, we propose a non-invasive fast method of using infant cry signals with convolutional neural network (CNN) based age classification to diagnose the abnormality of the vocal tract development as early as 4-month age.

Age Classification General Classification

Infant Cry Classification with Graph Convolutional Networks

no code implementations31 Jan 2021 Chunyan Ji, Ming Chen, Bin Li, Yi Pan

We propose an approach of graph convolutional networks for robust infant cry classification.

Classification Diversity +2

Deep Neural Networks with Short Circuits for Improved Gradient Learning

no code implementations23 Sep 2020 Ming Yan, Xueli Xiao, Joey Tianyi Zhou, Yi Pan

Deep neural networks have achieved great success both in computer vision and natural language processing tasks.

Graph Convolution Networks Using Message Passing and Multi-Source Similarity Features for Predicting circRNA-Disease Association

no code implementations15 Sep 2020 Thosini Bamunu Mudiyanselage, Xiujuan Lei, Nipuna Senanayake, Yanqing Zhang, Yi Pan

In this paper, we propose a novel graph convolution network framework to learn features from a graph built with multi-source similarity information to predict circRNA-disease associations.

A Novel Ensemble Deep Learning Model for Stock Prediction Based on Stock Prices and News

no code implementations23 Jul 2020 Yang Li, Yi Pan

This paper proposes to use sentiment analysis to extract useful information from multiple textual data sources and a blending ensemble deep learning model to predict future stock movement.

Deep Learning Philosophy +4

Efficient Hyperparameter Optimization in Deep Learning Using a Variable Length Genetic Algorithm

1 code implementation23 Jun 2020 Xueli Xiao, Ming Yan, Sunitha Basodi, Chunyan Ji, Yi Pan

However, traditional genetic algorithms with fixed-length chromosomes may not be a good fit for optimizing deep learning hyperparameters, because deep learning models have variable number of hyperparameters depending on the model depth.

Hyperparameter Optimization

Gradient Amplification: An efficient way to train deep neural networks

no code implementations16 Jun 2020 Sunitha Basodi, Chunyan Ji, Haiping Zhang, Yi Pan

Our proposed approach improves performance of these deep learning models even at higher learning rates, thereby allowing these models to achieve higher performance with reduced training time.

Deep Learning

Advancing the State of the Art in Open Domain Dialog Systems through the Alexa Prize

no code implementations27 Dec 2018 Chandra Khatri, Behnam Hedayatnia, Anu Venkatesh, Jeff Nunn, Yi Pan, Qing Liu, Han Song, Anna Gottardi, Sanjeev Kwatra, Sanju Pancholi, Ming Cheng, Qinglang Chen, Lauren Stubel, Karthik Gopalakrishnan, Kate Bland, Raefer Gabriel, Arindam Mandal, Dilek Hakkani-Tur, Gene Hwang, Nate Michel, Eric King, Rohit Prasad

In the second iteration of the competition in 2018, university teams advanced the state of the art by using context in dialog models, leveraging knowledge graphs for language understanding, handling complex utterances, building statistical and hierarchical dialog managers, and leveraging model-driven signals from user responses.

Knowledge Graphs Management +4

Three-Stream Convolutional Networks for Video-based Person Re-Identification

no code implementations22 Nov 2017 Zeng Yu, Tianrui Li, Ning Yu, Xun Gong, Ke Chen, Yi Pan

This paper aims to develop a new architecture that can make full use of the feature maps of convolutional networks.

Video-Based Person Re-Identification

Reconstruction of Hidden Representation for Robust Feature Extraction

no code implementations8 Oct 2017 Zeng Yu, Tianrui Li, Ning Yu, Yi Pan, Hongmei Chen, Bing Liu

We believe that minimizing the reconstruction error of the hidden representation is more robust than minimizing the Frobenius norm of the Jacobian matrix of the hidden representation.

Denoising Representation Learning

Parallel Large-Scale Attribute Reduction on Cloud Systems

no code implementations6 Oct 2016 Junbo Zhang, Tianrui Li, Yi Pan

The rapid growth of emerging information technologies and application patterns in modern society, e. g., Internet, Internet of Things, Cloud Computing and Tri-network Convergence, has caused the advent of the era of big data.

Attribute Cloud Computing +1

Effective-one-body model for black-hole binaries with generic mass ratios and spins

no code implementations11 Nov 2013 Andrea Taracchini, Alessandra Buonanno, Yi Pan, Tanja Hinderer, Michael Boyle, Daniel A. Hemberger, Lawrence E. Kidder, Geoffrey Lovelace, Abdul H. Mroue, Harald P. Pfeiffer, Mark A. Scheel, Bela Szilagyi, Nicholas W. Taylor, Anil Zenginoglu

Gravitational waves emitted by black-hole binary systems have the highest signal-to-noise ratio in LIGO and Virgo detectors when black-hole spins are aligned with the orbital angular momentum and extremal.

General Relativity and Quantum Cosmology

Cannot find the paper you are looking for? You can Submit a new open access paper.