Search Results for author: Jianwei Yin

Found 31 papers, 11 papers with code

Bridging Context Gaps: Leveraging Coreference Resolution for Long Contextual Understanding

no code implementations2 Oct 2024 Yanming Liu, Xinyue Peng, Jiannan Cao, Shi Bo, Yanxin Shen, Xuhong Zhang, Sheng Cheng, Xun Wang, Jianwei Yin, Tianyu Du

Large language models (LLMs) have shown remarkable capabilities in natural language processing; however, they still face difficulties when tasked with understanding lengthy contexts and executing effective question answering.

coreference-resolution Question Answering

Operating System And Artificial Intelligence: A Systematic Review

no code implementations19 Jul 2024 Yifan Zhang, Xinkui Zhao, Jianwei Yin, Lufei Zhang, Zuoning Chen

In the dynamic landscape of technology, the convergence of Artificial Intelligence (AI) and Operating Systems (OS) has emerged as a pivotal arena for innovation.

Intrusion Detection Scheduling

Preserving Knowledge in Large Language Model with Model-Agnostic Self-Decompression

no code implementations17 Jun 2024 Zilun Zhang, Yutao Sun, Tiancheng Zhao, Leigang Sha, Ruochen Xu, Kyusong Lee, Jianwei Yin

Humans can retain old knowledge while learning new information, but Large Language Models (LLMs) often suffer from catastrophic forgetting when post-pretrained or supervised fine-tuned (SFT) on domain-specific data.

Language Modelling Large Language Model

DP-MemArc: Differential Privacy Transfer Learning for Memory Efficient Language Models

no code implementations16 Jun 2024 Yanming Liu, Xinyue Peng, Yuwei Zhang, Xiaolan Ke, Songhang Deng, Jiannan Cao, Chen Ma, Mengchen Fu, Xuhong Zhang, Sheng Cheng, Xun Wang, Jianwei Yin, Tianyu Du

In this paper, we introduce DP-MemArc, a novel training framework aimed at reducing the memory costs of large language models while emphasizing the protection of user data privacy.

Transfer Learning

NovoBench: Benchmarking Deep Learning-based De Novo Peptide Sequencing Methods in Proteomics

no code implementations16 Jun 2024 Jingbo Zhou, Shaorong Chen, Jun Xia, Sizhe Liu, Tianze Ling, Wenjie Du, Yue Liu, Jianwei Yin, Stan Z. Li

In addition to amino acid-level and peptide-level precision and recall, we evaluate the models' performance in terms of identifying post-tranlational modifications (PTMs), efficiency and robustness to peptide length, noise peaks and missing fragment ratio, which are important influencing factors while seldom be considered.

Benchmarking de novo peptide sequencing

Tool-Planner: Task Planning with Clusters across Multiple Tools

1 code implementation6 Jun 2024 Yanming Liu, Xinyue Peng, Jiannan Cao, Shi Bo, Yuwei Zhang, Xuhong Zhang, Sheng Cheng, Xun Wang, Jianwei Yin, Tianyu Du

Experiments show that our approach demonstrates a high pass and win rate across different datasets and optimizes the planning scheme for tool learning in models such as GPT-4 and Claude 3, showcasing the potential of our method.

Language Modelling Large Language Model

Data-Free Federated Class Incremental Learning with Diffusion-Based Generative Memory

no code implementations22 May 2024 Naibo Wang, Yuchen Deng, Wenjie Feng, Jianwei Yin, See-Kiong Ng

In this paper, we introduce a novel data-free federated class incremental learning framework with diffusion-based generative memory (DFedDGM) to mitigate catastrophic forgetting by generating stable, high-quality images through diffusion models.

class-incremental learning Class Incremental Learning +4

SkinGEN: an Explainable Dermatology Diagnosis-to-Generation Framework with Interactive Vision-Language Models

no code implementations23 Apr 2024 Bo Lin, Yingjing Xu, Xuanwen Bao, Zhou Zhao, Zuyong Zhang, Zhouyang Wang, Jie Zhang, Shuiguang Deng, Jianwei Yin

With the continuous advancement of vision language models (VLMs) technology, remarkable research achievements have emerged in the dermatology field, the fourth most prevalent human disease category.

Hallucination Image Generation

One-Shot Sequential Federated Learning for Non-IID Data by Enhancing Local Model Diversity

no code implementations18 Apr 2024 Naibo Wang, Yuchen Deng, Wenjie Feng, Shichen Fan, Jianwei Yin, See-Kiong Ng

In this paper, we improve the one-shot sequential federated learning for non-IID data by proposing a local model diversity-enhancing strategy.

Diversity Federated Learning

TransLinkGuard: Safeguarding Transformer Models Against Model Stealing in Edge Deployment

no code implementations17 Apr 2024 Qinfeng Li, Zhiqiang Shen, Zhenghan Qin, Yangfan Xie, Xuhong Zhang, Tianyu Du, Jianwei Yin

Specifically, we identify four critical protection properties that existing methods fail to simultaneously satisfy: (1) maintaining protection after a model is physically copied; (2) authorizing model access at request level; (3) safeguarding runtime reverse engineering; (4) achieving high security with negligible runtime overhead.

RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback

1 code implementation11 Mar 2024 Yanming Liu, Xinyue Peng, Xuhong Zhang, Weihao Liu, Jianwei Yin, Jiannan Cao, Tianyu Du

Large language models (LLMs) demonstrate exceptional performance in numerous tasks but still heavily rely on knowledge stored in their parameters.

RAG Retrieval

ERA-CoT: Improving Chain-of-Thought through Entity Relationship Analysis

1 code implementation11 Mar 2024 Yanming Liu, Xinyue Peng, Tianyu Du, Jianwei Yin, Weihao Liu, Xuhong Zhang

Large language models (LLMs) have achieved commendable accomplishments in various natural language processing tasks.

Question Answering

Post-Training Attribute Unlearning in Recommender Systems

no code implementations11 Mar 2024 Chaochao Chen, Yizhao Zhang, Yuyuan Li, Dan Meng, Jun Wang, Xiaoli Zheng, Jianwei Yin

The first component is distinguishability loss, where we design a distribution-based measurement to make attribute labels indistinguishable from attackers.

Attribute Recommendation Systems

GroundVLP: Harnessing Zero-shot Visual Grounding from Vision-Language Pre-training and Open-Vocabulary Object Detection

1 code implementation22 Dec 2023 Haozhan Shen, Tiancheng Zhao, Mingwei Zhu, Jianwei Yin

Visual grounding, a crucial vision-language task involving the understanding of the visual context based on the query expression, necessitates the model to capture the interactions between objects, as well as various spatial and attribute information.

Attribute object-detection +2

Benchmarking Sequential Visual Input Reasoning and Prediction in Multimodal Large Language Models

1 code implementation20 Oct 2023 Mingwei Zhu, Leigang Sha, Yu Shu, Kangjia Zhao, Tiancheng Zhao, Jianwei Yin

Multimodal large language models (MLLMs) have shown great potential in perception and interpretation tasks, but their capabilities in predictive reasoning remain under-explored.

Activity Prediction Benchmarking +2

Federated Large Language Model: A Position Paper

no code implementations18 Jul 2023 Chaochao Chen, Xiaohua Feng, Jun Zhou, Jianwei Yin, Xiaolin Zheng

Large scale language models (LLM) have received significant attention and found diverse applications across various domains, but their development encounters challenges in real-world scenarios.

Federated Learning Language Modelling +3

RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing

1 code implementation20 Jun 2023 Zilun Zhang, Tiancheng Zhao, Yulong Guo, Jianwei Yin

Moreover, we present an image-text paired dataset in the field of remote sensing (RS), RS5M, which has 5 million RS images with English descriptions.

 Ranked #1 on Text Retrieval on RSICD (using extra training data)

Cross-Modal Retrieval Image Retrieval +5

EasySpider: A No-Code Visual System for Crawling the Web

1 code implementation ACM The Web Conference 2023 Naibo Wang, Wenjie Feng, Jianwei Yin, See-Kiong Ng

As such, web-crawling is an essential tool for both computational and non-computational scientists to conduct research.

Data Integration Marketing

FreeEagle: Detecting Complex Neural Trojans in Data-Free Cases

1 code implementation28 Feb 2023 Chong Fu, Xuhong Zhang, Shouling Ji, Ting Wang, Peng Lin, Yanghe Feng, Jianwei Yin

Thus, in this paper, we propose FreeEagle, the first data-free backdoor detection method that can effectively detect complex backdoor attacks on deep neural networks, without relying on the access to any clean samples or samples with the trigger.

Backdoor Attack

VL-CheckList: Evaluating Pre-trained Vision-Language Models with Objects, Attributes and Relations

1 code implementation1 Jul 2022 Tiancheng Zhao, Tianqi Zhang, Mingwei Zhu, Haozhan Shen, Kyusong Lee, Xiaopeng Lu, Jianwei Yin

Inspired by the CheckList for testing natural language processing, we exploit VL-CheckList, a novel framework to understand the capabilities of VLP models.

Differentiable and Scalable Generative Adversarial Models for Data Imputation

no code implementations10 Jan 2022 Yangyang Wu, Jun Wang, Xiaoye Miao, Wenjia Wang, Jianwei Yin

DIM leverages a new masking Sinkhorn divergence function to make an arbitrary generative adversarial imputation model differentiable, while for such a differentiable imputation model, SSE can estimate an appropriate sample size to ensure the user-specified imputation accuracy of the final model.

Imputation

Towards Scalable and Privacy-Preserving Deep Neural Network via Algorithmic-Cryptographic Co-design

no code implementations17 Dec 2020 Jun Zhou, Longfei Zheng, Chaochao Chen, Yan Wang, Xiaolin Zheng, Bingzhe Wu, Cen Chen, Li Wang, Jianwei Yin

In this paper, we propose SPNN - a Scalable and Privacy-preserving deep Neural Network learning framework, from algorithmic-cryptographic co-perspective.

Privacy Preserving

Joint Partial Optimal Transport for Open Set Domain Adaptation

no code implementations11 Jul 2020 Renjun Xu, Pelen Liu, Yin Zhang, Fang Cai, Jindong Wang, Shuoying Liang, Heting Ying, Jianwei Yin

However, in a general setting when the target domain contains classes that are never observed in the source domain, namely in Open Set Domain Adaptation (OSDA), existing DA methods failed to work because of the interference of the extra unknown classes.

Domain Adaptation

Service Wrapper: a system for converting web data into web services

1 code implementation17 Oct 2019 Naibo Wang, Zhiling Luo, Xiya Lyu, Zitong Yang, Jianwei Yin

In this work, we construct a service wrapper system to convert available data in web pages into web services.

Context-Aware Deep Spatio-Temporal Network for Hand Pose Estimation from Depth Images

no code implementations6 Oct 2018 Yiming Wu, Wei Ji, Xi Li, Gang Wang, Jianwei Yin, Fei Wu

As a fundamental and challenging problem in computer vision, hand pose estimation aims to estimate the hand joint locations from depth images.

Hand Pose Estimation

Cannot find the paper you are looking for? You can Submit a new open access paper.