Search Results for author: Jianwei Yin

Found 22 papers, 10 papers with code

Context-Aware Deep Spatio-Temporal Network for Hand Pose Estimation from Depth Images

no code implementations6 Oct 2018 Yiming Wu, Wei Ji, Xi Li, Gang Wang, Jianwei Yin, Fei Wu

As a fundamental and challenging problem in computer vision, hand pose estimation aims to estimate the hand joint locations from depth images.

Hand Pose Estimation

Service Wrapper: a system for converting web data into web services

1 code implementation17 Oct 2019 Naibo Wang, Zhiling Luo, Xiya Lyu, Zitong Yang, Jianwei Yin

In this work, we construct a service wrapper system to convert available data in web pages into web services.

Joint Partial Optimal Transport for Open Set Domain Adaptation

no code implementations11 Jul 2020 Renjun Xu, Pelen Liu, Yin Zhang, Fang Cai, Jindong Wang, Shuoying Liang, Heting Ying, Jianwei Yin

However, in a general setting when the target domain contains classes that are never observed in the source domain, namely in Open Set Domain Adaptation (OSDA), existing DA methods failed to work because of the interference of the extra unknown classes.

Domain Adaptation

Towards Scalable and Privacy-Preserving Deep Neural Network via Algorithmic-Cryptographic Co-design

no code implementations17 Dec 2020 Jun Zhou, Longfei Zheng, Chaochao Chen, Yan Wang, Xiaolin Zheng, Bingzhe Wu, Cen Chen, Li Wang, Jianwei Yin

In this paper, we propose SPNN - a Scalable and Privacy-preserving deep Neural Network learning framework, from algorithmic-cryptographic co-perspective.

Privacy Preserving

Differentiable and Scalable Generative Adversarial Models for Data Imputation

no code implementations10 Jan 2022 Yangyang Wu, Jun Wang, Xiaoye Miao, Wenjia Wang, Jianwei Yin

DIM leverages a new masking Sinkhorn divergence function to make an arbitrary generative adversarial imputation model differentiable, while for such a differentiable imputation model, SSE can estimate an appropriate sample size to ensure the user-specified imputation accuracy of the final model.

Imputation

VL-CheckList: Evaluating Pre-trained Vision-Language Models with Objects, Attributes and Relations

1 code implementation1 Jul 2022 Tiancheng Zhao, Tianqi Zhang, Mingwei Zhu, Haozhan Shen, Kyusong Lee, Xiaopeng Lu, Jianwei Yin

Inspired by the CheckList for testing natural language processing, we exploit VL-CheckList, a novel framework to understand the capabilities of VLP models.

FreeEagle: Detecting Complex Neural Trojans in Data-Free Cases

1 code implementation28 Feb 2023 Chong Fu, Xuhong Zhang, Shouling Ji, Ting Wang, Peng Lin, Yanghe Feng, Jianwei Yin

Thus, in this paper, we propose FreeEagle, the first data-free backdoor detection method that can effectively detect complex backdoor attacks on deep neural networks, without relying on the access to any clean samples or samples with the trigger.

Backdoor Attack

EasySpider: A No-Code Visual System for Crawling the Web

1 code implementation ACM The Web Conference 2023 Naibo Wang, Wenjie Feng, Jianwei Yin, See-Kiong Ng

As such, web-crawling is an essential tool for both computational and non-computational scientists to conduct research.

Data Integration Marketing

RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing

1 code implementation20 Jun 2023 Zilun Zhang, Tiancheng Zhao, Yulong Guo, Jianwei Yin

Moreover, we present an image-text paired dataset in the field of remote sensing (RS), RS5M, which has 5 million RS images with English descriptions.

 Ranked #1 on Cross-Modal Retrieval on RSITMD (using extra training data)

Cross-Modal Retrieval Image Retrieval +5

Federated Large Language Model: A Position Paper

no code implementations18 Jul 2023 Chaochao Chen, Xiaohua Feng, Jun Zhou, Jianwei Yin, Xiaolin Zheng

Large scale language models (LLM) have received significant attention and found diverse applications across various domains, but their development encounters challenges in real-world scenarios.

Federated Learning Language Modelling +3

Benchmarking Sequential Visual Input Reasoning and Prediction in Multimodal Large Language Models

1 code implementation20 Oct 2023 Mingwei Zhu, Leigang Sha, Yu Shu, Kangjia Zhao, Tiancheng Zhao, Jianwei Yin

Multimodal large language models (MLLMs) have shown great potential in perception and interpretation tasks, but their capabilities in predictive reasoning remain under-explored.

Activity Prediction Benchmarking +2

GroundVLP: Harnessing Zero-shot Visual Grounding from Vision-Language Pre-training and Open-Vocabulary Object Detection

1 code implementation22 Dec 2023 Haozhan Shen, Tiancheng Zhao, Mingwei Zhu, Jianwei Yin

Visual grounding, a crucial vision-language task involving the understanding of the visual context based on the query expression, necessitates the model to capture the interactions between objects, as well as various spatial and attribute information.

Attribute object-detection +2

RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback

1 code implementation11 Mar 2024 Yanming Liu, Xinyue Peng, Xuhong Zhang, Weihao Liu, Jianwei Yin, Jiannan Cao, Tianyu Du

Large language models (LLMs) demonstrate exceptional performance in numerous tasks but still heavily rely on knowledge stored in their parameters.

Retrieval

ERA-CoT: Improving Chain-of-Thought through Entity Relationship Analysis

1 code implementation11 Mar 2024 Yanming Liu, Xinyue Peng, Tianyu Du, Jianwei Yin, Weihao Liu, Xuhong Zhang

Large language models (LLMs) have achieved commendable accomplishments in various natural language processing tasks.

Question Answering

Post-Training Attribute Unlearning in Recommender Systems

no code implementations11 Mar 2024 Chaochao Chen, Yizhao Zhang, Yuyuan Li, Dan Meng, Jun Wang, Xiaoli Zheng, Jianwei Yin

The first component is distinguishability loss, where we design a distribution-based measurement to make attribute labels indistinguishable from attackers.

Attribute Recommendation Systems

TransLinkGuard: Safeguarding Transformer Models Against Model Stealing in Edge Deployment

no code implementations17 Apr 2024 Qinfeng Li, Zhiqiang Shen, Zhenghan Qin, Yangfan Xie, Xuhong Zhang, Tianyu Du, Jianwei Yin

Specifically, we identify four critical protection properties that existing methods fail to simultaneously satisfy: (1) maintaining protection after a model is physically copied; (2) authorizing model access at request level; (3) safeguarding runtime reverse engineering; (4) achieving high security with negligible runtime overhead.

One-Shot Sequential Federated Learning for Non-IID Data by Enhancing Local Model Diversity

no code implementations18 Apr 2024 Naibo Wang, Yuchen Deng, Wenjie Feng, Shichen Fan, Jianwei Yin, See-Kiong Ng

In this paper, we improve the one-shot sequential federated learning for non-IID data by proposing a local model diversity-enhancing strategy.

Federated Learning

SkinGEN: an Explainable Dermatology Diagnosis-to-Generation Framework with Interactive Vision-Language Models

no code implementations23 Apr 2024 Bo Lin, Yingjing Xu, Xuanwen Bao, Zhou Zhao, Zuyong Zhang, Zhouyang Wang, Jie Zhang, Shuiguang Deng, Jianwei Yin

With the continuous advancement of vision language models (VLMs) technology, remarkable research achievements have emerged in the dermatology field, the fourth most prevalent human disease category.

Cannot find the paper you are looking for? You can Submit a new open access paper.