no code implementations • 22 Sep 2024 • Chuanbo Hu, Shan Jia, Xin Li
Effective urban renewal efforts can transform these environments, enhancing their appeal and livability.
no code implementations • 5 Aug 2024 • Ye Yao, Tingfeng Han, Shan Jia, Siwei Lyu
Image inpainting, which is the task of filling in missing areas in an image, is a common image editing technique.
no code implementations • 3 Jun 2024 • Mingzhen Huang, Jialing Cai, Shan Jia, Vishnu Suresh Lokhande, Siwei Lyu
This dataset is a benchmark for evaluating text-driven image editing methods in multifaceted scenarios.
1 code implementation • 30 Apr 2024 • Cai Yu, Shan Jia, Xiaomeng Fu, Jin Liu, Jiahe Tian, Jiao Dai, Xi Wang, Siwei Lyu, Jizhong Han
With the rising prevalence of deepfakes, there is a growing interest in developing generalizable detection methods for various types of deepfakes.
1 code implementation • 28 Apr 2024 • Mingzhen Huang, Shan Jia, Zhou Zhou, Yan Ju, Jialing Cai, Siwei Lyu
In the battle against widespread online misinformation, a growing problem is text-image inconsistency, where images are misleadingly paired with texts with different intent or meaning.
1 code implementation • 19 Apr 2024 • Yan Ju, Chengzhe Sun, Shan Jia, Shuwei Hou, Zhaofeng Si, Soumyya Kanti Datta, Lipeng Ke, Riky Zhou, Anita Nikolich, Siwei Lyu
Furthermore, it serves as an evaluation and benchmarking platform for researchers in digital media forensics to compare the performance of multiple algorithms on the same input.
1 code implementation • 21 Mar 2024 • Shan Jia, Reilin Lyu, Kangran Zhao, Yize Chen, Zhiyuan Yan, Yan Ju, Chuanbo Hu, Xin Li, Baoyuan Wu, Siwei Lyu
DeepFakes, which refer to AI-generated media content, have become an increasing concern due to their use as a means for disinformation.
1 code implementation • 18 Jan 2024 • Soumyya Kanti Datta, Shan Jia, Siwei Lyu
A lip-syncing deepfake is a digitally manipulated video in which a person's lip movements are created convincingly using AI models to match altered or entirely new audio.
no code implementations • 5 Oct 2023 • Sneha Muppalla, Shan Jia, Siwei Lyu
Deepfakes are AI-generated media in which an image or video has been digitally modified.
1 code implementation • 29 Jun 2023 • Yan Ju, Shu Hu, Shan Jia, George H. Chen, Siwei Lyu
Despite the development of effective deepfake detectors in recent years, recent studies have demonstrated that biases in the data used to train these detectors can lead to disparities in detection accuracy across different races and genders.
no code implementations • 4 May 2023 • Chuanbo Hu, Shan Jia, Fan Zhang, Changjiang Xiao, Mindi Ruan, Jacob Thrasher, Xin Li
Experimental results on the re-annotated Place Pulse 2. 0 dataset demonstrate promising detection performance of the proposed method, with an accuracy of 79. 9%.
1 code implementation • 14 Apr 2023 • Shan Jia, Mingzhen Huang, Zhou Zhou, Yan Ju, Jialing Cai, Siwei Lyu
To achieve this, we propose a new approach that leverages the DALL-E2 language-image model to automatically generate and splice masked regions guided by a text prompt.
1 code implementation • 16 Nov 2022 • Yan Ju, Shan Jia, Jialing Cai, Haiying Guan, Siwei Lyu
To address this issue, we propose a Global and Local Feature Fusion (GLFF) framework to learn rich and discriminative representations by combining multi-scale global features from the whole image with refined local features from informative patches for AI synthesized image detection.
1 code implementation • 27 Oct 2022 • Na Zhang, Shan Jia, Siwei Lyu, Xin Li
Our technical contributions include: 1) We propose a fusion-based few-shot learning (FSL) method to learn discriminative features that can generalize to unseen morphing attack types from predefined presentation attacks; 2) The proposed FSL based on the fusion of the PRNU model and Noiseprint network is extended from binary MAD to multiclass morphing attack fingerprinting (MAF).
1 code implementation • 7 Sep 2022 • Qiang Xu, Shan Jia, Xinghao Jiang, Tanfeng Sun, Zhe Wang, Hong Yan
Based on the finding that multiple different modules in image acquisition will lead to different sensitivity inconsistencies to the convolutional neural network (CNN)-based rendering in images, we propose a deep texture rendering module for texture difference enhancement and discriminative texture representation.
1 code implementation • 14 May 2022 • Chuanbo Hu, Shan Jia, Fan Zhang, Xin Li
However, due to the large diversity of geographic context and acquisition conditions, the captured SVI always contains various distracting objects (e. g., pedestrians and vehicles), which will distract human visual attention from efficiently finding the destination in the last few meters.
1 code implementation • 26 Mar 2022 • Yan Ju, Shan Jia, Lipeng Ke, Hongfei Xue, Koki Nagano, Siwei Lyu
Specifically, we design a two-branch model to combine global spatial information from the whole image and local informative features from multiple patches selected by a novel patch selection module.
1 code implementation • 25 Feb 2022 • Shan Jia, Xin Li, Siwei Lyu
Then we take Deepfakes model attribution as a multiclass classification task and propose a spatial and temporal attention based method to explore the differences among Deepfakes in the new dataset.
no code implementations • 26 Aug 2020 • Shan Jia, Shuo Wang, Chuanbo Hu, Paula Webster, Xin Li
Facial expressions of emotion play an important role in human social interactions.
no code implementations • 12 May 2020 • Shan Jia, Xin Li, Chuanbo Hu, Guodong Guo, Zhengquan Xu
We have witnessed rapid advances in both face presentation attack models and presentation attack detection (PAD) in recent years.
no code implementations • 12 Oct 2019 • Shan Jia, Xin Li, Chuanbo Hu, Zhengquan Xu
In this work, we introduce a wax figure face database (WFFD) as a novel and super-realistic 3D face presentation attack.
no code implementations • 6 Jun 2019 • Shan Jia, Chuanbo Hu, Guodong Guo, Zhengquan Xu
Compared to 2D face presentation attacks (e. g. printed photos and video replays), 3D type attacks are more challenging to face recognition systems (FRS) by presenting 3D characteristics or materials similar to real faces.