no code implementations • 16 Mar 2023 • Matevž Fabjančič, Octavian Machidon, Hashim Sharif, Yifan Zhao, Saša Misailović, Veljko Pejović
We implement Mobiprox in Android OS and through experiments in diverse mobile domains, including human activity recognition and spoken keyword detection, demonstrate that it can save up to 15% system-wide energy with a minimal impact on the inference accuracy.
1 code implementation • 28 Dec 2022 • Yifan Zhao, Jia Li, Xiaowu Chen, Yonghong Tian
This framework, namely PArt-guided Relational Transformers (PART), is proposed to learn the discriminative part features with an automatic part discovery module, and to explore the intrinsic correlations with a feature transformation module by adapting the Transformer models from the field of natural language processing.
Ranked #4 on Fine-Grained Image Classification on FGVC Aircraft
Fine-Grained Image Classification Fine-Grained Visual Recognition +1
no code implementations • 28 Dec 2022 • Yifan Zhao, Jia Li, Yonghong Tian
Fine-grained visual parsing, including fine-grained part segmentation and fine-grained object recognition, has attracted considerable critical attention due to its importance in many real-world applications, e. g., agriculture, remote sensing, and space technologies.
no code implementations • 5 Dec 2022 • Jingxi Li, Tianyi Gan, Yifan Zhao, Bijie Bai, Che-Yung Shen, Songyu Sun, Mona Jarrahi, Aydogan Ozcan
A unidirectional imager would only permit image formation along one direction, from an input field-of-view (FOV) A to an output FOV B, and in the reverse path, the image formation would be blocked.
no code implementations • Neurocomputing 2022 • Heng Wu, Yifan Zhao, Jia Li
Recent ideas propose to explore this problem in an unsupervised setting, i. e., without any labels in base classes, which reduces the heavy consumption of manual annotations.
no code implementations • 21 Jun 2022 • Deniz Mengu, Yifan Zhao, Anika Tabassum, Mona Jarrahi, Aydogan Ozcan
Permutation matrices form an important computational building block frequently used in various fields including e. g., communications, information security and data processing.
no code implementations • 15 Jun 2022 • Cagatay Isil, Deniz Mengu, Yifan Zhao, Anika Tabassum, Jingxi Li, Yi Luo, Mona Jarrahi, Aydogan Ozcan
We report a deep learning-enabled diffractive display design that is based on a jointly-trained pair of an electronic encoder and a diffractive optical decoder to synthesize/project super-resolved images using low-resolution wavefront modulators.
no code implementations • 26 May 2022 • Bijie Bai, Yi Luo, Tianyi Gan, Jingtian Hu, Yuhang Li, Yifan Zhao, Deniz Mengu, Mona Jarrahi, Aydogan Ozcan
Here, we demonstrate a camera design that performs class-specific imaging of target objects with instantaneous all-optical erasure of other classes of objects.
no code implementations • 10 Nov 2021 • Jiaxin Li, Yan Ding, Weizhong Zhang, Yifan Zhao, Lingxi Guo, Zhe Yang
Augmented reality technology based on image registration is becoming increasingly popular for the convenience of pre-surgery preparation and medical education.
no code implementations • ICCV 2021 • Jiawei Zhao, Ke Yan, Yifan Zhao, Xiaowei Guo, Feiyue Huang, Jia Li
Different from these researches, in this paper, we propose a novel Transformer-based Dual Relation learning framework, constructing complementary relationships by exploring two aspects of correlation, i. e., structural relation graph and semantic relation graph.
1 code implementation • ACM MM 2021 • Jiawei Zhao, Yifan Zhao, Jia Li
Multi-label image recognition aims to recognize multiple objects simultaneously in one image.
1 code implementation • ICCV 2021 • Jiajian Zhao, Yifan Zhao, Jia Li, Ke Yan, Yonghong Tian
The crucial problem in vehicle re-identification is to find the same vehicle identity when reviewing this object from cross-view cameras, which sets a higher demand for learning viewpoint-invariant representations.
1 code implementation • 8 Sep 2021 • Zhongxing Ma, Yifan Zhao, Jia Li
Therefore, we propose a Pose-guided inter-and intra-part relational transformer (Pirt) for occluded person Re-Id, which builds part-aware long-term correlations by introducing transformers.
no code implementations • 8 Sep 2021 • Yifan Zhao, Jiawei Zhao, Jia Li, Xiaowu Chen
To construct our framework as well as achieving accurate salient detection results, we propose a Ubiquitous Target Awareness (UTA) network to solve three important challenges in RGB-D SOD task: 1) a depth awareness module to excavate depth information and to mine ambiguous regions via adaptive depth-error weights, 2) a spatial-aware cross-modal interaction and a channel-aware cross-level interaction, exploiting the low-level boundary cues and amplifying high-level salient channels, and 3) a gated multi-scale predictor module to perceive the object saliency in different contextual scales.
1 code implementation • ICCV 2021 • Chenxu Zhang, Yifan Zhao, Yifei HUANG, Ming Zeng, Saifeng Ni, Madhukar Budagavi, Xiaohu Guo
In this paper, we propose a talking face generation method that takes an audio signal as input and a short target video clip as reference, and synthesizes a photo-realistic video of the target face with natural lip motions, head poses, and eye blinks that are in-sync with the input audio signal.
1 code implementation • 1 Aug 2021 • Yifan Zhao, Le Hui, Jin Xie
To achieve this, we exploit the consistency between the input sparse point cloud and generated dense point cloud for the shapes and rendered images.
no code implementations • CVPR 2021 • Yifan Zhao, Ke Yan, Feiyue Huang, Jia Li
Fine-grained object recognition aims to learn effective features that can identify the subtle differences between visually similar objects.
Ranked #27 on Fine-Grained Image Classification on CUB-200-2011
no code implementations • 1 Jan 2021 • Yali Du, Yifan Zhao, Meng Fang, Jun Wang, Gangyan Xu, Haifeng Zhang
Dealing with multi-agent control in networked systems is one of the biggest challenges in Reinforcement Learning (RL) and limited success has been presented compared to recent deep reinforcement learning in single-agent domain.
no code implementations • 15 Oct 2020 • Chi Chen, Xin Peng, Zhenchang Xing, Jun Sun, Xin Wang, Yifan Zhao, Wenyun Zhao
APIRec-CST is a deep learning model that combines the API usage with the text information in the source code based on an API Context Graph Network and a Code Token Network that simultaneously learn structural and textual features for API recommendation.
1 code implementation • 17 Sep 2020 • Xin Guo, Yifan Zhao, Jia Li
To explore the relationship between music and dance movements, we propose a cross-modal alignment module that focuses on dancing video clips, accompanied on pre-designed music, to learn a system that can judge the consistency between the visual features of pose sequences and the acoustic features of music.
1 code implementation • 10 Aug 2020 • Zeyuan Wang, Yifan Zhao, Jia Li, Yonghong Tian
Given base classes with sufficient labeled samples, the target of few-shot classification is to recognize unlabeled samples of novel classes with only a few labeled samples.
1 code implementation • 30 May 2020 • Jia-Wei Zhao, Yifan Zhao, Jia Li, Xiaowu Chen
To solve this, many recent RGBD-based networks are proposed by adopting the depth map as an independent input and fuse the features with RGB information.
Ranked #1 on RGB-D Salient Object Detection on RGBD135
no code implementations • 23 May 2020 • Deniz Mengu, Yifan Zhao, Nezih T. Yardimci, Yair Rivenson, Mona Jarrahi, Aydogan Ozcan
By modeling the undesired layer-to-layer misalignments in 3D as continuous random variables in the optical forward model, diffractive networks are trained to maintain their inference accuracy over a large range of misalignments; we term this diffractive network design as vaccinated D2NN (v-D2NN).
no code implementations • ICCV 2019 • Yifan Zhao, Jia Li, Yu Zhang, Yonghong Tian
In this paper, we propose a joint parsing framework with boundary and semantic awareness to address this challenging problem.
1 code implementation • 31 Jul 2019 • Yi Zheng, Yifan Zhao, Mengyuan Ren, He Yan, Xiangju Lu, Junhui Liu, Jia Li
Recent years have witnessed increasing attention in cartoon media, powered by the strong demands of industrial applications.
no code implementations • 10 Apr 2019 • Kaiwen Yu, Jia Li, Yu Zhang, Yifan Zhao, Long Xu
Along with the development of virtual reality (VR), omnidirectional images play an important role in producing multimedia content with immersive experience.