no code implementations • 1 May 2023 • Zhao Xu, Yaochen Xie, Youzhi Luo, Xuan Zhang, Xinyi Xu, Meng Liu, Kaleb Dickerson, Cheng Deng, Maho Nakata, Shuiwang Ji
Here, we propose a novel deep learning framework to predict 3D geometries from molecular graphs.
no code implementations • 14 Apr 2023 • Cheng Deng, Jiaxin Ding, Luoyi Fu, Weinan Zhang, Xinbing Wang, Chenghu Zhou
In this work, we propose Covidia, COVID-19 interdisciplinary academic knowledge graph to bridge the gap between knowledge of COVID-19 on different domains.
no code implementations • 3 Apr 2023 • Cheng Deng, Fan Xu, Jiaxing Ding, Luoyi Fu, Weinan Zhang, Xinbing Wang
Graph representation learning has been widely studied and demonstrated effectiveness in various graph tasks.
2 code implementations • 2 Apr 2023 • Cheng Deng, Bo Tong, Luoyi Fu, Jiaxin Ding, Dexing Cao, Xinbing Wang, Chenghu Zhou
In the research of end-to-end dialogue systems, using real-world knowledge to generate natural, fluent, and human-like utterances with correct answers is crucial.
1 code implementation • CVPR 2023 • Muli Yang, Liancheng Wang, Cheng Deng, Hanwang Zhang
Novel Class Discovery (NCD) aims to discover unknown classes without any annotation, by exploiting the transferable knowledge already learned from a base set of known classes.
no code implementations • CVPR 2023 • Aming Wu, Cheng Deng
To simulate this ability, a task of unsupervised out-of-distribution object detection (OOD-OD) is proposed to detect the objects that are never-seen-before during model training, which is beneficial for promoting the safe deployment of object detectors.
no code implementations • 20 Nov 2022 • Wenli Sun, Xinyang Jiang, Shuguang Dou, Dongsheng Li, Duoqian Miao, Cheng Deng, Cairong Zhao
Instead of learning fixed triggers for the target classes from the training set, DT-IBA can dynamically generate new triggers for any unknown identities.
1 code implementation • CVPR 2022 • Xiangyu Li, Xu Yang, Kun Wei, Cheng Deng, Muli Yang
Some methods recognize state and object with two trained classifiers, ignoring the impact of the interaction between object and state; the other methods try to learn the joint representation of the state-object compositions, leading to the domain gap between seen and unseen composition sets.
no code implementations • 4 Jun 2022 • Yingbin Bai, Erkun Yang, Zhaoqing Wang, Yuxuan Du, Bo Han, Cheng Deng, Dadong Wang, Tongliang Liu
With the training going on, the model begins to overfit noisy pairs.
no code implementations • 19 Mar 2022 • Qingsong Zhang, Bin Gu, Zhiyuan Dang, Cheng Deng, Heng Huang
Based on that, we propose a novel and practical VFL framework with black-box models, which is inseparably interconnected to the promising properties of ZOO.
1 code implementation • CVPR 2022 • Yanan Gu, Xu Yang, Kun Wei, Cheng Deng
Unfortunately, these methods only focus on selecting samples from the memory bank for replay and ignore the adequate exploration of semantic information in the single-pass data stream, leading to poor classification accuracy.
1 code implementation • CVPR 2022 • Aming Wu, Cheng Deng
Particularly, for the night-sunny scene, our method outperforms baselines by 3%, which indicates that our method is instrumental in enhancing generalization ability.
1 code implementation • CVPR 2022 • Muli Yang, Yuehua Zhu, Jiaping Yu, Aming Wu, Cheng Deng
In response to the explosively-increasing requirement of annotated data, Novel Class Discovery (NCD) has emerged as a promising alternative to automatically recognize unknown classes without any annotation.
no code implementations • CVPR 2022 • Jiexi Yan, Lei Luo, Chenghao Xu, Cheng Deng, Heng Huang
While in metric space, we utilize weakly-supervised contrastive learning to excavate these negative correlations hidden in noisy data.
no code implementations • CVPR 2022 • Erkun Yang, Dongren Yao, Tongliang Liu, Cheng Deng
More specifically, we propose a proxy-based contrastive (PC) loss to mitigate the gap between different modalities and train networks for different modalities jointly with small-loss samples that are selected with the PC loss and a mutual quantization loss.
1 code implementation • NeurIPS 2021 • Aming Wu, Suqi Zhao, Cheng Deng, Wei Liu
To alleviate the impact of few samples, enhancing the generalization and discrimination abilities of detectors on new objects plays an important role.
no code implementations • 29 Oct 2021 • Jiexi Yan, Lei Luo, Cheng Deng, Heng Huang
Since these noisy labels often cause severe performance degradation, it is crucial to enhance the robustness and generalization ability of DML.
3 code implementations • 30 Sep 2021 • Zhao Xu, Youzhi Luo, Xuan Zhang, Xinyi Xu, Yaochen Xie, Meng Liu, Kaleb Dickerson, Cheng Deng, Maho Nakata, Shuiwang Ji
Here, we propose to predict the ground-state 3D geometries from molecular graphs using machine learning methods.
Ranked #1 on
3D Geometry Prediction
on Molecule3D val
no code implementations • 29 Sep 2021 • Ziqi Zhang, Cheng Deng, Kun Wei, Xu Yang
And on this basis, a novel attribute transfer method, named semantic directional decomposition network (SDD-Net), is proposed to achieve semantic-level facial attribute transfer by latent semantic direction decomposition, improving the interpretability and editability of our method.
no code implementations • 26 Sep 2021 • Qingsong Zhang, Bin Gu, Cheng Deng, Songxiang Gu, Liefeng Bo, Jian Pei, Heng Huang
To address the challenges of communication and computation resource utilization, we propose an asynchronous stochastic quasi-Newton (AsySQN) framework for VFL, under which three algorithms, i. e. AsySQN-SGD, -SVRG and -SAGA, are proposed.
no code implementations • 20 Jul 2021 • Xinyi Xu, Cheng Deng, Yaochen Xie, Shuiwang Ji
Our framework embeds the given graph into multiple subspaces, of which each representation is prompted to encode specific characteristics of graphs.
1 code implementation • 22 Jun 2021 • Zhipeng Wang, Hao Wang, Jiexi Yan, Aming Wu, Cheng Deng
Most existing methods regard ZS-SBIR as a traditional classification problem and employ a cross-entropy or triplet-based loss to achieve retrieval, which neglect the problems of the domain gap between sketches and natural images and the large intra-class diversity in sketches.
1 code implementation • CVPR 2021 • Xu Yang, Cheng Deng, Zhiyuan Dang, Kun Wei, Junchi Yan
Specifically, the Identity Aggregation is applied to extract semantic features from labeled nodes, the Semantic Alignment is utilized to align node features obtained from different aspects using the class central similarity.
no code implementations • CVPR 2021 • Jiexi Yan, Lei Luo, Cheng Deng, Heng Huang
Learning feature embedding directly from images without any human supervision is a very challenging and essential task in the field of computer vision and machine learning.
1 code implementation • CVPR 2021 • Zhiyuan Dang, Cheng Deng, Xu Yang, Kun Wei, Heng Huang
Specifically, for the local level, we match the nearest neighbors based on batch embedded features, as for the global one, we match neighbors from overall embedded features.
1 code implementation • 9 Mar 2021 • Zhiyuan Dang, Cheng Deng, Xu Yang, Heng Huang
In this paper, we present a novel Doubly Contrastive Deep Clustering (DCDC) framework, which constructs contrastive loss over both sample and class views to obtain more discriminative features and competitive results.
no code implementations • 1 Mar 2021 • Qingsong Zhang, Bin Gu, Cheng Deng, Heng Huang
Vertical federated learning (VFL) attracts increasing attention due to the emerging demands of multi-party collaborative modeling and concerns of privacy leakage.
no code implementations • ICCV 2021 • Chao Li, Shangqian Gao, Cheng Deng, Wei Liu, Heng Huang
Specifically, given a target model, we first construct its substitute model to exploit cross-modal correlations within hamming space, with which we create adversarial examples by limitedly querying from a target model.
1 code implementation • 31 Dec 2020 • Kun Wei, Cheng Deng, Xu Yang, Maosen Li
Different from traditional incremental classification networks, the semantic gap between the embedding spaces of two adjacent tasks is the main challenge for embedding networks under incremental learning setting.
1 code implementation • NeurIPS 2020 • Xu Yang, Cheng Deng, Kun Wei, Junchi Yan, Wei Liu
Meanwhile, we devise an adversarial attack strategy to explore samples that easily fool the clustering layers but do not impact the performance of the deep embedding.
1 code implementation • 17 Nov 2020 • Xinyi Xu, Zhengyang Wang, Cheng Deng, Hao Yuan, Shuiwang Ji
Grouping has been commonly used in deep metric learning for computing diverse features.
1 code implementation • NeurIPS 2020 • Yuehua Zhu, Muli Yang, Cheng Deng, Wei Liu
In this paper, we propose a novel Proxy-based deep Graph Metric Learning (ProxyGML) approach from the perspective of graph classification, which uses fewer proxies yet achieves better comprehensive performance.
no code implementations • 14 Aug 2020 • Bin Gu, An Xu, Zhouyuan Huo, Cheng Deng, Heng Huang
To the best of our knowledge, AFSGD-VP and its SVRG and SAGA variants are the first asynchronous federated learning algorithms for vertically partitioned data.
1 code implementation • CVPR 2020 • Jie Li, Rongrong Ji, Hong Liu, Jianzhuang Liu, Bineng Zhong, Cheng Deng, Qi Tian
For reducing the solution space, we first model the adversarial perturbation optimization problem as a process of recovering frequency-sparse perturbations with compressed sensing, under the setting that random noise in the low-frequency space is more likely to be adversarial.
no code implementations • 3 Apr 2020 • Hao Wang, Cheng Deng, Fan Ma, Yi Yang
Actor and action video segmentation with language queries aims to segment out the expression referred objects in the video.
Ranked #9 on
Referring Expression Segmentation
on J-HMDB
1 code implementation • CVPR 2020 • Gen Luo, Yiyi Zhou, Xiaoshuai Sun, Liujuan Cao, Chenglin Wu, Cheng Deng, Rongrong Ji
In addition, we address a key challenge in this multi-task setup, i. e., the prediction conflict, with two innovative designs namely, Consistency Energy Maximization (CEM) and Adaptive Soft Non-Located Suppression (ASNLS).
1 code implementation • NeurIPS 2019 • Chao Li, Shangqian Gao, Cheng Deng, De Xie, Wei Liu
Extensive experiments on two cross-modal benchmark datasets show that the adversarial examples produced by our CMLA are efficient in fooling a target deep cross-modal hashing network.
no code implementations • CVPR 2019 • Erkun Yang, Tongliang Liu, Cheng Deng, Wei Liu, DaCheng Tao
To address this issue, we propose a novel deep unsupervised hashing model, dubbed DistillHash, which can learn a distilled data set consisted of data pairs, which have confidence similarity signals.
no code implementations • 7 May 2019 • Xinxun Xu, Hao Wang, Leida Li, Cheng Deng
Zero-shot sketch-based image retrieval (ZS-SBIR) is a specific cross-modal retrieval task for retrieving natural images with free-hand sketches under zero-shot scenario.
no code implementations • CVPR 2019 • Xu Yang, Cheng Deng, Feng Zheng, Junchi Yan, Wei Liu
In this paper, we propose a joint learning framework for discriminative embedding and spectral clustering.
no code implementations • 18 Apr 2019 • Xianglong Liu, Lei Huang, Cheng Deng, Bo Lang, DaCheng Tao
For each hash table, a query-adaptive bitwise weighting is introduced to alleviate the quantization loss by simultaneously exploiting the quality of hash functions and their complement for nearest neighbor search.
no code implementations • 16 Apr 2019 • Erkun Yang, Cheng Deng, Chao Li, Wei Liu, Jie Li, DaCheng Tao
In this paper, we propose a deep quantization approach, which is among the early attempts of leveraging deep neural networks into quantization-based cross-modal similarity search.
no code implementations • 10 Apr 2019 • Cheng Deng, Xianglong Liu, Chao Li, DaCheng Tao
Recent years have witnessed the quick progress of the hyperspectral images (HSI) classification.
no code implementations • 4 Apr 2019 • Cheng Deng, Zhaojia Chen, Xianglong Liu, Xinbo Gao, DaCheng Tao
Given the benefits of its low storage requirements and high retrieval efficiency, hashing has recently received increasing attention.
no code implementations • 4 Apr 2019 • Cheng Deng, Zhao Li, Xinbo Gao, DaCheng Tao
In this area, extracting effective statistical characteristics from a JPEG image for classification remains a challenge.
no code implementations • 4 Apr 2019 • Cheng Deng, Yumeng Xue, Xianglong Liu, Chao Li, DaCheng Tao
The advantages of our proposed method are threefold: 1) the network can be effectively trained using only limited labeled samples with the help of novel active learning strategies; 2) the network is flexible and scalable enough to function across various transfer situations, including cross-dataset and intra-image; 3) the learned deep joint spectral-spatial feature representation is more generic and robust than many joint spectral-spatial feature representation.
no code implementations • 3 Apr 2019 • Hao Wang, Cheng Deng, Xinxu Xu, Wei Liu, Xinbo Gao, DaCheng Tao
Previous works mostly focus on a generative approach that takes a highly abstract and sparse sketch as input and then synthesizes the corresponding natural image.
no code implementations • 6 Mar 2019 • De Xie, Cheng Deng, Hao Wang, Chao Li, Dapeng Tao
Two-stream architecture have shown strong performance in video classification task.
no code implementations • 6 Mar 2019 • Chao Li, Cheng Deng, Lei Wang, De Xie, Xianglong Liu
In recent years, hashing has attracted more and more attention owing to its superior capacity of low storage cost and high query efficiency in large-scale cross-modal retrieval.
no code implementations • 17 Feb 2019 • De Xie, Muli Yang, Cheng Deng, Wei Liu, DaCheng Tao
Image attribute transfer aims to change an input image to a target one with expected attributes, which has received significant attention in recent years.
1 code implementation • 23 Jan 2019 • Shaohui Lin, Rongrong Ji, Yuchao Li, Cheng Deng, Xuelong. Li
In this paper, we propose a novel filter pruning scheme, termed structured sparsity regularization (SSR), to simultaneously speedup the computation and reduce the memory overhead of CNNs, which can be well supported by various off-the-shelf deep learning libraries.
1 code implementation • CVPR 2019 • Jie Hu, Rongrong Ji, Hong Liu, Shengchuan Zhang, Cheng Deng, Qi Tian
In this paper, we make the first attempt towards visual feature translation to break through the barrier of using features across different visual search systems.
no code implementations • NeurIPS 2018 • Jie Xu, Lei Luo, Cheng Deng, Heng Huang
Metric learning, aiming to learn a discriminative Mahalanobis distance matrix M that can effectively reflect the similarity between data samples, has been widely studied in various image recognition problems.
1 code implementation • CVPR 2019 • Feng Zheng, Cheng Deng, Xing Sun, Xinyang Jiang, Xiaowei Guo, Zongqiao Yu, Feiyue Huang, Rongrong Ji
Most existing Re-IDentification (Re-ID) methods are highly dependent on precise bounding boxes that enable images to be aligned with each other.
Ranked #2 on
Person Re-Identification
on CUHK03-C
no code implementations • ICML 2018 • Bin Gu, Zhouyuan Huo, Cheng Deng, Heng Huang
Asynchronous parallel stochastic gradient optimization has been playing a pivotal role to solve large-scale machine learning problems in big data applications.
no code implementations • CVPR 2018 • Kamran Ghasedi Dizaji, Feng Zheng, Najmeh Sadoughi, Yanhua Yang, Cheng Deng, Heng Huang
HashGAN consists of three networks, a generator, a discriminator and an encoder.
no code implementations • CVPR 2018 • Xin Miao, Xian-Tong Zhen, Xianglong Liu, Cheng Deng, Vassilis Athitsos, Heng Huang
In this paper, we propose the direct shape regression network (DSRN) for end-to-end face alignment by jointly handling the aforementioned challenges in a unified framework.
Ranked #13 on
Face Alignment
on AFLW-19
no code implementations • 28 May 2018 • Xiao Liu, Shengchuan Zhang, Hong Liu, Xin Liu, Cheng Deng, Rongrong Ji
In principle, CerfGAN contains a novel component, i. e., a multi-class discriminator (MCD), which gives the model an extremely powerful ability to match multiple translation mappings.
1 code implementation • IJCAI2018 2018 • Erkun Yang, Cheng Deng, Tongliang Liu, Wei Liu, DaCheng Tao
Hashing is becoming increasingly popular for approximate nearest neighbor searching in massive databases due to its storage and search efficiency.
1 code implementation • CVPR 2018 • Chao Li, Cheng Deng, Ning li, Wei Liu, Xinbo Gao, DaCheng Tao
In addition, we harness a self-supervised semantic network to discover high-level semantic information in the form of multi-label annotations.
no code implementations • NeurIPS 2017 • Feiping Nie, Xiaoqian Wang, Cheng Deng, Heng Huang
In graph based co-clustering methods, a bipartite graph is constructed to depict the relation between features and samples.
no code implementations • NeurIPS 2017 • Hong Chen, Xiaoqian Wang, Cheng Deng, Heng Huang
Among them, learning models with grouped variables have shown competitive performance for prediction and variable selection.
1 code implementation • ICCV 2017 • Kamran Ghasedi Dizaji, Amirhossein Herandi, Cheng Deng, Weidong Cai, Heng Huang
We define a clustering objective function using relative entropy (KL divergence) minimization, regularized by a prior for the frequency of cluster assignments.
Ranked #1 on
Image Clustering
on FRGC
no code implementations • CVPR 2016 • Xianglong Liu, Xinjie Fan, Cheng Deng, Zhujin Li, Hao Su, DaCheng Tao
Despite its successful progress in classic point-to-point search, there are few studies regarding point-to-hyperplane search, which has strong practical capabilities of scaling up in many applications like active learning with SVMs.
no code implementations • ICCV 2015 • Xianglong Liu, Lei Huang, Cheng Deng, Jiwen Lu, Bo Lang
have enjoyed the benefits of complementary hash tables and information fusion over multiple views.
no code implementations • 5 Sep 2015 • Wenhao Jiang, Cheng Deng, Wei Liu, Feiping Nie, Fu-Lai Chung, Heng Huang
Domain adaptation problems arise in a variety of applications, where a training dataset from the \textit{source} domain and a test dataset from the \textit{target} domain typically follow different distributions.
no code implementations • CVPR 2014 • Xianglong Liu, Junfeng He, Cheng Deng, Bo Lang
Hashing technique has become a promising approach for fast similarity search.