no code implementations • 12 May 2022 • KaiXuan Chen, Shunyu Liu, Na Yu, Rong Yan, Quan Zhang, Jie Song, Zunlei Feng, Mingli Song
As the topology of the power system is in the form of graph structure, graph neural network based representation learning is naturally suitable for learning the status of the power system.
1 code implementation • 5 May 2022 • Jie Song, Ying Chen, Jingwen Ye, Mingli Song
Knowledge distillation (KD) has become a well established paradigm for compressing deep neural networks.
no code implementations • 25 Apr 2022 • Jie Song, Meiyu Liang, Zhe Xue, Feifei Kou, Ang Li
There is a complex correlation among the data of scientific papers.
no code implementations • 31 Mar 2022 • Jie Song, Meiyu Liang, Zhe Xue, Junping Du, Kou Feifei
in the heterogeneous graph of scientific papers.
1 code implementation • 22 Mar 2022 • Zipeng Zhong, Jie Song, Zunlei Feng, Tiantao Liu, Lingxiang Jia, Shaolun Yao, Min Wu, Tingjun Hou, Mingli Song
Chemical reaction prediction, involving forward synthesis and retrosynthesis prediction, is a fundamental problem in organic synthesis.
1 code implementation • 22 Mar 2022 • Mengqi Xue, Haofei Zhang, Jie Song, Mingli Song
Continual learning is a longstanding research topic due to its crucial role in tackling continually arriving tasks.
no code implementations • 7 Mar 2022 • Haofei Zhang, Feng Mao, Mengqi Xue, Gongfan Fang, Zunlei Feng, Jie Song, Mingli Song
Moreover, the transformer-based students excel in learning amalgamated knowledge, as they have mastered heterogeneous detection tasks rapidly and achieved superior or at least comparable performance to those of the teachers in their specializations.
no code implementations • 3 Mar 2022 • Zijian Dong, Chen Guo, Jie Song, Xu Chen, Andreas Geiger, Otmar Hilliges
We present a novel method to learn Personalized Implicit Neural Avatars (PINA) from a short RGB-D sequence.
no code implementations • 17 Jan 2022 • Jie Song, Huawei Yi, Wenqian Xu, Xiaohui Li, Bo Li, Yuanyuan Liu
The proposal of perceptual loss solves the problem that per-pixel difference loss function causes the reconstructed image to be overly-smooth, which acquires a significant progress in the field of single image super-resolution reconstruction.
no code implementations • 11 Jan 2022 • Xu Chen, Tianjian Jiang, Jie Song, Jinlong Yang, Michael J. Black, Andreas Geiger, Otmar Hilliges
Furthermore, we show that our method can be used on the task of fitting human models to raw scans, outperforming the previous state-of-the-art.
1 code implementation • 12 Dec 2021 • Gongfan Fang, Kanya Mo, Xinchao Wang, Jie Song, Shitao Bei, Haofei Zhang, Mingli Song
At the heart of our approach is a novel strategy to reuse the shared common features in training data so as to synthesize different data instances.
no code implementations • 11 Dec 2021 • Yeye He, Jie Song, Yue Wang, Surajit Chaudhuri, Vishal Anil, Blake Lassiter, Yaron Goland, Gaurav Malhotra
As data lakes become increasingly popular in large enterprises today, there is a growing need to tag or classify data assets (e. g., files and databases) in data lakes with additional metadata (e. g., semantic column-types), as the inferred metadata can enable a range of downstream applications like data governance (e. g., GDPR compliance), and dataset search.
no code implementations • 9 Dec 2021 • Zunlei Feng, Jiacong Hu, Sai Wu, Xiaotian Yu, Jie Song, Mingli Song
The aggregate gradient strategy is a versatile module for mainstream CNN classifiers.
1 code implementation • 7 Dec 2021 • Haofei Zhang, Jiarui Duan, Mengqi Xue, Jie Song, Li Sun, Mingli Song
Recently, vision Transformers (ViTs) are developing rapidly and starting to challenge the domination of convolutional neural networks (CNNs) in the realm of computer vision (CV).
no code implementations • 6 Dec 2021 • Qihan Huang, Haofei Zhang, Mengqi Xue, Jie Song, Mingli Song
Although few-shot learning and zero-shot learning have been extensively explored in the field of image classification, it is indispensable to design new methods for object detection in the data-scarce scenario since object detection has an additional challenging localization task.
no code implementations • 5 Dec 2021 • Jingwen Ye, Yining Mao, Jie Song, Xinchao Wang, Cheng Jin, Mingli Song
In other words, all users may employ a model in SDB for inference, but only authorized users get access to KD from the model.
no code implementations • 1 Dec 2021 • Sammy Christen, Muhammed Kocabas, Emre Aksan, Jemin Hwangbo, Jie Song, Otmar Hilliges
We introduce the dynamic grasp synthesis task: given an object with a known 6D pose and a grasp reference, our goal is to generate motions that move the object to a target 6D pose.
no code implementations • 29 Nov 2021 • Chen Guo, Xu Chen, Jie Song, Otmar Hilliges
In this work, we propose a method capable of capturing the dynamic 3D human shape from a monocular video featuring challenging body poses, without any additional input.
no code implementations • 1 Nov 2021 • Hsuan-I Ho, Xu Chen, Jie Song, Otmar Hilliges
We propose to address these issues in a motion-guided frame-upsampling framework that is capable of producing realistic human motion and appearance.
1 code implementation • NeurIPS 2021 • Gongfan Fang, Yifan Bao, Jie Song, Xinchao Wang, Donglin Xie, Chengchao Shen, Mingli Song
Knowledge distillation~(KD) aims to craft a compact student model that imitates the behavior of a pre-trained teacher in a target domain.
no code implementations • ICCV 2021 • Zijian Dong, Jie Song, Xu Chen, Chen Guo, Otmar Hilliges
In this paper we contribute a simple yet effective approach for estimating 3D poses of multiple people from multi-view images.
no code implementations • 29 Sep 2021 • KaiXuan Chen, Jie Song, Shunyu Liu, Na Yu, Zunlei Feng, Gengshi Han, Mingli Song
A DKEPool network de facto disassembles representation learning into two stages, structure learning and distribution learning.
no code implementations • CVPR 2021 • Jie Song, Haofei Zhang, Xinchao Wang, Mengqi Xue, Ying Chen, Li Sun, DaCheng Tao, Mingli Song
Knowledge distillation pursues a diminutive yet well-behaved student network by harnessing the knowledge learned by a cumbersome teacher model.
1 code implementation • 18 May 2021 • Gongfan Fang, Jie Song, Xinchao Wang, Chengchao Shen, Xingen Wang, Mingli Song
In this paper, we propose Contrastive Model Inversion~(CMI), where the data diversity is explicitly modeled as an optimizable objective, to alleviate the mode collapse issue.
no code implementations • 10 May 2021 • Mengqi Xue, Jie Song, Xinchao Wang, Ying Chen, Xingen Wang, Mingli Song
Knowledge distillation (KD) has recently emerged as an efficacious scheme for learning compact deep neural networks (DNNs).
no code implementations • 10 Apr 2021 • Jie Song, Yeye He
Complex data pipelines are increasingly common in diverse applications such as BI reporting and ML modeling.
no code implementations • 15 Mar 2021 • Yang Liu, Tu Zheng, Jie Song, Deng Cai, Xiaofei He
In this paper, we argue that a Mutual Nearest Neighbor (MNN) relation should be established to explicitly select the query descriptors that are most relevant to each task and discard less relevant ones from aggregative clutters in FSL.
no code implementations • 5 Mar 2021 • Yonghong Luo, Chao Lu, Lipeng Zhu, Jie Song
The proposed STGCN utilizes graph convolution to integrate network topology information into the learning model to exploit spatial information.
1 code implementation • CVPR 2021 • Chengchao Shen, Youtan Yin, Xinchao Wang, Xubin Li, Jie Song, Mingli Song
Based on the adversarial losses of the generator and discriminator, we categorize GANs into two classes, Symmetric GANs and Asymmetric GANs, and introduce a novel gradient decomposition method to unify the two, allowing us to train both classes in one stage and hence alleviate the training effort.
1 code implementation • ICCV 2021 • Manuel Kaufmann, Yi Zhao, Chengcheng Tang, Lingling Tao, Christopher Twigg, Jie Song, Robert Wang, Otmar Hilliges
To this end, we present a method to estimate SMPL parameters from 6-12 EM sensors.
no code implementations • ICCV 2021 • Ying Chen, Feng Mao, Jie Song, Xinchao Wang, Huiqiong Wang, Mingli Song
Neural trees aim at integrating deep neural networks and decision trees so as to bring the best of the two worlds, including representation learning from the former and faster inference from the latter.
1 code implementation • 9 Dec 2020 • Chengchao Shen, Xinchao Wang, Youtan Yin, Jie Song, Sihui Luo, Mingli Song
In this paper, we investigate the practical few-shot knowledge distillation scenario, where we assume only a few samples without human annotations are available for each category.
1 code implementation • 22 Oct 2020 • Manuel Kaufmann, Emre Aksan, Jie Song, Fabrizio Pece, Remo Ziegler, Otmar Hilliges
At the heart of our approach lies the idea to cast motion infilling as an inpainting problem and to train a convolutional de-noising autoencoder on image-like representations of motion sequences.
no code implementations • ECCV 2020 • Jie Song, Xu Chen, Otmar Hilliges
We propose a novel algorithm for the fitting of 3D human shape to images.
no code implementations • ECCV 2020 • Xu Chen, Zijian Dong, Jie Song, Andreas Geiger, Otmar Hilliges
Many object pose estimation algorithms rely on the analysis-by-synthesis framework which requires explicit representations of individual object instances.
no code implementations • 13 Aug 2020 • Jie Song, Liang Xiao, Mohsen Molaei, Zhichao Lian
In this way, rich image appearance models together with more contextual information are integrated by learning a series of decision tree ensembles.
no code implementations • 10 Jul 2020 • Gongfan Fang, Xinchao Wang, Haofei Zhang, Jie Song, Mingli Song
This network is referred to as the {\emph{Template Network}} because its filters will be used as templates to reconstruct images from the impression.
1 code implementation • CVPR 2020 • Jie Song, Yixin Chen, Jingwen Ye, Xinchao Wang, Chengchao Shen, Feng Mao, Mingli Song
In this paper, we propose the DEeP Attribution gRAph (DEPARA) to investigate the transferability of knowledge learned from PR-DNNs.
2 code implementations • 23 Dec 2019 • Gongfan Fang, Jie Song, Chengchao Shen, Xinchao Wang, Da Chen, Mingli Song
Knowledge Distillation (KD) has made remarkable progress in the last few years and become a popular paradigm for model compression and knowledge transfer.
1 code implementation • NeurIPS 2019 • Jie Song, Yixin Chen, Xinchao Wang, Chengchao Shen, Mingli Song
Exploring the transferability between heterogeneous tasks sheds light on their intrinsic interconnections, and consequently enables knowledge transfer from one task to another so as to reduce the training effort of the latter.
1 code implementation • ICCV 2019 • Chengchao Shen, Mengqi Xue, Xinchao Wang, Jie Song, Li Sun, Mingli Song
To this end, we introduce a dual-step strategy that first extracts the task-specific knowledge from the heterogeneous teachers sharing the same sub-task, and then amalgamates the extracted knowledge to build the student network.
no code implementations • 20 Aug 2019 • Gang Hu, Lingbo Liu, DaCheng Tao, Jie Song, K. C. S. Kwok
This study used machine learning techniques to resolve the conflicting requirement between limited wind tunnel tests that produce unreliable results and a completed investigation of the interference effects that is costly and time-consuming.
1 code implementation • 8 Jan 2019 • Xu Chen, Jie Song, Otmar Hilliges
This paper studies the task of full generative modelling of realistic images of humans, guided only by coarse sketch of the pose, while providing control over the specific instance or type of outfit worn by the user.
2 code implementations • ICCV 2019 • Xu Chen, Jie Song, Otmar Hilliges
The approach is self-supervised and only requires 2D images and associated view transforms for training.
no code implementations • ICCV 2019 • Jie Song, Bjoern Andres, Michael Black, Otmar Hilliges, Siyu Tang
The new optimization problem can be viewed as a Conditional Random Field (CRF) in which the random variables are associated with the binary edge labels of the initial graph and the hard constraints are introduced in the CRF as high-order potentials.
1 code implementation • 7 Nov 2018 • Chengchao Shen, Xinchao Wang, Jie Song, Li Sun, Mingli Song
We propose in this paper to study a new model-reusing task, which we term as \emph{knowledge amalgamation}.
no code implementations • ECCV 2018 • Jie Song, Chengchao Shen, Jie Lei, An-Xiang Zeng, Kairi Ou, DaCheng Tao, Mingli Song
We propose a selective zero-shot classifier based on both the human defined and the automatically discovered residual attributes.
no code implementations • CVPR 2018 • Jie Song, Chengchao Shen, Yezhou Yang, Yang Liu, Mingli Song
Most existing Zero-Shot Learning (ZSL) methods have the strong bias problem, in which instances of unseen (target) classes tend to be categorized as one of the seen (source) classes.
1 code implementation • CVPR 2018 • Adrian Spurr, Jie Song, Seonwook Park, Otmar Hilliges
Furthermore, we show that our proposed method can be used without changes on depth images and performs comparably to specialized methods.
no code implementations • 10 Apr 2017 • Partha Ghosh, Jie Song, Emre Aksan, Otmar Hilliges
Furthermore, we propose new evaluation protocols to assess the quality of synthetic motion sequences even for which no ground truth data exists.
no code implementations • CVPR 2017 • Jie Song, Li-Min Wang, Luc van Gool, Otmar Hilliges
Temporal information can provide additional cues about the location of body joints and help to alleviate these issues.
Ranked #4 on
Pose Estimation
on UPenn Action