Search Results for author: Yang song

Found 116 papers, 62 papers with code

Improved Word Sense Disambiguation with Enhanced Sense Representations

1 code implementation Findings (EMNLP) 2021 Yang song, Xin Cai Ong, Hwee Tou Ng, Qian Lin

Current state-of-the-art supervised word sense disambiguation (WSD) systems (such as GlossBERT and bi-encoder model) yield surprisingly good results by purely leveraging pre-trained language models and short dictionary definitions (or glosses) of the different word senses.

Word Sense Disambiguation

When Multi-Level Meets Multi-Interest: A Multi-Grained Neural Model for Sequential Recommendation

1 code implementation3 May 2022 Yu Tian, Jianxin Chang, Yannan Niu, Yang song, Chenliang Li

Specifically, multi-interest methods such as ComiRec and MIMN, focus on extracting different interests for a user by performing historical item clustering, while graph convolution methods including TGSRec and SURGE elect to refine user preferences based on multi-level correlations between historical items.

Sequential Recommendation

DFC: Anatomically Informed Fiber Clustering with Self-supervised Deep Learning for Fast and Effective Tractography Parcellation

1 code implementation2 May 2022 Yuqian Chen, Chaoyi Zhang, Tengfei Xue, Yang song, Nikos Makris, Yogesh Rathi, Weidong Cai, Fan Zhang, Lauren J. O'Donnell

In this work, we propose a novel deep learning framework for WMFC, Deep Fiber Clustering (DFC), which solves the unsupervised clustering problem as a self-supervised learning task with a domain-specific pretext task to predict pairwise fiber distances.

Representation Learning Self-Supervised Learning

Computer-Aided Extraction of Select MRI Markers of Cerebral Small Vessel Disease: A Systematic Review

no code implementations4 Apr 2022 Jiyang Jiang, Dadong Wang, Yang song, Perminder S. Sachdev, Wei Wen

Cerebral small vessel disease (CSVD) is a major vascular contributor to cognitive impairment in ageing, including dementias.

Transfer Learning

Leveraging Search History for Improving Person-Job Fit

no code implementations27 Mar 2022 Yupeng Hou, Xingyu Pan, Wayne Xin Zhao, Shuqing Bian, Yang song, Tao Zhang, Ji-Rong Wen

As the core technique of online recruitment platforms, person-job fit can improve hiring efficiency by accurately matching job positions with qualified candidates.

Text Matching

Explainability in Graph Neural Networks: An Experimental Survey

no code implementations17 Mar 2022 Peibo Li, Yixing Yang, Maurice Pagnucco, Yang song

Graph neural networks (GNNs) have been extensively developed for graph representation learning in various application domains.

Graph Representation Learning

Towards Bi-directional Skip Connections in Encoder-Decoder Architectures and Beyond

no code implementations11 Mar 2022 Tiange Xiang, Chaoyi Zhang, Xinyi Wang, Yang song, Dongnan Liu, Heng Huang, Weidong Cai

With the backward skip connections, we propose a U-Net based network family, namely Bi-directional O-shape networks, which set new benchmarks on multiple public medical imaging segmentation datasets.

Medical Image Segmentation Neural Architecture Search

GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generation

1 code implementation ICLR 2022 Minkai Xu, Lantao Yu, Yang song, Chence Shi, Stefano Ermon, Jian Tang

GeoDiff treats each atom as a particle and learns to directly reverse the diffusion process (i. e., transforming from a noise distribution to stable conformations) as a Markov chain.

Drug Discovery

StrongSORT: Make DeepSORT Great Again

1 code implementation28 Feb 2022 Yunhao Du, Yang song, Bo Yang, Yanyun Zhao

By integrating StrongSORT with the two algorithms, the final tracker StrongSORT++ ranks first on MOT17 and MOT20 in terms of HOTA and IDF1 metrics and surpasses the second-place one by 1. 3 - 2. 2.

Ranked #2 on Multi-Object Tracking on MOT17 (using extra training data)

Multi-Object Tracking

A Model-Agnostic Causal Learning Framework for Recommendation using Search Data

1 code implementation9 Feb 2022 Zihua Si, Xueran Han, Xiao Zhang, Jun Xu, Yue Yin, Yang song, Ji-Rong Wen

In this paper, we propose a model-agnostic framework named IV4Rec that can effectively decompose the embedding vectors into these two parts, hence enhancing recommendation results.

Recommendation Systems

SupWMA: Consistent and Efficient Tractography Parcellation of Superficial White Matter with Deep Learning

1 code implementation29 Jan 2022 Tengfei Xue, Fan Zhang, Chaoyi Zhang, Yuqian Chen, Yang song, Nikos Makris, Yogesh Rathi, Weidong Cai, Lauren J. O'Donnell

Most parcellation methods focus on the deep white matter (DWM), while fewer methods address the superficial white matter (SWM) due to its complexity.

Contrastive Learning

Decompose to Adapt: Cross-domain Object Detection via Feature Disentanglement

1 code implementation6 Jan 2022 Dongnan Liu, Chaoyi Zhang, Yang song, Heng Huang, Chenyu Wang, Michael Barnett, Weidong Cai

Recent advances in unsupervised domain adaptation (UDA) techniques have witnessed great success in cross-domain computer vision tasks, enhancing the generalization ability of data-driven deep learning architectures by bridging the domain distribution gaps.

Disentanglement Object Detection +1

Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Driving

no code implementations22 Dec 2021 Jingxiao Zheng, Xinwei Shi, Alexander Gorban, Junhua Mao, Yang song, Charles R. Qi, Ting Liu, Visesh Chari, Andre Cornman, Yin Zhou, CongCong Li, Dragomir Anguelov

3D human pose estimation (HPE) in autonomous vehicles (AV) differs from other use cases in many factors, including the 3D resolution and range of data, absence of dense depth maps, failure modes for LiDAR, relative location between the camera and LiDAR, and a high bar for estimation accuracy.

3D Human Pose Estimation Autonomous Driving

Density Ratio Estimation via Infinitesimal Classification

1 code implementation22 Nov 2021 Kristy Choi, Chenlin Meng, Yang song, Stefano Ermon

We then estimate the instantaneous rate of change of the bridge distributions indexed by time (the "time score") -- a quantity defined analogously to data (Stein) scores -- with a novel time score matching objective.

Classification Density Ratio Estimation +1

Solving Inverse Problems in Medical Imaging with Score-Based Generative Models

no code implementations NeurIPS Workshop Deep_Invers 2021 Yang song, Liyue Shen, Lei Xing, Stefano Ermon

These measurements are typically synthesized from images using a fixed physical model of the measurement process, which hinders the generalization capability of models to unknown measurement processes.

Computed Tomography (CT)

Estimating High Order Gradients of the Data Distribution by Denoising

no code implementations NeurIPS 2021 Chenlin Meng, Yang song, Wenzhe Li, Stefano Ermon

By leveraging Tweedie's formula on higher order moments, we generalize denoising score matching to estimate higher order derivatives.

Denoising Image Generation

Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks

2 code implementations NeurIPS 2021 Qiyu Kang, Yang song, Qinxu Ding, Wee Peng Tay

By ensuring that the equilibrium points of the ODE solution used as part of SODEF is Lyapunov-stable, the ODE solution for an input with a small perturbation converges to the same solution as the unperturbed input.

Score-Based Generative Classifiers

no code implementations1 Oct 2021 Roland S. Zimmermann, Lukas Schott, Yang song, Benjamin A. Dunn, David A. Klindt

In this work, we investigate score-based generative models as classifiers for natural images.

Classification

Concept-Aware Denoising Graph Neural Network for Micro-Video Recommendation

no code implementations28 Sep 2021 Yiyu Liu, Qian Liu, Yu Tian, Changping Wang, Yanan Niu, Yang song, Chenliang Li

In this paper, we propose a novel concept-aware denoising graph neural network (named CONDE) for micro-video recommendation.

Denoising Recommendation Systems

DSNet: A Dual-Stream Framework for Weakly-Supervised Gigapixel Pathology Image Analysis

no code implementations13 Sep 2021 Tiange Xiang, Yang song, Chaoyi Zhang, Dongnan Liu, Mei Chen, Fan Zhang, Heng Huang, Lauren O'Donnell, Weidong Cai

With image-level labels only, patch-wise classification would be sub-optimal due to inconsistency between the patch appearance and image-level label.

Classification whole slide images

Voxel-wise Cross-Volume Representation Learning for 3D Neuron Reconstruction

no code implementations14 Aug 2021 Heng Wang, Chaoyi Zhang, Jianhui Yu, Yang song, SiQi Liu, Wojciech Chrzanowski, Weidong Cai

Recently, a series of deep learning based segmentation methods have been proposed to improve the quality of raw 3D optical image stacks by removing noises and restoring neuronal structures from low-contrast background.

Representation Learning

Discriminative Latent Semantic Graph for Video Captioning

1 code implementation8 Aug 2021 Yang Bai, Junyan Wang, Yang Long, Bingzhang Hu, Yang song, Maurice Pagnucco, Yu Guan

Video captioning aims to automatically generate natural language sentences that can describe the visual contents of a given video.

Frame Video Captioning +1

SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations

1 code implementation ICLR 2022 Chenlin Meng, Yutong He, Yang song, Jiaming Song, Jiajun Wu, Jun-Yan Zhu, Stefano Ermon

The key challenge is balancing faithfulness to the user input (e. g., hand-drawn colored strokes) and realism of the synthesized image.

Denoising Image Generation

Deep Fiber Clustering: Anatomically Informed Unsupervised Deep Learning for Fast and Effective White Matter Parcellation

no code implementations11 Jul 2021 Yuqian Chen, Chaoyi Zhang, Yang song, Nikos Makris, Yogesh Rathi, Weidong Cai, Fan Zhang, Lauren J. O'Donnell

White matter fiber clustering (WMFC) enables parcellation of white matter tractography for applications such as disease classification and anatomical tract segmentation.

Self-Supervised Learning

CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation

1 code implementation NeurIPS 2021 Yusuke Tashiro, Jiaming Song, Yang song, Stefano Ermon

In this paper, we propose Conditional Score-based Diffusion models for Imputation (CSDI), a novel time series imputation method that utilizes score-based diffusion models conditioned on observed data.

Image Generation Imputation +1

PhotoChat: A Human-Human Dialogue Dataset with Photo Sharing Behavior for Joint Image-Text Modeling

no code implementations ACL 2021 Xiaoxue Zang, Lijuan Liu, Maria Wang, Yang song, Hao Zhang, Jindong Chen

Based on this dataset, we propose two tasks to facilitate research on image-text modeling: a photo-sharing intent prediction task that predicts whether one intends to share a photo in the next conversation turn, and a photo retrieval task that retrieves the most relevant photo according to the dialogue context.

Image Retrieval

Sequential Recommendation with Graph Neural Networks

1 code implementation27 Jun 2021 Jianxin Chang, Chen Gao, Yu Zheng, Yiqun Hui, Yanan Niu, Yang song, Depeng Jin, Yong Li

This helps explicitly distinguish users' core interests, by forming dense clusters in the interest graph.

Metric Learning Sequential Recommendation

BiX-NAS: Searching Efficient Bi-directional Architecture for Medical Image Segmentation

1 code implementation26 Jun 2021 Xinyi Wang, Tiange Xiang, Chaoyi Zhang, Yang song, Dongnan Liu, Heng Huang, Weidong Cai

We evaluate BiX-NAS on two segmentation tasks using three different medical image datasets, and the experimental results show that our BiX-NAS searched architecture achieves the state-of-the-art performance with significantly lower computational cost.

Medical Image Segmentation Neural Architecture Search +1

Partial Graph Reasoning for Neural Network Regularization

1 code implementation3 Jun 2021 Tiange Xiang, Chaoyi Zhang, Yang song, SiQi Liu, Hongliang Yuan, Weidong Cai

This add-on graph regularizes the network during training and can be completely skipped during inference.

Anytime Sampling for Autoregressive Models via Ordered Autoencoding

1 code implementation ICLR 2021 Yilun Xu, Yang song, Sahaj Garg, Linyuan Gong, Rui Shu, Aditya Grover, Stefano Ermon

Experimentally, we demonstrate in several image and audio generation tasks that sample quality degrades gracefully as we reduce the computational budget for sampling.

Audio Generation

Maximum Likelihood Training of Score-Based Diffusion Models

2 code implementations NeurIPS 2021 Yang song, Conor Durkan, Iain Murray, Stefano Ermon

Score-based diffusion models synthesize samples by reversing a stochastic process that diffuses data to noise, and are trained by minimizing a weighted combination of score matching losses.

Ranked #5 on Image Generation on ImageNet 32x32 (bpd metric)

Data Augmentation Image Generation

Single Neuron Segmentation using Graph-based Global Reasoning with Auxiliary Skeleton Loss from 3D Optical Microscope Images

no code implementations22 Jan 2021 Heng Wang, Yang song, Chaoyi Zhang, Jianhui Yu, SiQi Liu, Hanchuan Peng, Weidong Cai

One of the critical steps in improving accurate single neuron reconstruction from three-dimensional (3D) optical microscope images is the neuronal structure segmentation.

How to Train Your Energy-Based Models

2 code implementations9 Jan 2021 Yang song, Diederik P. Kingma

Energy-Based Models (EBMs), also known as non-normalized probabilistic models, specify probability density or mass functions up to an unknown normalizing constant.

Understanding Classifiers with Generative Models

no code implementations1 Jan 2021 Laëtitia Shao, Yang song, Stefano Ermon

Although deep neural networks are effective on supervised learning tasks, they have been shown to be brittle.

Two-sample testing

Fast WordPiece Tokenization

no code implementations EMNLP 2021 Xinying Song, Alex Salcianu, Yang song, Dave Dopson, Denny Zhou

For general text, we further propose an algorithm that combines pre-tokenization (splitting the text into words) and our linear-time WordPiece method into a single pass.

Learning Energy-Based Models by Diffusion Recovery Likelihood

1 code implementation ICLR 2021 Ruiqi Gao, Yang song, Ben Poole, Ying Nian Wu, Diederik P. Kingma

Inspired by recent progress on diffusion probabilistic models, we present a diffusion recovery likelihood method to tractably learn and sample from a sequence of EBMs trained on increasingly noisy versions of a dataset.

Image Generation

Score-Based Generative Modeling through Stochastic Differential Equations

6 code implementations ICLR 2021 Yang song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar, Stefano Ermon, Ben Poole

Combined with multiple architectural improvements, we achieve record-breaking performance for unconditional image generation on CIFAR-10 with an Inception score of 9. 89 and FID of 2. 20, a competitive likelihood of 2. 99 bits/dim, and demonstrate high fidelity generation of 1024 x 1024 images for the first time from a score-based generative model.

Colorization Image Inpainting +1

Autoregressive Score Matching

no code implementations NeurIPS 2020 Chenlin Meng, Lantao Yu, Yang song, Jiaming Song, Stefano Ermon

To increase flexibility, we propose autoregressive conditional score models (AR-CSM) where we parameterize the joint distribution in terms of the derivatives of univariate log-conditionals (scores), which need not be normalized.

Density Estimation Image Denoising +1

Imitation with Neural Density Models

no code implementations NeurIPS 2021 Kuno Kim, Akshat Jindal, Yang song, Jiaming Song, Yanan Sui, Stefano Ermon

We propose a new framework for Imitation Learning (IL) via density estimation of the expert's occupancy measure followed by Maximum Occupancy Entropy Reinforcement Learning (RL) using the density as a reward.

Density Estimation Imitation Learning +1

Understanding Classifier Mistakes with Generative Models

no code implementations5 Oct 2020 Laëtitia Shao, Yang song, Stefano Ermon

From this observation, we develop a detection criteria for samples on which a classifier is likely to fail at test time.

Two-sample testing

Learning to Match Jobs with Resumes from Sparse Interaction Data using Multi-View Co-Teaching Network

no code implementations25 Sep 2020 Shuqing Bian, Xu Chen, Wayne Xin Zhao, Kun Zhou, Yupeng Hou, Yang song, Tao Zhang, Ji-Rong Wen

Compared with pure text-based matching models, the proposed approach is able to learn better data representations from limited or even sparse interaction data, which is more resistible to noise in training data.

Text Matching

PDAM: A Panoptic-Level Feature Alignment Framework for Unsupervised Domain Adaptive Instance Segmentation in Microscopy Images

1 code implementation11 Sep 2020 Dongnan Liu, Donghao Zhang, Yang song, Fan Zhang, Lauren O'Donnell, Heng Huang, Mei Chen, Weidong Cai

In this work, we present an unsupervised domain adaptation (UDA) method, named Panoptic Domain Adaptive Mask R-CNN (PDAM), for unsupervised instance segmentation in microscopy images.

Instance Segmentation Semantic Segmentation +1

Efficient Learning of Generative Models via Finite-Difference Score Matching

1 code implementation NeurIPS 2020 Tianyu Pang, Kun Xu, Chongxuan Li, Yang song, Stefano Ermon, Jun Zhu

Several machine learning applications involve the optimization of higher-order derivatives (e. g., gradients of gradients) during training, which can be expensive in respect to memory and computation even with automatic differentiation.

BiO-Net: Learning Recurrent Bi-directional Connections for Encoder-Decoder Architecture

1 code implementation1 Jul 2020 Tiange Xiang, Chaoyi Zhang, Dongnan Liu, Yang song, Heng Huang, Weidong Cai

U-Net has become one of the state-of-the-art deep learning-based approaches for modern computer vision tasks such as semantic segmentation, super resolution, image denoising, and inpainting.

Image Denoising Semantic Segmentation +1

Improved Techniques for Training Score-Based Generative Models

7 code implementations NeurIPS 2020 Yang Song, Stefano Ermon

Score-based generative models can produce high quality image samples comparable to GANs, without requiring adversarial optimization.

Image Generation

Gleason Score Prediction using Deep Learning in Tissue Microarray Image

no code implementations11 May 2020 Yi-Hong Zhang, Jing Zhang, Yang song, Chaomin Shen, Guang Yang

Prostate cancer (PCa) is one of the most common cancers in men around the world.

ICE-GAN: Identity-aware and Capsule-Enhanced GAN with Graph-based Reasoning for Micro-Expression Recognition and Synthesis

1 code implementation9 May 2020 Jianhui Yu, Chaoyi Zhang, Yang song, Weidong Cai

Micro-expressions are reflections of people's true feelings and motives, which attract an increasing number of researchers into the study of automatic facial micro-expression recognition.

Micro-Expression Recognition

Diversity can be Transferred: Output Diversification for White- and Black-box Attacks

1 code implementation NeurIPS 2020 Yusuke Tashiro, Yang song, Stefano Ermon

Adversarial attacks often involve random perturbations of the inputs drawn from uniform or Gaussian distributions, e. g., to initialize optimization-based white-box attacks or generate update directions in black-box attacks.

Training Deep Energy-Based Models with f-Divergence Minimization

1 code implementation ICML 2020 Lantao Yu, Yang song, Jiaming Song, Stefano Ermon

Experimental results demonstrate the superiority of f-EBM over contrastive divergence, as well as the benefits of training EBMs using f-divergences other than KL.

Gaussianization Flows

3 code implementations4 Mar 2020 Chenlin Meng, Yang song, Jiaming Song, Stefano Ermon

Iterative Gaussianization is a fixed-point iteration procedure that can transform any continuous random vector into a Gaussian one.

Permutation Invariant Graph Generation via Score-Based Generative Modeling

1 code implementation2 Mar 2020 Chenhao Niu, Yang song, Jiaming Song, Shengjia Zhao, Aditya Grover, Stefano Ermon

In particular, we design a permutation equivariant, multi-channel graph neural network to model the gradient of the data distribution at the input graph (a. k. a., the score function).

Graph Generation

Panoptic Feature Fusion Net: A Novel Instance Segmentation Paradigm for Biomedical and Biological Images

1 code implementation15 Feb 2020 Dongnan Liu, Donghao Zhang, Yang song, Heng Huang, Weidong Cai

Specifically, our proposed PFFNet contains a residual attention feature fusion mechanism to incorporate the instance prediction with the semantic features, in order to facilitate the semantic contextual information learning in the instance branch.

Instance Segmentation Medical Image Segmentation +1

Accelerating Feedforward Computation via Parallel Nonlinear Equation Solving

1 code implementation10 Feb 2020 Yang Song, Chenlin Meng, Renjie Liao, Stefano Ermon

Feedforward computation, such as evaluating a neural network or sampling from an autoregressive model, is ubiquitous in machine learning.

Frame

Region and Object based Panoptic Image Synthesis through Conditional GANs

no code implementations14 Dec 2019 Heng Wang, Donghao Zhang, Yang song, Heng Huang, Mei Chen, Weidong Cai

Our contribution consists of the proposal of a significant task worth investigating and a naive baseline of solving it.

Image-to-Image Translation Translation

Error-Correcting Output Codes with Ensemble Diversity for Robust Learning in Neural Networks

no code implementations30 Nov 2019 Yang Song, Qiyu Kang, Wee Peng Tay

Though deep learning has been applied successfully in many scenarios, malicious inputs with human-imperceptible perturbations can make it vulnerable in real applications.

Multi-class Classification

Domain Adaptation for Person-Job Fit with Transferable Deep Global Match Network

no code implementations IJCNLP 2019 Shuqing Bian, Wayne Xin Zhao, Yang song, Tao Zhang, Ji-Rong Wen

Furthermore, we extend the match network and implement domain adaptation in three levels, sentence-level representation, sentence-level match, and global match.

Domain Adaptation

Representation Learning with Ordered Relation Paths for Knowledge Graph Completion

1 code implementation IJCNLP 2019 Yao Zhu, Hongzhi Liu, Zhonghai Wu, Yang song, Tao Zhang

Recently, a few methods take relation paths into consideration but pay less attention to the order of relations in paths which is important for reasoning.

Ranked #3 on Link Prediction on FB15k (MR metric)

Knowledge Graph Completion Link Prediction +1

Extremely Small BERT Models from Mixed-Vocabulary Training

no code implementations EACL 2021 Sanqiang Zhao, Raghav Gupta, Yang song, Denny Zhou

Pretrained language models like BERT have achieved good results on NLP tasks, but are impractical on resource-limited devices due to memory footprint.

Knowledge Distillation Language Modelling +3

Towards Certified Defense for Unrestricted Adversarial Attacks

no code implementations25 Sep 2019 Shengjia Zhao, Yang song, Stefano Ermon

Our defense draws inspiration from differential privacy, and is based on intentionally adding noise to the classifier's outputs to limit the attacker's knowledge about the parameters.

Adversarial Attack

A General Data Renewal Model for Prediction Algorithms in Industrial Data Analytics

no code implementations22 Aug 2019 Hongzhi Wang, Yijie Yang, Yang song

In industrial data analytics, one of the fundamental problems is to utilize the temporal correlation of the industrial data to make timely predictions in the production process, such as fault prediction and yield prediction.

LSTM-based Flow Prediction

no code implementations9 Aug 2019 Hongzhi Wang, Yang song, Shihan Tang

In this paper, a method of prediction on continuous time series variables from the production or flow -- an LSTM algorithm based on multivariate tuning -- is proposed.

Time Series

MintNet: Building Invertible Neural Networks with Masked Convolutions

1 code implementation NeurIPS 2019 Yang Song, Chenlin Meng, Stefano Ermon

To demonstrate their flexibility, we show that our invertible neural networks are competitive with ResNets on MNIST and CIFAR-10 classification.

Image Generation

Generative Modeling by Estimating Gradients of the Data Distribution

10 code implementations NeurIPS 2019 Yang Song, Stefano Ermon

We introduce a new generative model where samples are produced via Langevin dynamics using gradients of the data distribution estimated with score matching.

Image Inpainting

Generating Long and Informative Reviews with Aspect-Aware Coarse-to-Fine Decoding

1 code implementation ACL 2019 Junyi Li, Wayne Xin Zhao, Ji-Rong Wen, Yang song

In this paper, we propose a novel review generation model by characterizing an elaborately designed aspect-aware coarse-to-fine generation process.

Review Generation Text Generation

Geo-Aware Networks for Fine-Grained Recognition

1 code implementation4 Jun 2019 Grace Chu, Brian Potetz, Weijun Wang, Andrew Howard, Yang song, Fernando Brucher, Thomas Leung, Hartwig Adam

By leveraging geolocation information we improve top-1 accuracy in iNaturalist from 70. 1% to 79. 0% for a strong baseline image-only model.

Fine-Grained Image Classification General Classification

Sliced Score Matching: A Scalable Approach to Density and Score Estimation

6 code implementations17 May 2019 Yang Song, Sahaj Garg, Jiaxin Shi, Stefano Ermon

However, it has been so far limited to simple, shallow models or low-dimensional data, due to the difficulty of computing the Hessian of log-density functions.

Variational Inference

Class-Balanced Loss Based on Effective Number of Samples

7 code implementations CVPR 2019 Yin Cui, Menglin Jia, Tsung-Yi Lin, Yang song, Serge Belongie

We design a re-weighting scheme that uses the effective number of samples for each class to re-balance the loss, thereby yielding a class-balanced loss.

Image Classification Long-tail Learning

Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning

1 code implementation3 Dec 2018 Zhibo Wang, Mengkai Song, Zhifei Zhang, Yang song, Qian Wang, Hairong Qi

Although the state-of-the-art attacking techniques that incorporated the advance of Generative adversarial networks (GANs) could construct class representatives of the global data distribution among all clients, it is still challenging to distinguishably attack a specific client (i. e., user-level privacy leakage), which is a stronger privacy threat to precisely recover the private data from a specific client.

Edge-computing Federated Learning

Learning to Recommend with Multiple Cascading Behaviors

no code implementations21 Sep 2018 Chen Gao, Xiangnan He, Dahua Gan, Xiangning Chen, Fuli Feng, Yong Li, Tat-Seng Chua, Lina Yao, Yang song, Depeng Jin

To fully exploit the signal in the data of multiple types of behaviors, we perform a joint optimization based on the multi-task learning framework, where the optimization on a behavior is treated as a task.

Multi-Task Learning Recommendation Systems

Deep Dual Pyramid Network for Barcode Segmentation using Barcode-30k Database

no code implementations31 Jul 2018 Qijie Zhao, Feng Ni, Yang song, Yongtao Wang, Zhi Tang

Specifically, a synthesizing method was proposed to generate well-annotated images containing barcode and QR code labels, which contributes to largely decrease the annotation time.

Semantic Segmentation

3D Global Convolutional Adversarial Network\\ for Prostate MR Volume Segmentation

no code implementations18 Jul 2018 Haozhe Jia, Yang song, Donghao Zhang, Heng Huang, Dagan Feng, Michael Fulham, Yong Xia, Weidong Cai

In this paper, we propose a 3D Global Convolutional Adversarial Network (3D GCA-Net) to address efficient prostate MR volume segmentation.

General Classification

Large Scale Fine-Grained Categorization and Domain-Specific Transfer Learning

1 code implementation CVPR 2018 Yin Cui, Yang song, Chen Sun, Andrew Howard, Serge Belongie

We propose a measure to estimate domain similarity via Earth Mover's Distance and demonstrate that transfer learning benefits from pre-training on a source domain that is similar to the target domain by this measure.

Fine-Grained Image Classification Fine-Grained Visual Categorization +1

Constructing Unrestricted Adversarial Examples with Generative Models

1 code implementation NeurIPS 2018 Yang Song, Rui Shu, Nate Kushman, Stefano Ermon

Then, conditioned on a desired class, we search over the AC-GAN latent space to find images that are likely under the generative model and are misclassified by a target classifier.

Talking Face Generation by Conditional Recurrent Adversarial Network

1 code implementation13 Apr 2018 Yang Song, Jingwen Zhu, Dawei Li, Xiaolong Wang, Hairong Qi

Given an arbitrary face image and an arbitrary speech clip, the proposed work attempts to generating the talking face video with accurate lip synchronization while maintaining smooth transition of both lip and facial movement over the entire video clip.

Constrained Lip-synchronization Video Generation

Accelerating Natural Gradient with Higher-Order Invariance

2 code implementations ICML 2018 Yang Song, Jiaming Song, Stefano Ermon

An appealing property of the natural gradient is that it is invariant to arbitrary differentiable reparameterizations of the model.

reinforcement-learning

Decoupled Learning for Conditional Adversarial Networks

1 code implementation21 Jan 2018 Zhifei Zhang, Yang song, Hairong Qi

Incorporating encoding-decoding nets with adversarial nets has been widely adopted in image generation tasks.

Image Generation

PixelDefend: Leveraging Generative Models to Understand and Defend against Adversarial Examples

1 code implementation ICLR 2018 Yang Song, Taesup Kim, Sebastian Nowozin, Stefano Ermon, Nate Kushman

Adversarial perturbations of normal images are usually imperceptible to humans, but they can seriously confuse state-of-the-art machine learning models.

Two-sample testing

Person Re-identification Using Visual Attention

no code implementations23 Jul 2017 Alireza Rahimpour, Liu Liu, Ali Taalimi, Yang song, Hairong Qi

Despite recent attempts for solving the person re-identification problem, it remains a challenging task since a person's appearance can vary significantly when large variations in view angle, human pose, and illumination are involved.

Person Re-Identification

The iNaturalist Species Classification and Detection Dataset

7 code implementations CVPR 2018 Grant Van Horn, Oisin Mac Aodha, Yang song, Yin Cui, Chen Sun, Alex Shepard, Hartwig Adam, Pietro Perona, Serge Belongie

Existing image classification datasets used in computer vision tend to have a uniform distribution of images across object categories.

Classification General Classification +1

Learning Unified Embedding for Apparel Recognition

no code implementations19 Jul 2017 Yang Song, Yuan Li, Bo Wu, Chao-Yeh Chen, Xiao Zhang, Hartwig Adam

To ease the training difficulty, a novel learning scheme is proposed by using the output from specialized models as learning targets so that L2 loss can be used instead of triplet loss.

r-BTN: Cross-domain Face Composite and Synthesis from Limited Facial Patches

no code implementations2 Jun 2017 Yang Song, Zhifei Zhang, Hairong Qi

A more generalized question is that if a large proportion (e. g., more than 50%) of the face/sketch is missing, can a realistic whole face sketch/image still be estimated.

Facial Inpainting Transfer Learning

Age Progression/Regression by Conditional Adversarial Autoencoder

4 code implementations CVPR 2017 Zhifei Zhang, Yang song, Hairong Qi

In CAAE, the face is first mapped to a latent vector through a convolutional encoder, and then the vector is projected to the face manifold conditional on age through a deconvolutional generator.

Stochastic Gradient Geodesic MCMC Methods

no code implementations NeurIPS 2016 Chang Liu, Jun Zhu, Yang song

We propose two stochastic gradient MCMC methods for sampling from Bayesian posterior distributions defined on Riemann manifolds with a known geodesic flow, e. g. hyperspheres.

Topic Models

Derivative Delay Embedding: Online Modeling of Streaming Time Series

1 code implementation24 Sep 2016 Zhifei Zhang, Yang song, Wei Wang, Hairong Qi

The staggering amount of streaming time series coming from the real world calls for more efficient and effective online modeling solution.

General Classification Time Series

Kernel Bayesian Inference with Posterior Regularization

no code implementations NeurIPS 2016 Yang Song, Jun Zhu, Yong Ren

We propose a vector-valued regression problem whose solution is equivalent to the reproducing kernel Hilbert space (RKHS) embedding of the Bayesian posterior distribution.

Bayesian Inference

Improving the Robustness of Deep Neural Networks via Stability Training

no code implementations CVPR 2016 Stephan Zheng, Yang song, Thomas Leung, Ian Goodfellow

In this paper we address the issue of output instability of deep neural networks: small perturbations in the visual input can significantly distort the feature embeddings and output of a neural network.

General Classification

Bayesian Matrix Completion via Adaptive Relaxed Spectral Regularization

1 code implementation3 Dec 2015 Yang Song, Jun Zhu

Bayesian matrix completion has been studied based on a low-rank matrix factorization formulation with promising results.

Bayesian Inference Collaborative Filtering +1

A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems

1 code implementation WWW 2015 Ali Elkahky, Yang song, Xiaodong He

We extend the model to jointly learn from features of items from different domains and user features by introducing a multi-view Deep Learning model.

News Recommendation Recommendation Systems

An Overview of Microsoft Academic Service (MAS) and Applications

no code implementations WWW 2015 Arnab Sinha, Zhihong Shen, Yang song, Hao Ma, Darrin Eide, Bo-June (Paul) Hsu, Kuansan Wang

In addition to obtaining these entities from the publisher feeds as in the previous effort, we in this version include data mining results from the Web index and an in-house knowledge base from Bing, a major commercial search engine.

Learning Fine-grained Image Similarity with Deep Ranking

6 code implementations CVPR 2014 Jiang Wang, Yang song, Thomas Leung, Chuck Rosenberg, Jinbin Wang, James Philbin, Bo Chen, Ying Wu

This paper proposes a deep ranking model that employs deep learning techniques to learn similarity metric directly from images. It has higher learning capability than models based on hand-crafted features.

General Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.