Search Results for author: Shihao Ji

Found 31 papers, 24 papers with code

A Hybrid Generative and Discriminative PointNet on Unordered Point Sets

no code implementations19 Apr 2024 Yang Ye, Shihao Ji

This paper proposes GDPNet, the first hybrid Generative and Discriminative PointNet that extends JEM for point cloud classification and generation.

Image Classification Point Cloud Classification +2

M-EBM: Towards Understanding the Manifolds of Energy-Based Models

1 code implementation8 Mar 2023 Xiulong Yang, Shihao Ji

Despite its simplicity, M-EBM significantly improves unconditional EBMs in training stability and speed on a host of benchmark datasets, such as CIFAR10, CIFAR100, CelebA-HQ, and ImageNet 32x32.

Image Generation

Accounting for Temporal Variability in Functional Magnetic Resonance Imaging Improves Prediction of Intelligence

1 code implementation11 Nov 2022 Yang Li, Xin Ma, Raj Sunderraman, Shihao Ji, Suprateek Kundu

We compare the prediction performance for different intelligence measures based on static FC, dynamic FC, and region level time series acquired from the Adolescent Brain Cognitive Development (ABCD) study involving close to 7000 individuals.

feature selection Time Series +1

APSNet: Attention Based Point Cloud Sampling

1 code implementation11 Oct 2022 Yang Ye, Xiulong Yang, Shihao Ji

Traditional task-agnostic sampling methods, such as farthest point sampling (FPS), do not consider downstream tasks when sampling point clouds, and thus non-informative points to the tasks are often sampled.

3D Point Cloud Classification Knowledge Distillation +2

Towards Bridging the Performance Gaps of Joint Energy-based Models

1 code implementation CVPR 2023 Xiulong Yang, Qing Su, Shihao Ji

This question has recently been answered in the affirmative, introducing the field of Joint Energy-based Model (JEM), which achieves high classification accuracy and image generation quality simultaneously.

Adversarial Robustness Data Augmentation +3

Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model

1 code implementation16 Aug 2022 Xiulong Yang, Sheng-Min Shih, Yinlin Fu, Xiaoting Zhao, Shihao Ji

Diffusion Denoising Probability Models (DDPM) and Vision Transformer (ViT) have demonstrated significant progress in generative tasks and discriminative tasks, respectively, and thus far these models have largely been developed in their own domains.

Denoising Image Classification +1

ChiTransformer:Towards Reliable Stereo from Cues

1 code implementation9 Mar 2022 Qing Su, Shihao Ji

Current stereo matching techniques are challenged by restricted searching space, occluded regions and sheer size.

Depth Estimation Retrieval +1

Chitransformer: Towards Reliable Stereo From Cues

1 code implementation CVPR 2022 Qing Su, Shihao Ji

Current stereo matching techniques are challenged by restricted searching space, occluded regions and sheer size.

Ranked #2 on Stereo Depth Estimation on KITTI2015 (D1-all All metric)

Monocular Depth Estimation Retrieval +1

Generative Dynamic Patch Attack

1 code implementation8 Nov 2021 Xiang Li, Shihao Ji

Extensive experiments on VGGFace, Traffic Sign and ImageNet show that GDPA achieves higher attack success rates than state-of-the-art patch attacks, while adversarially trained model with GDPA demonstrates superior robustness to adversarial patch attacks than competing methods.

JEM++: Improved Techniques for Training JEM

1 code implementation ICCV 2021 Xiulong Yang, Shihao Ji

1) We propose a proximal SGLD to generate samples in the proximity of samples from the previous step, which improves the stability.

Improving Text-to-Image Synthesis Using Contrastive Learning

1 code implementation6 Jul 2021 Hui Ye, Xiulong Yang, Martin Takac, Rajshekhar Sunderraman, Shihao Ji

To address this issue, we propose a contrastive learning approach to improve the quality and enhance the semantic consistency of synthetic images.

Contrastive Learning Text-to-Image Generation

Dep-$L_0$: Improving $L_0$-based Network Sparsification via Dependency Modeling

1 code implementation30 Jun 2021 Yang Li, Shihao Ji

We term our algorithm Dep-$L_0$ as it prunes networks via a dependency-enabled $L_0$ regularization.

Network Pruning Variational Inference

Reducing Risk and Uncertainty of Deep Neural Networks on Diagnosing COVID-19 Infection

no code implementations28 Apr 2021 Krishanu Sarker, Sharbani Pandit, Anupam Sarker, Saeid Belkasim, Shihao Ji

In this work, we introduce uncertainty estimation to detect confusing cases for expert referral to address the unreliability of state-of-the-art (SOTA) DNNs on COVID-19 detection.

Generative Max-Mahalanobis Classifiers for Image Classification, Generation and More

1 code implementation1 Jan 2021 Xiulong Yang, Hui Ye, Yang Ye, Xiang Li, Shihao Ji

We show that our Generative MMC (GMMC) can be trained discriminatively, generatively, or jointly for image classification and generation.

Adversarial Robustness Classification +4

Adversarial Privacy Preserving Graph Embedding against Inference Attack

1 code implementation30 Aug 2020 Kaiyang Li, Guangchun Luo, Yang Ye, Wei Li, Shihao Ji, Zhipeng Cai

In this paper, we propose Adversarial Privacy Graph Embedding (APGE), a graph adversarial training framework that integrates the disentangling and purging mechanisms to remove users' private information from learned node representations.

Graph Embedding Inference Attack +4

Learning with Multiplicative Perturbations

1 code implementation4 Dec 2019 Xiulong Yang, Shihao Ji

In this paper, we propose xAT and xVAT, new adversarial training algorithms, that generate \textbf{multiplicative} perturbations to input examples for robust training of DNNs.

Sparse Graph Attention Networks

1 code implementation2 Dec 2019 Yang Ye, Shihao Ji

Among the variants of GNNs, Graph Attention Networks (GATs) learn to assign dense attention coefficients over all neighbors of a node for feature aggregation, and improve the performance of many graph learning tasks.

General Classification Graph Attention +5

Toward Filament Segmentation Using Deep Neural Networks

no code implementations20 Nov 2019 Azim Ahmadzadeh, Sushant S. Mahajan, Dustin J. Kempton, Rafal A. Angryk, Shihao Ji

Despite the known challenges in the identification and characterization of filaments by the existing module, which in turn are inherited into any other module that intends to learn from such outputs, Mask R-CNN shows promising results.

Neural Plasticity Networks

1 code implementation13 Aug 2019 Yang Li, Shihao Ji

To the best of our knowledge, this is the first learning framework that unifies network sparsification and network expansion in an end-to-end training pipeline.

Image Classification

Neural Image Compression and Explanation

1 code implementation9 Aug 2019 Xiang Li, Shihao Ji

Explaining the prediction of deep neural networks (DNNs) and semantic image compression are two active research areas of deep learning with a numerous of applications in decision-critical systems, such as surveillance cameras, drones and self-driving cars, where interpretable decision is critical and storage/network bandwidth is limited.

General Classification Image Classification +2

$L_0$-ARM: Network Sparsification via Stochastic Binary Optimization

1 code implementation9 Apr 2019 Yang Li, Shihao Ji

Thanks to the flexibility of ARM, many smooth or non-smooth parametric functions, such as scaled sigmoid or hard sigmoid, can be used to parameterize this binary optimization problem and the unbiasness of the ARM estimator is retained, while the hard concrete estimator has to rely on the hard sigmoid function to achieve conditional computation and thus accelerated training.

Defense-VAE: A Fast and Accurate Defense against Adversarial Attacks

1 code implementation17 Dec 2018 Xiang Li, Shihao Ji

The proposed method is generic and can defend white-box and black-box attacks without the need of retraining the original CNN classifiers, and can further strengthen the defense by retraining CNN or end-to-end finetuning the whole pipeline.

Towards Robust Human Activity Recognition from RGB Video Stream with Limited Labeled Data

no code implementations16 Dec 2018 Krishanu Sarker, Mohamed Masoud, Saeid Belkasim, Shihao Ji

Due to lack of depth information, RGB video based activity recognition performs poorly compared to RGB-D video based solutions.

Data Augmentation Human Activity Recognition

Parallelizing Word2Vec in Multi-Core and Many-Core Architectures

1 code implementation18 Nov 2016 Shihao Ji, Nadathur Satish, Sheng Li, Pradeep Dubey

Word2vec is a widely used algorithm for extracting low-dimensional vector representations of words.

Extreme Stochastic Variational Inference: Distributed and Asynchronous

no code implementations31 May 2016 Jiong Zhang, Parameswaran Raman, Shihao Ji, Hsiang-Fu Yu, S. V. N. Vishwanathan, Inderjit S. Dhillon

Moreover, it requires the parameters to fit in the memory of a single processor; this is problematic when the number of parameters is in billions.

Variational Inference

Parallelizing Word2Vec in Shared and Distributed Memory

no code implementations15 Apr 2016 Shihao Ji, Nadathur Satish, Sheng Li, Pradeep Dubey

In combination, these techniques allow us to scale up the computation near linearly across cores and nodes, and process hundreds of millions of words per second, which is the fastest word2vec implementation to the best of our knowledge.

Machine Translation named-entity-recognition +5

BlackOut: Speeding up Recurrent Neural Network Language Models With Very Large Vocabularies

1 code implementation21 Nov 2015 Shihao Ji, S. V. N. Vishwanathan, Nadathur Satish, Michael J. Anderson, Pradeep Dubey

One way to understand BlackOut is to view it as an extension of the DropOut strategy to the output layer, wherein we use a discriminative training loss and a weighted sampling scheme.

Language Modelling

WordRank: Learning Word Embeddings via Robust Ranking

2 code implementations EMNLP 2016 Shihao Ji, Hyokun Yun, Pinar Yanardag, Shin Matsushima, S. V. N. Vishwanathan

Then, based on this insight, we propose a novel framework WordRank that efficiently estimates word representations via robust ranking, in which the attention mechanism and robustness to noise are readily achieved via the DCG-like ranking losses.

Learning Word Embeddings Word Similarity

Cannot find the paper you are looking for? You can Submit a new open access paper.