Search Results for author:
Found 34 papers, 12 papers with code
Jointly Optimizing Image Compression with Low-light Image Enhancement
To simultaneously achieve a higher compression rate and better enhancement performance for low-light images, we propose a novel image compression framework with joint optimization of low-light image enhancement.
Understanding and Constructing Latent Modality Structures in Multi-modal Representation Learning
Hence we advocate that the key of better performance lies in meaningful latent modality structures instead of perfect modality alignment.
Few-Shot Image Classification
Open-Ended Question Answering
+6
High-Fidelity Variable-Rate Image Compression via Invertible Activation Transformation
We implement the IAT in a mathematical invertible manner on a single rate Invertible Neural Network (INN) based model and the quality level (QLevel) would be fed into the IAT to generate scaling and bias tensors.
Multi-modal Alignment using Representation Codebook
Aligning signals from different modalities is an important step in vision-language representation learning as it affects the performance of later stages such as cross-modality fusion.
Vision-Language Pre-Training with Triple Contrastive Learning
Besides CMA, TCL introduces an intra-modal contrastive objective to provide complementary benefits in representation learning.
Ranked #1 on
Zero-Shot Cross-Modal Retrieval
on COCO 2014
Learning Oriented Remote Sensing Object Detection via Naive Geometric Computing
Detecting oriented objects along with estimating their rotation information is one crucial step for analyzing remote sensing images.
Simpler, Faster, Stronger: Breaking The log-K Curse On Contrastive Learners With FlatNCE
InfoNCE-based contrastive representation learners, such as SimCLR, have been tremendously successful in recent years.
SpanPredict: Extraction of Predictive Document Spans with Neural Attention
In many natural language processing applications, identifying predictive text can be as important as the predictions themselves.
Towards Robust and Efficient Contrastive Textual Representation Learning
There has been growing interest in representation learning for text data, based on theoretical arguments and empirical evidence.
Wasserstein Contrastive Representation Distillation
The primary goal of knowledge distillation (KD) is to encapsulate the information of a model learned from a teacher network into a student network, with the latter being more compact than the former.
Ranked #7 on
Knowledge Distillation
on CIFAR-100
Proactive Pseudo-Intervention: Causally Informed Contrastive Learning For Interpretable Vision Models
Deep neural networks excel at comprehending complex visual signals, delivering on par or even superior performance to that of human experts.
Improving Text Generation with Student-Forcing Optimal Transport
An extension is further proposed to improve the OT learning, based on the structural and contextual information of the text sequences.
Contextualized Perturbation for Textual Adversarial Attack
Adversarial examples expose the vulnerabilities of natural language processing (NLP) models, and can be used to evaluate and improve their robustness.
Weakly supervised cross-domain alignment with optimal transport
Cross-domain alignment between image objects and text sequences is key to many visual-language tasks, and it poses a fundamental challenge to both computer vision and natural language processing.
Graph Optimal Transport for Cross-Domain Alignment
In GOT, cross-domain alignment is formulated as a graph matching problem, by representing entities into a dynamically-constructed graph.
On Fenchel Mini-Max Learning
Inference, estimation, sampling and likelihood evaluation are four primary goals of probabilistic modeling.
Graph-Driven Generative Models for Heterogeneous Multi-Task Learning
We propose a novel graph-driven generative model, that unifies multiple heterogeneous learning tasks into the same framework.
Improving Textual Network Learning with Variational Homophilic Embeddings
This paper considers a novel variational formulation of network embeddings, with special focus on textual networks.
LMVP: Video Predictor with Leaked Motion Information
We propose a Leaked Motion Video Predictor (LMVP) to predict future frames by capturing the spatial and temporal dependencies from given inputs.
Improving Textual Network Embedding with Global Attention via Optimal Transport
Constituting highly informative network embeddings is an important tool for network analysis.
Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models
Variational autoencoders (VAEs) have received much attention recently as an end-to-end architecture for text generation with latent variables.
Improving Sequence-to-Sequence Learning via Optimal Transport
Sequence-to-sequence models are commonly trained via maximum likelihood estimation (MLE).
Sequence Generation with Guider Network
Sequence generation with reinforcement learning (RL) has received significant attention recently.
Hierarchically-Structured Variational Autoencoders for Long Text Generation
Variational autoencoders (VAEs) have received much attention recently as an end-to-end architecture for text generation.
Adversarial Text Generation via Feature-Mover's Distance
However, the discrete nature of text hinders the application of GAN to text-generation tasks.
Chi-square Generative Adversarial Network
To assess the difference between real and synthetic data, Generative Adversarial Networks (GANs) are trained using a distribution discrepancy measure.
Variational Inference and Model Selection with Generalized Evidence Bounds
Recent advances on the scalability and flexibility of variational inference have made it successful at unravelling hidden patterns in complex data.
A Unified Particle-Optimization Framework for Scalable Bayesian Sampling
There has been recent interest in developing scalable Bayesian sampling methods such as stochastic gradient MCMC (SG-MCMC) and Stein variational gradient descent (SVGD) for big-data analysis.
Adversarial Symmetric Variational Autoencoder
A new form of variational autoencoder (VAE) is developed, in which the joint distribution of data and codes is considered in two (symmetric) forms: ($i$) from observed data fed through the encoder to yield codes, and ($ii$) from latent codes drawn from a simple prior and propagated through the decoder to manifest data.
Triangle Generative Adversarial Networks
The generators are designed to learn the two-way conditional distributions between the two domains, while the discriminators implicitly define a ternary discriminative function, which is trained to distinguish real data pairs and two kinds of fake data pairs.
Image-to-Image Translation
Semi-Supervised Image Classification
+1
Symmetric Variational Autoencoder and Connections to Adversarial Learning
A new form of the variational autoencoder (VAE) is proposed, based on the symmetric Kullback-Leibler divergence.
ALICE: Towards Understanding Adversarial Learning for Joint Distribution Matching
We investigate the non-identifiability issues associated with bidirectional adversarial training for joint distribution matching.
Continuous-Time Flows for Efficient Inference and Density Estimation
Distinct from normalizing flows and GANs, CTFs can be adopted to achieve the above two goals in one framework, with theoretical guarantees.
Formal Analysis of V2X Revocation Protocols
This paper focusses on the formal analysis of a particular element of security mechanisms for V2X found in many proposals: the revocation of malicious or misbehaving vehicles from the V2X system by invalidating their credentials.
Cryptography and Security D.2.4; D.4.6
