Search Results for author: Tong Yang

Found 36 papers, 17 papers with code

Slot-guided Volumetric Object Radiance Fields

no code implementations NeurIPS 2023 Di Qi, Tong Yang, Xiangyu Zhang

We hope our approach can provide preliminary understanding of the physical world and help ease future research in 3D object-centric representation learning.

Object Representation Learning

CAFE: Towards Compact, Adaptive, and Fast Embedding for Large-scale Recommendation Models

1 code implementation6 Dec 2023 Hailin Zhang, Zirui Liu, Boxuan Chen, Yikai Zhao, Tong Zhao, Tong Yang, Bin Cui

Guided by our design philosophy, we further propose a multi-level hash embedding framework to optimize the embedding tables of non-hot features.

Feature Importance Philosophy

FAAC: Facial Animation Generation with Anchor Frame and Conditional Control for Superior Fidelity and Editability

no code implementations6 Dec 2023 Linze Li, Sunqi Fan, Hengjun Pu, Zhaodong Bing, Yao Tang, Tianzhu Ye, Tong Yang, Liangyu Chen, Jiajun Liang

Our method's efficacy has been validated on multiple representative DreamBooth and LoRA models, delivering substantial improvements over the original outcomes in terms of facial fidelity, text-to-image editability, and video motion.

Face Model Video Generation

Experimental Analysis of Large-scale Learnable Vector Storage Compression

1 code implementation27 Nov 2023 Hailin Zhang, Penghao Zhao, Xupeng Miao, Yingxia Shao, Zirui Liu, Tong Yang, Bin Cui

Learnable embedding vector is one of the most important applications in machine learning, and is widely used in various database-related domains.

Benchmarking

Federated Natural Policy Gradient Methods for Multi-task Reinforcement Learning

no code implementations1 Nov 2023 Tong Yang, Shicong Cen, Yuting Wei, Yuxin Chen, Yuejie Chi

Federated reinforcement learning (RL) enables collaborative decision making of multiple distributed agents without sharing local data trajectories.

Decision Making Policy Gradient Methods +2

Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Acceleration

1 code implementation NeurIPS 2023 Longlin Yu, Tianyu Xie, Yu Zhu, Tong Yang, Xiangyu Zhang, Cheng Zhang

Semi-implicit variational inference (SIVI) has been introduced to expand the analytical variational families by defining expressive semi-implicit distributions in a hierarchical manner.

Bayesian Inference Variational Inference

LAMP: Learn A Motion Pattern for Few-Shot-Based Video Generation

1 code implementation16 Oct 2023 Ruiqi Wu, Liangyu Chen, Tong Yang, Chunle Guo, Chongyi Li, Xiangyu Zhang

Specifically, we design a first-frame-conditioned pipeline that uses an off-the-shelf text-to-image model for content generation so that our tuned video diffusion model mainly focuses on motion learning.

Image Animation Text-to-Image Generation +2

Calibrating Cross-modal Features for Text-Based Person Searching

no code implementations5 Apr 2023 Donglai Wei, Sipeng Zhang, Tong Yang, Yang Liu, Jing Liu

On the other hand, the Masking Caption Modeling (MCM) loss leverages a masked captions prediction task to establish detailed and generic relationships between textual and visual parts.

Person Search Text based Person Search

A Primal-dual Approach for Solving Variational Inequalities with General-form Constraints

1 code implementation27 Oct 2022 Tatjana Chavdarova, Matteo Pagliardini, Tong Yang, Michael I. Jordan

We prove its convergence and show that the gap function of the last iterate of this inexact-ACVI method decreases at a rate of $\mathcal{O}(\frac{1}{\sqrt{K}})$ when the operator is $L$-Lipschitz and monotone, provided that the errors decrease at appropriate rates.

Optimization for Amortized Inverse Problems

no code implementations25 Oct 2022 Tianci Liu, Tong Yang, Quan Zhang, Qi Lei

Incorporating a deep generative model as the prior distribution in inverse problems has established substantial success in reconstructing images from corrupted observations.

Denoising

Solving Constrained Variational Inequalities via a First-order Interior Point-based Method

1 code implementation21 Jun 2022 Tong Yang, Michael I. Jordan, Tatjana Chavdarova

We provide convergence guarantees for ACVI in two general classes of problems: (i) when the operator is $\xi$-monotone, and (ii) when it is monotone, some constraints are active and the game is not purely rotational.

Learning A Simulation-based Visual Policy for Real-world Peg In Unseen Holes

1 code implementation9 May 2022 Liang Xie, Hongxiang Yu, Kechun Xu, Tong Yang, Minhang Wang, Haojian Lu, Rong Xiong, Yue Wang

This paper proposes a learning-based visual peg-in-hole that enables training with several shapes in simulation, and adapting to arbitrary unseen shapes in real world with minimal sim-to-real cost.

Cannikin's Law in Tensor Modeling: A Rank Study for Entanglement and Separability in Tensor Complexity and Model Capacity

no code implementations16 Apr 2022 Tong Yang

This study clarifies the proper criteria to assess the modeling capacity of a general tensor model.

Tensor-networks for High-order Polynomial Approximation: A Many-body Physics Perspective

no code implementations16 Apr 2022 Tong Yang

We analyze the problem of high-order polynomial approximation from a many-body physics perspective, and demonstrate the descriptive power of entanglement entropy in capturing model capacity and task complexity.

Descriptive Tensor Networks

Knowledgebra: An Algebraic Learning Framework for Knowledge Graph

no code implementations15 Apr 2022 Tong Yang, Yifei Wang, Long Sha, Jan Engelbrecht, Pengyu Hong

As far as we know, by applying abstract algebra in statistical learning, this work develops the first formal language for general knowledge graphs, and also sheds light on the problem of neural-symbolic integration from an algebraic perspective.

Abstract Algebra General Knowledge +3

Q-ViT: Fully Differentiable Quantization for Vision Transformer

no code implementations19 Jan 2022 Zhexin Li, Tong Yang, Peisong Wang, Jian Cheng

In this paper, we propose a fully differentiable quantization method for vision transformer (ViT) named as Q-ViT, in which both of the quantization scales and bit-widths are learnable parameters.

Quantization

LGD: Label-guided Self-distillation for Object Detection

1 code implementation23 Sep 2021 Peizhen Zhang, Zijian Kang, Tong Yang, Xiangyu Zhang, Nanning Zheng, Jian Sun

Instead, we generate an instructive knowledge based only on student representations and regular labels.

Instance Segmentation Object +4

Anchor DETR: Query Design for Transformer-Based Object Detection

2 code implementations15 Sep 2021 Yingming Wang, Xiangyu Zhang, Tong Yang, Jian Sun

Thanks to the query design and the attention variant, the proposed detector that we called Anchor DETR, can achieve better performance and run faster than the DETR with 10$\times$ fewer training epochs.

Object object-detection +1

Points as Queries: Weakly Semi-supervised Object Detection by Points

1 code implementation CVPR 2021 Liangyu Chen, Tong Yang, Xiangyu Zhang, Wei zhang, Jian Sun

We propose a novel point annotated setting for the weakly semi-supervised object detection task, in which the dataset comprises small fully annotated images and large weakly annotated images by points.

object-detection Object Detection +1

You Only Look One-level Feature

6 code implementations CVPR 2021 Qiang Chen, Yingming Wang, Tong Yang, Xiangyu Zhang, Jian Cheng, Jian Sun

From the perspective of optimization, we introduce an alternative way to address the problem instead of adopting the complex feature pyramids - {\em utilizing only one-level feature for detection}.

object-detection Object Detection

Generator Pyramid for High-Resolution Image Inpainting

no code implementations4 Dec 2020 Leilei Cao, Tong Yang, Yixu Wang, Bo Yan, Yandong Guo

Thus, our model consists of a pyramid of fully convolutional GANs, wherein the content GAN is responsible for completing contents in the lowest-resolution masked image, and each texture GAN is responsible for synthesizing textures in a higher-resolution image.

Image Inpainting Texture Synthesis +1

Co-mining: Self-Supervised Learning for Sparsely Annotated Object Detection

1 code implementation3 Dec 2020 Tiancai Wang, Tong Yang, Jiale Cao, Xiangyu Zhang

Object detectors usually achieve promising results with the supervision of complete instance annotations.

MULTI-VIEW LEARNING Object +4

Variance Regularization for Accelerating Stochastic Optimization

no code implementations13 Aug 2020 Tong Yang, Long Sha, Pengyu Hong

While nowadays most gradient-based optimization methods focus on exploring the high-dimensional geometric features, the random error accumulated in a stochastic version of any algorithm implementation has not been stressed yet.

Stochastic Optimization

A Deep Learning Approach for COVID-19 Trend Prediction

no code implementations9 Aug 2020 Tong Yang, Long Sha, Justin Li, Pengyu Hong

In this work, we developed a deep learning model-based approach to forecast the spreading trend of SARS-CoV-2 in the United States.

Time Series Time Series Analysis

Entanglement-Embedded Recurrent Network Architecture: Tensorized Latent State Propagation and Chaos Forecasting

no code implementations10 Jun 2020 Xiangyi Meng, Tong Yang

Chaotic time series forecasting has been far less understood despite its tremendous potential in theory and real-world applications.

Tensor Decomposition Time Series +1

Perceptual Extreme Super Resolution Network with Receptive Field Block

1 code implementation26 May 2020 Taizhang Shang, Qiuju Dai, Shengchen Zhu, Tong Yang, Yandong Guo

Third, we alternately use different upsampling methods in the upsampling stage to reduce the high computation complexity and still remain satisfactory performance.

Image Super-Resolution object-detection +1

NagE: Non-Abelian Group Embedding for Knowledge Graphs

no code implementations22 May 2020 Tong Yang, Long Sha, Pengyu Hong

We demonstrated the existence of a group algebraic structure hidden in relational knowledge embedding problems, which suggests that a group-based embedding framework is essential for designing embedding models.

Knowledge Graph Embedding Knowledge Graphs

Learning Human-Object Interaction Detection using Interaction Points

1 code implementation CVPR 2020 Tiancai Wang, Tong Yang, Martin Danelljan, Fahad Shahbaz Khan, Xiangyu Zhang, Jian Sun

Human-object interaction (HOI) detection strives to localize both the human and an object as well as the identification of complex interactions between them.

Human-Object Interaction Detection Keypoint Detection +2

A Group-Theoretic Framework for Knowledge Graph Embedding

no code implementations25 Sep 2019 Tong Yang, Long Sha, Pengyu Hong

We have rigorously proved the existence of a group algebraic structure hidden in relational knowledge embedding problems, which suggests that a group-based embedding framework is essential for model design.

Knowledge Graph Embedding

AHash: A Load-Balanced One Permutation Hash

1 code implementation25 Sep 2019 Chenxingyu Zhao, Jie Gui, Yixiao Guo, Jie Jiang, Tong Yang, Bin Cui, Gong Zhang

Unlike the densification to fill the empty bins after they undesirably occur, our design goal is to balance the load so as to reduce the empty bins in advance.

X-Forest: Approximate Random Projection Trees for Similarity Measurement

1 code implementation25 Sep 2019 Yikai Zhao, Peiqing Chen, Zidong Zhao, Tong Yang, Jie Jiang, Bin Cui, Gong Zhang, Steve Uhlig

First, we introduced RP Trees into the tasks of similarity measurement such that accuracy is improved.

Resizable Neural Networks

no code implementations25 Sep 2019 Yichen Zhu, Xiangyu Zhang, Tong Yang, Jian Sun

We introduce the adaptive resizable networks as dynamic networks, which further improve the performance with less computational cost via data-dependent inference.

Data Augmentation Neural Architecture Search

DetNAS: Backbone Search for Object Detection

2 code implementations NeurIPS 2019 Yukang Chen, Tong Yang, Xiangyu Zhang, Gaofeng Meng, Xinyu Xiao, Jian Sun

In this work, we present DetNAS to use Neural Architecture Search (NAS) for the design of better backbones for object detection.

General Classification Image Classification +4

Cannot find the paper you are looking for? You can Submit a new open access paper.