Search Results for author: Xiaokang Yang

Found 175 papers, 69 papers with code

Layered Neighborhood Expansion for Incremental Multiple Graph Matching

1 code implementation ECCV 2020 Zixuan Chen, Zhihui Xie, Junchi Yan Yinqiang Zheng, Xiaokang Yang

In this paper, we treat the graphs as graphs on a super-graph, and propose a novel breadth first search based method for expanding the neighborhood on the super-graph for a new coming graph, such that the matching with the new graph can be efficiently performed within the constructed neighborhood.

Graph Matching

HDR-GS: Efficient High Dynamic Range Novel View Synthesis at 1000x Speed via Gaussian Splatting

1 code implementation24 May 2024 Yuanhao Cai, Zihao Xiao, Yixun Liang, Minghan Qin, Yulun Zhang, Xiaokang Yang, Yaoyao Liu, Alan Yuille

In this paper, we propose a new framework, High Dynamic Range Gaussian Splatting (HDR-GS), which can efficiently render novel HDR views and reconstruct LDR images with a user input exposure time.

FLoRA: Low-Rank Core Space for N-dimension

no code implementations23 May 2024 Chongjie Si, Xuehui Wang, Xue Yang, Zhengqin Xu, Qingyun Li, Jifeng Dai, Yu Qiao, Xiaokang Yang, Wei Shen

To tackle the diversity of dimensional spaces across different foundation models and provide a more precise representation of the changes within these spaces, this paper introduces a generalized parameter-efficient fine-tuning framework, FLoRA, designed for various dimensional parameter space.

Tensor Decomposition

Promoting AI Equity in Science: Generalized Domain Prompt Learning for Accessible VLM Research

no code implementations14 May 2024 Qinglong Cao, Yuntian Chen, Lu Lu, Hao Sun, Zhenzhong Zeng, Xiaokang Yang, Dongxiao Zhang

Our framework paves the way for sustainable and inclusive VLM research, transcending the barriers between academia and industry.

Domain Adaptation

IPAD: Industrial Process Anomaly Detection Dataset

no code implementations23 Apr 2024 Jinfan Liu, Yichao Yan, Junjie Li, Weiming Zhao, Pengzhi Chu, Xingdong Sheng, Yunhui Liu, Xiaokang Yang

Video anomaly detection (VAD) is a challenging task aiming to recognize anomalies in video frames, and existing large-scale VAD researches primarily focus on road traffic and human activity scenes.

Anomaly Detection Video Anomaly Detection +1

Infusion: Preventing Customized Text-to-Image Diffusion from Overfitting

no code implementations22 Apr 2024 Weili Zeng, Yichao Yan, Qi Zhu, Zhuo Chen, Pengzhi Chu, Weiming Zhao, Xiaokang Yang

Text-to-image (T2I) customization aims to create images that embody specific visual concepts delineated in textual descriptions.

Rethinking Clothes Changing Person ReID: Conflicts, Synthesis, and Optimization

no code implementations19 Apr 2024 Junjie Li, Guanshuo Wang, Fufu Yu, Yichao Yan, Qiong Jia, Shouhong Ding, Xingdong Sheng, Yunhui Liu, Xiaokang Yang

However, such improvement sacrifices the performance under the standard protocol, caused by the inner conflict between standard and CC.

Clothes Changing Person Re-Identification

Tendency-driven Mutual Exclusivity for Weakly Supervised Incremental Semantic Segmentation

no code implementations18 Apr 2024 Chongjie Si, Xuehui Wang, Xiaokang Yang, Wei Shen

However, a scenario usually arises where a pixel is concurrently predicted as an old class by the pre-trained segmentation model and a new class by the seed areas.

Incremental Learning Segmentation +1

UAlign: Pushing the Limit of Template-free Retrosynthesis Prediction with Unsupervised SMILES Alignment

1 code implementation25 Mar 2024 Kaipeng Zeng, Bo Yang, Xin Zhao, Yu Zhang, Fan Nie, Xiaokang Yang, Yaohui Jin, Yanyan Xu

Single-step retrosynthesis prediction, a crucial step in the planning process, has witnessed a surge in interest in recent years due to advancements in AI for science.

Graph-to-Sequence molecular representation +3

EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splatting

no code implementations22 Mar 2024 Kailing Wang, Chen Yang, Yuehao Wang, Sikuang Li, Yan Wang, Qi Dou, Xiaokang Yang, Wei Shen

Precise camera tracking, high-fidelity 3D tissue reconstruction, and real-time online visualization are critical for intrabody medical imaging devices such as endoscopes and capsule robots.

Simultaneous Localization and Mapping

Boundary Matters: A Bi-Level Active Finetuning Framework

no code implementations15 Mar 2024 Han Lu, Yichen Xie, Xiaokang Yang, Junchi Yan

In this paper, we propose a Bi-Level Active Finetuning framework to select the samples for annotation in one shot, which includes two stages: core sample selection for diversity, and boundary sample selection for uncertainty.

Active Learning Denoising

Comparison of No-Reference Image Quality Models via MAP Estimation in Diffusion Latents

no code implementations11 Mar 2024 Weixia Zhang, Dingquan Li, Guangtao Zhai, Xiaokang Yang, Kede Ma

Contemporary no-reference image quality assessment (NR-IQA) models can effectively quantify the perceived image quality, with high correlations between model predictions and human perceptual scores on fixed test sets.

Image Enhancement No-Reference Image Quality Assessment +1

Rethinking Classifier Re-Training in Long-Tailed Recognition: A Simple Logits Retargeting Approach

no code implementations1 Mar 2024 Han Lu, Siyu Sun, Yichen Xie, Liqing Zhang, Xiaokang Yang, Junchi Yan

In the long-tailed recognition field, the Decoupled Training paradigm has demonstrated remarkable capabilities among various methods.

Representation Learning

CasCast: Skillful High-resolution Precipitation Nowcasting via Cascaded Modelling

no code implementations6 Feb 2024 Junchao Gong, Lei Bai, Peng Ye, Wanghan Xu, Na Liu, Jianhua Dai, Xiaokang Yang, Wanli Ouyang

Precipitation nowcasting based on radar data plays a crucial role in extreme weather prediction and has broad implications for disaster management.

Management

Poisson Process for Bayesian Optimization

no code implementations5 Feb 2024 Xiaoxing Wang, Jiaxing Li, Chao Xue, Wei Liu, Weifeng Liu, Xiaokang Yang, Junchi Yan, DaCheng Tao

BayesianOptimization(BO) is a sample-efficient black-box optimizer, and extensive methods have been proposed to build the absolute function response of the black-box function through a probabilistic surrogate model, including Tree-structured Parzen Estimator (TPE), random forest (SMAC), and Gaussian process (GP).

Bayesian Optimization Hyperparameter Optimization +2

Few-Shot Class-Incremental Learning with Prior Knowledge

1 code implementation2 Feb 2024 Wenhao Jiang, Duo Li, Menghan Hu, Guangtao Zhai, Xiaokang Yang, Xiao-Ping Zhang

To tackle the issues of catastrophic forgetting and overfitting in few-shot class-incremental learning (FSCIL), previous work has primarily concentrated on preserving the memory of old knowledge during the incremental phase.

Few-Shot Class-Incremental Learning Incremental Learning

Vision-Informed Flow Image Super-Resolution with Quaternion Spatial Modeling and Dynamic Flow Convolution

no code implementations29 Jan 2024 Qinglong Cao, Zhengqin Xu, Chao Ma, Xiaokang Yang, Yuntian Chen

To tackle this dilemma, we comprehensively consider the flow visual properties, including the unique flow imaging principle and morphological information, and propose the first flow visual property-informed FISR algorithm.

Image Super-Resolution

Uncertainty-aware Sampling for Long-tailed Semi-supervised Learning

1 code implementation9 Jan 2024 Kuo Yang, Duo Li, Menghan Hu, Guangtao Zhai, Xiaokang Yang, Xiao-Ping Zhang

This approach allows the model to perceive the uncertainty of pseudo-labels at different training stages, thereby adaptively adjusting the selection thresholds for different classes.

Pseudo Label

Inter-X: Towards Versatile Human-Human Interaction Analysis

no code implementations26 Dec 2023 Liang Xu, Xintao Lv, Yichao Yan, Xin Jin, Shuwen Wu, Congsheng Xu, Yifan Liu, Yizhou Zhou, Fengyun Rao, Xingdong Sheng, Yunhui Liu, Wenjun Zeng, Xiaokang Yang

We also equip Inter-X with versatile annotations of more than 34K fine-grained human part-level textual descriptions, semantic interaction categories, interaction order, and the relationship and personality of the subjects.

Efficient Deformable Tissue Reconstruction via Orthogonal Neural Plane

2 code implementations23 Dec 2023 Chen Yang, Kailing Wang, Yuehao Wang, Qi Dou, Xiaokang Yang, Wei Shen

Intraoperative imaging techniques for reconstructing deformable tissues in vivo are pivotal for advanced surgical systems.

Appeal: Allow Mislabeled Samples the Chance to be Rectified in Partial Label Learning

no code implementations18 Dec 2023 Chongjie Si, Xuehui Wang, Yan Wang, Xiaokang Yang, Wei Shen

In partial label learning (PLL), each instance is associated with a set of candidate labels among which only one is ground-truth.

Partial Label Learning

VidToMe: Video Token Merging for Zero-Shot Video Editing

no code implementations17 Dec 2023 Xirui Li, Chao Ma, Xiaokang Yang, Ming-Hsuan Yang

In this work, we propose a novel approach to enhance temporal consistency in generated videos by merging self-attention tokens across frames.

Video Editing Video Generation

Domain Prompt Learning with Quaternion Networks

no code implementations12 Dec 2023 Qinglong Cao, Zhengqin Xu, Yuntian Chen, Chao Ma, Xiaokang Yang

Specifically, the proposed method involves using domain-specific vision features from domain-specific foundation models to guide the transformation of generalized contextual embeddings from the language branch into a specialized space within the quaternion networks.

Contrastive Learning

Image Super-Resolution with Text Prompt Diffusion

1 code implementation24 Nov 2023 Zheng Chen, Yulun Zhang, Jinjin Gu, Xin Yuan, Linghe Kong, Guihai Chen, Xiaokang Yang

Specifically, we first design a text-image generation pipeline to integrate text into the SR dataset through the text degradation representation and degradation model.

Image Generation Image Super-Resolution +1

Binarized 3D Whole-body Human Mesh Recovery

1 code implementation24 Nov 2023 Zhiteng Li, Yulun Zhang, Jing Lin, Haotong Qin, Jinjin Gu, Xin Yuan, Linghe Kong, Xiaokang Yang

In this work, we propose a Binarized Dual Residual Network (BiDRN), a novel quantization method to estimate the 3D human body, face, and hands parameters efficiently.

Binarization Human Mesh Recovery +1

EvaSurf: Efficient View-Aware Implicit Textured Surface Reconstruction on Mobile Devices

no code implementations16 Nov 2023 Jingnan Gao, Zhuo Chen, Yichao Yan, Bowen Pan, Zhe Wang, Jiangjing Lyu, Xiaokang Yang

In our method, we first employ an efficient surface-based model with a multi-view supervision module to ensure accurate mesh reconstruction.

3D Reconstruction Surface Reconstruction

Generalizable Person Search on Open-world User-Generated Video Content

no code implementations16 Oct 2023 Junjie Li, Guanshuo Wang, Yichao Yan, Fufu Yu, Qiong Jia, Jie Qin, Shouhong Ding, Xiaokang Yang

Person search is a challenging task that involves detecting and retrieving individuals from a large set of un-cropped scene images.

Domain Generalization Person Search

Domain-Controlled Prompt Learning

1 code implementation30 Sep 2023 Qinglong Cao, Zhengqin Xu, Yuntian Chen, Chao Ma, Xiaokang Yang

Existing prompt learning methods often lack domain-awareness or domain-transfer mechanisms, leading to suboptimal performance due to the misinterpretation of specific images in natural image patterns.

Directional Texture Editing for 3D Models

no code implementations26 Sep 2023 Shengqi Liu, Zhuo Chen, Jingnan Gao, Yichao Yan, Wenhan Zhu, Jiangjing Lyu, Xiaokang Yang

However, the inherent complexity of 3D models and the ambiguous text description lead to the challenge in this task.

3D Object Editing

SAM-PARSER: Fine-tuning SAM Efficiently by Parameter Space Reconstruction

no code implementations28 Aug 2023 Zelin Peng, Zhengqin Xu, Zhilin Zeng, Xiaokang Yang, Wei Shen

Most existing fine-tuning methods attempt to bridge the gaps among different scenarios by introducing a set of new parameters to modify SAM's original parameter space.

Segmentation Semantic Segmentation

Dual Aggregation Transformer for Image Super-Resolution

1 code implementation ICCV 2023 Zheng Chen, Yulun Zhang, Jinjin Gu, Linghe Kong, Xiaokang Yang, Fisher Yu

Based on the above idea, we propose a novel Transformer model, Dual Aggregation Transformer (DAT), for image SR. Our DAT aggregates features across spatial and channel dimensions, in the inter-block and intra-block dual manner.

Image Super-Resolution

Vid2Act: Activate Offline Videos for Visual RL

no code implementations6 Jun 2023 Minting Pan, Yitao Zheng, Wendong Zhang, Yunbo Wang, Xiaokang Yang

Pretraining RL models on offline video datasets is a promising way to improve their training efficiency in online tasks, but challenging due to the inherent mismatch in tasks, dynamics, and behaviors across domains.

Knowledge Distillation

Reflection Invariance Learning for Few-shot Semantic Segmentation

no code implementations1 Jun 2023 Qinglong Cao, Yuntian Chen, Chao Ma, Xiaokang Yang

Few-shot semantic segmentation (FSS) aims to segment objects of unseen classes in query images with only a few annotated support images.

Few-Shot Semantic Segmentation Segmentation +1

Neural LerPlane Representations for Fast 4D Reconstruction of Deformable Tissues

2 code implementations31 May 2023 Chen Yang, Kailing Wang, Yuehao Wang, Xiaokang Yang, Wei Shen

Reconstructing deformable tissues from endoscopic stereo videos in robotic surgery is crucial for various clinical applications.

4D reconstruction

Few-Shot Rotation-Invariant Aerial Image Semantic Segmentation

1 code implementation29 May 2023 Qinglong Cao, Yuntian Chen, Chao Ma, Xiaokang Yang

Few-shot aerial image segmentation is a challenging task that involves precisely parsing objects in query aerial images with limited annotated support.

Image Segmentation Segmentation +1

Making Offline RL Online: Collaborative World Models for Offline Visual Reinforcement Learning

no code implementations24 May 2023 Qi Wang, Junming Yang, Yunbo Wang, Xin Jin, Wenjun Zeng, Xiaokang Yang

Training offline reinforcement learning (RL) models using visual inputs poses two significant challenges, i. e., the overfitting problem in representation learning and the overestimation bias for expected future rewards.

Offline RL Reinforcement Learning (RL) +2

DynaVol: Unsupervised Learning for Dynamic Scenes through Object-Centric Voxelization

no code implementations30 Apr 2023 Yanpeng Zhao, Siyu Gao, Yunbo Wang, Xiaokang Yang

The voxel features and global features are complementary and are both leveraged by a compositional NeRF decoder for volume rendering.

Decoder Neural Rendering +4

HyperStyle3D: Text-Guided 3D Portrait Stylization via Hypernetworks

no code implementations19 Apr 2023 Zhuo Chen, Xudong Xu, Yichao Yan, Ye Pan, Wenhan Zhu, Wayne Wu, Bo Dai, Xiaokang Yang

While the use of 3D-aware GANs bypasses the requirement of 3D data, we further alleviate the necessity of style images with the CLIP model being the stylization guidance.

Attribute

FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Lead

1 code implementation6 Apr 2023 Kang Chen, Tao Han, Junchao Gong, Lei Bai, Fenghua Ling, Jing-Jia Luo, Xi Chen, Leiming Ma, Tianning Zhang, Rui Su, Yuanzheng Ci, Bin Li, Xiaokang Yang, Wanli Ouyang

We present FengWu, an advanced data-driven global medium-range weather forecast system based on Artificial Intelligence (AI).

Head3D: Complete 3D Head Generation via Tri-plane Feature Distillation

no code implementations28 Mar 2023 Yuhao Cheng, Yichao Yan, Wenhan Zhu, Ye Pan, Bowen Pan, Xiaokang Yang

Head generation with diverse identities is an important task in computer vision and computer graphics, widely used in multimedia applications.

Model-Based Reinforcement Learning with Isolated Imaginations

1 code implementation27 Mar 2023 Minting Pan, Xiangming Zhu, Yitao Zheng, Yunbo Wang, Xiaokang Yang

On top of our previous work, we further consider the sparse dependencies between controllable and noncontrollable states, address the training collapse problem of state decoupling, and validate our approach in transfer learning setups.

Autonomous Driving Model-based Reinforcement Learning +3

Active Finetuning: Exploiting Annotation Budget in the Pretraining-Finetuning Paradigm

1 code implementation CVPR 2023 Yichen Xie, Han Lu, Junchi Yan, Xiaokang Yang, Masayoshi Tomizuka, Wei Zhan

We propose a novel method called ActiveFT for active finetuning task to select a subset of data distributing similarly with the entire unlabeled pool and maintaining enough diversity by optimizing a parametric model in the continuous space.

Image Classification Semantic Segmentation

EasyDGL: Encode, Train and Interpret for Continuous-time Dynamic Graph Learning

1 code implementation22 Mar 2023 Chao Chen, Haoyu Geng, Nianzu Yang, Xiaokang Yang, Junchi Yan

Dynamic graphs arise in various real-world applications, and it is often welcomed to model the dynamics directly in continuous time domain for its flexibility.

Dynamic Link Prediction Dynamic Node Classification +4

Predictive Experience Replay for Continual Visual Control and Forecasting

2 code implementations12 Mar 2023 Wendong Zhang, Geng Chen, Xiangming Zhu, Siyu Gao, Yunbo Wang, Xiaokang Yang

In this paper, we present a new continual learning approach for visual dynamics modeling and explore its efficacy in visual control and forecasting.

Continual Learning Model-based Reinforcement Learning +2

Recursive Generalization Transformer for Image Super-Resolution

1 code implementation11 Mar 2023 Zheng Chen, Yulun Zhang, Jinjin Gu, Linghe Kong, Xiaokang Yang

In this work, we propose the Recursive Generalization Transformer (RGT) for image SR, which can capture global spatial information and is suitable for high-resolution images.

Image Reconstruction Image Super-Resolution

Xformer: Hybrid X-Shaped Transformer for Image Denoising

1 code implementation11 Mar 2023 Jiale Zhang, Yulun Zhang, Jinjin Gu, Jiahua Dong, Linghe Kong, Xiaokang Yang

The channel-wise Transformer block performs direct global context interactions across tokens defined by channel dimension.

Decoder Image Denoising

Graph Signal Sampling for Inductive One-Bit Matrix Completion: a Closed-form Solution

1 code implementation8 Feb 2023 Chao Chen, Haoyu Geng, Gang Zeng, Zhaobing Han, Hua Chai, Xiaokang Yang, Junchi Yan

Inductive one-bit matrix completion is motivated by modern applications such as recommender systems, where new users would appear at test stage with the ratings consisting of only ones and no zeros.

Matrix Completion Recommendation Systems

Deep Learning of Partial Graph Matching via Differentiable Top-K

1 code implementation CVPR 2023 Runzhong Wang, Ziao Guo, Shaofei Jiang, Xiaokang Yang, Junchi Yan

Graph matching (GM) aims at discovering node matching between graphs, by maximizing the node- and edge-wise affinities between the matched elements.

 Ranked #1 on Graph Matching on Willow Object Class (F1 score metric)

Graph Matching Stereo Matching

3D-Aware Face Swapping

no code implementations CVPR 2023 Yixuan Li, Chao Ma, Yichao Yan, Wenhan Zhu, Xiaokang Yang

To achieve this, we take advantage of the strong geometry and texture prior of 3D human faces, where the 2D faces are projected into the latent space of a 3D generative model.

Attribute Face Swapping

A K-variate Time Series Is Worth K Words: Evolution of the Vanilla Transformer Architecture for Long-term Multivariate Time Series Forecasting

no code implementations6 Dec 2022 Zanwei Zhou, RuiZhe Zhong, Chen Yang, Yan Wang, Xiaokang Yang, Wei Shen

In this study, we point out that the current tokenization strategy in MTSF Transformer architectures ignores the token uniformity inductive bias of Transformers.

Decoder Inductive Bias +2

Adv-Attribute: Inconspicuous and Transferable Adversarial Attack on Face Recognition

no code implementations13 Oct 2022 Shuai Jia, Bangjie Yin, Taiping Yao, Shouhong Ding, Chunhua Shen, Xiaokang Yang, Chao Ma

For face recognition attacks, existing methods typically generate the l_p-norm perturbations on pixels, however, resulting in low attack transferability and high vulnerability to denoising defense models.

Adversarial Attack Attribute +2

Perceptual Attacks of No-Reference Image Quality Models with Human-in-the-Loop

1 code implementation3 Oct 2022 Weixia Zhang, Dingquan Li, Xiongkuo Min, Guangtao Zhai, Guodong Guo, Xiaokang Yang, Kede Ma

No-reference image quality assessment (NR-IQA) aims to quantify how humans perceive visual distortions of digital images without access to their undistorted references.

No-Reference Image Quality Assessment NR-IQA

Perceptual Quality Assessment of Omnidirectional Images

no code implementations6 Jul 2022 Huiyu Duan, Guangtao Zhai, Xiongkuo Min, Yucheng Zhu, Yi Fang, Xiaokang Yang

The original and distorted omnidirectional images, subjective quality ratings, and the head and eye movement data together constitute the OIQA database.

Image Quality Assessment

A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Prediction

no code implementations4 Jul 2022 Wei Shen, Zelin Peng, Xuehui Wang, Huayu Wang, Jiazhong Cen, Dongsheng Jiang, Lingxi Xie, Xiaokang Yang, Qi Tian

Next, we summarize the existing label-efficient image segmentation methods from a unified perspective that discusses an important question: how to bridge the gap between weak supervision and dense prediction -- the current methods are mostly based on heuristic priors, such as cross-pixel similarity, cross-label constraint, cross-view consistency, and cross-image relation.

Image Segmentation Instance Segmentation +2

Iso-Dream: Isolating and Leveraging Noncontrollable Visual Dynamics in World Models

2 code implementations27 May 2022 Minting Pan, Xiangming Zhu, Yunbo Wang, Xiaokang Yang

First, by optimizing the inverse dynamics, we encourage the world model to learn controllable and noncontrollable sources of spatiotemporal changes on isolated state transition branches.

Autonomous Driving Decision Making

Continual Predictive Learning from Videos

1 code implementation CVPR 2022 Geng Chen, Wendong Zhang, Han Lu, Siyu Gao, Yunbo Wang, Mingsheng Long, Xiaokang Yang

Can we develop predictive learning algorithms that can deal with more realistic, non-stationary physical environments?

Continual Learning Test-time Adaptation +1

Learning Self-Modulating Attention in Continuous Time Space with Applications to Sequential Recommendation

1 code implementation30 Mar 2022 Chao Chen, Haoyu Geng, Nianzu Yang, Junchi Yan, Daiyue Xue, Jianping Yu, Xiaokang Yang

User interests are usually dynamic in the real world, which poses both theoretical and practical challenges for learning accurate preferences from rich behavior data.

Dynamic Link Prediction Sequential Recommendation

Analysis Method of Strapdown Inertial Navigation Error Distribution Based on Covariance Matrix Decomposition

1 code implementation22 Mar 2022 Xiaokang Yang, Gongmin Yan, Fan Liu, Bofan Guan, Sihai Li

Compared with the Monte-Carlo method and other method based on covariance matrix, the proposed method uses more complete error model, considers the interaction effect of error sources and can be easily realized with less computation.

EAutoDet: Efficient Architecture Search for Object Detection

no code implementations21 Mar 2022 Xiaoxing Wang, Jiale Lin, Junchi Yan, Juanping Zhao, Xiaokang Yang

In contrast, this paper introduces an efficient framework, named EAutoDet, that can discover practical backbone and FPN architectures for object detection in 1. 4 GPU-days.

Ranked #30 on Object Detection In Aerial Images on DOTA (using extra training data)

Object object-detection +1

Facial Geometric Detail Recovery via Implicit Representation

1 code implementation18 Mar 2022 Xingyu Ren, Alexandros Lattas, Baris Gecer, Jiankang Deng, Chao Ma, Xiaokang Yang, Stefanos Zafeiriou

Learning a dense 3D model with fine-scale details from a single facial image is highly challenging and ill-posed.

ActFormer: A GAN-based Transformer towards General Action-Conditioned 3D Human Motion Generation

no code implementations ICCV 2023 Liang Xu, Ziyang Song, Dongliang Wang, Jing Su, Zhicheng Fang, Chenjing Ding, Weihao Gan, Yichao Yan, Xin Jin, Xiaokang Yang, Wenjun Zeng, Wei Wu

We present a GAN-based Transformer for general action-conditioned 3D human motion generation, including not only single-person actions but also multi-person interactive actions.

Self-supervised Implicit Glyph Attention for Text Recognition

1 code implementation CVPR 2023 Tongkun Guan, Chaochen Gu, Jingzheng Tu, Xue Yang, Qi Feng, Yudi Zhao, Xiaokang Yang, Wei Shen

Supervised attention can alleviate the above issue, but it is character category-specific, which requires extra laborious character-level bounding box annotations and would be memory-intensive when handling languages with larger character categories.

Scene Text Recognition Text Segmentation

NeuroFluid: Fluid Dynamics Grounding with Particle-Driven Neural Radiance Fields

no code implementations3 Mar 2022 Shanyan Guan, Huayu Deng, Yunbo Wang, Xiaokang Yang

Deep learning has shown great potential for modeling the physical dynamics of complex particle systems such as fluids.

DFA-NeRF: Personalized Talking Head Generation via Disentangled Face Attributes Neural Rendering

no code implementations3 Jan 2022 Shunyu Yao, RuiZhe Zhong, Yichao Yan, Guangtao Zhai, Xiaokang Yang

Specifically, neural radiance field takes lip movements features and personalized attributes as two disentangled conditions, where lip movements are directly predicted from the audio inputs to achieve lip-synchronized generation.

Neural Rendering Talking Head Generation

End-to-End Reconstruction-Classification Learning for Face Forgery Detection

1 code implementation CVPR 2022 Junyi Cao, Chao Ma, Taiping Yao, Shen Chen, Shouhong Ding, Xiaokang Yang

Reconstruction learning over real images enhances the learned representations to be aware of forgery patterns that are even unknown, while classification learning takes the charge of mining the essential discrepancy between real and fake images, facilitating the understanding of forgeries.

Classification Decoder

Learning Invisible Markers for Hidden Codes in Offline-to-Online Photography

no code implementations CVPR 2022 Jun Jia, Zhongpai Gao, Dandan Zhu, Xiongkuo Min, Guangtao Zhai, Xiaokang Yang

In addition, the automatic localization of hidden codes significantly reduces the time of manually correcting geometric distortions for photos, which is a revolutionary innovation for information hiding in mobile applications.

A General Framework for Evaluating Robustness of Combinatorial Optimization Solvers on Graphs

no code implementations28 Dec 2021 Han Lu, Zenan Li, Runzhong Wang, Qibing Ren, Junchi Yan, Xiaokang Yang

Solving combinatorial optimization (CO) on graphs is among the fundamental tasks for upper-stream applications in data mining, machine learning and operations research.

Adversarial Attack Combinatorial Optimization

TAL: Two-stream Adaptive Learning for Generalizable Person Re-identification

no code implementations29 Nov 2021 Yichao Yan, Junjie Li, Shengcai Liao, Jie Qin, Bingbing Ni, Xiaokang Yang

In the meantime, we design an adaptive BN layer in the domain-invariant stream, to approximate the statistics of various unseen domains.

Domain Generalization Generalizable Person Re-identification +1

Consensus Synergizes with Memory: A Simple Approach for Anomaly Segmentation in Urban Scenes

no code implementations24 Nov 2021 Jiazhong Cen, Zenkun Jiang, Lingxi Xie, Qi Tian, Xiaokang Yang, Wei Shen

Anomaly segmentation is a crucial task for safety-critical applications, such as autonomous driving in urban scenes, where the goal is to detect out-of-distribution (OOD) objects with categories which are unseen during training.

Anomaly Detection Autonomous Driving +1

Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptation

1 code implementation7 Nov 2021 Shanyan Guan, Jingwei Xu, Michelle Z. He, Yunbo Wang, Bingbing Ni, Xiaokang Yang

We consider a new problem of adapting a human mesh reconstruction model to out-of-domain streaming videos, where performance of existing SMPL-based models are significantly affected by the distribution shift represented by different camera parameters, bone lengths, backgrounds, and occlusions.

3D Absolute Human Pose Estimation Bilevel Optimization

ZARTS: On Zero-order Optimization for Neural Architecture Search

no code implementations10 Oct 2021 Xiaoxing Wang, Wenxuan Guo, Junchi Yan, Jianlin Su, Xiaokang Yang

Also, we search on the search space of DARTS to compare with peer methods, and our discovered architecture achieves 97. 54% accuracy on CIFAR-10 and 75. 7% top-1 accuracy on ImageNet, which are state-of-the-art performance.

Neural Architecture Search

DAAS: Differentiable Architecture and Augmentation Policy Search

no code implementations30 Sep 2021 Xiaoxing Wang, Xiangxiang Chu, Junchi Yan, Xiaokang Yang

Neural architecture search (NAS) has been an active direction of automatic machine learning (Auto-ML), aiming to explore efficient network structures.

Data Augmentation Neural Architecture Search

Zero-CL: Instance and Feature decorrelation for negative-free symmetric contrastive learning

no code implementations ICLR 2022 Shaofeng Zhang, Feng Zhu, Junchi Yan, Rui Zhao, Xiaokang Yang

The proposed two methods (FCL, ICL) can be combined synthetically, called Zero-CL, where ``Zero'' means negative samples are \textbf{zero} relevant, which allows Zero-CL to completely discard negative pairs i. e., with \textbf{zero} negative samples.

Contrastive Learning

On Learning to Solve Cardinality Constrained Combinatorial Optimization in One-Shot: A Re-parameterization Approach via Gumbel-Sinkhorn-TopK

no code implementations29 Sep 2021 Runzhong Wang, Li Shen, Yiting Chen, Junchi Yan, Xiaokang Yang, DaCheng Tao

Cardinality constrained combinatorial optimization requires selecting an optimal subset of $k$ elements, and it will be appealing to design data-driven algorithms that perform TopK selection over a probability distribution predicted by a neural network.

Combinatorial Optimization One-Shot Learning +1

Efficient Person Search: An Anchor-Free Approach

4 code implementations1 Sep 2021 Yichao Yan, Jinpeng Li, Jie Qin, Shengcai Liao, Xiaokang Yang

Third, by investigating the advantages of both anchor-based and anchor-free models, we further augment AlignPS with an ROI-Align head, which significantly improves the robustness of re-id features while still keeping our model highly efficient.

Person Search

Task-Specific Normalization for Continual Learning of Blind Image Quality Models

2 code implementations28 Jul 2021 Weixia Zhang, Kede Ma, Guangtao Zhai, Xiaokang Yang

In this paper, we present a simple yet effective continual learning method for blind image quality assessment (BIQA) with improved quality prediction accuracy, plasticity-stability trade-off, and task-order/-length robustness.

Blind Image Quality Assessment Continual Learning

PointAugmenting: Cross-Modal Augmentation for 3D Object Detection

no code implementations CVPR 2021 Chunwei Wang, Chao Ma, Ming Zhu, Xiaokang Yang

On one hand, PointAugmenting decorates point clouds with corresponding point-wise CNN features extracted by pretrained 2D detection models, and then performs 3D object detection over the decorated point clouds.

3D Object Detection Autonomous Driving +4

Context-Aware Image Inpainting with Learned Semantic Priors

1 code implementation14 Jun 2021 Wendong Zhang, Junwei Zhu, Ying Tai, Yunbo Wang, Wenqing Chu, Bingbing Ni, Chengjie Wang, Xiaokang Yang

Based on the semantic priors, we further propose a context-aware image inpainting model, which adaptively integrates global semantics and local features in a unified image generator.

Image Inpainting Knowledge Distillation

Making CNNs Interpretable by Building Dynamic Sequential Decision Forests with Top-down Hierarchy Learning

no code implementations5 Jun 2021 Yilin Wang, Shaozuo Yu, Xiaokang Yang, Wei Shen

In this paper, we propose a generic model transfer scheme to make Convlutional Neural Networks (CNNs) interpretable, while maintaining their high classification accuracy.

Classification

Scalable and Explainable 1-Bit Matrix Completion via Graph Signal Learning

1 code implementation AAAI 2021 Chao Chen, Dongsheng Li, Junchi Yan, Hanchi Huang, Xiaokang Yang

One-bit matrix completion is an important class of positiveunlabeled (PU) learning problems where the observations consist of only positive examples, eg, in top-N recommender systems.

Collaborative Ranking Matrix Completion +1

Learning Multi-Attention Context Graph for Group-Based Re-Identification

1 code implementation29 Apr 2021 Yichao Yan, Jie Qin, Bingbing Ni, Jiaxin Chen, Li Liu, Fan Zhu, Wei-Shi Zheng, Xiaokang Yang, Ling Shao

Extensive experiments on the novel dataset as well as three existing datasets clearly demonstrate the effectiveness of the proposed framework for both group-based re-id tasks.

Person Re-Identification

Bilevel Online Adaptation for Out-of-Domain Human Mesh Reconstruction

1 code implementation CVPR 2021 Shanyan Guan, Jingwei Xu, Yunbo Wang, Bingbing Ni, Xiaokang Yang

This paper considers a new problem of adapting a pre-trained model of human mesh reconstruction to out-of-domain streaming videos.

3D Human Pose Estimation

Learning Comprehensive Motion Representation for Action Recognition

no code implementations23 Mar 2021 Mingyu Wu, Boyuan Jiang, Donghao Luo, Junchi Yan, Yabiao Wang, Ying Tai, Chengjie Wang, Jilin Li, Feiyue Huang, Xiaokang Yang

For action recognition learning, 2D CNN-based methods are efficient but may yield redundant features due to applying the same 2D convolution kernel to each frame.

Action Recognition

Continual Learning for Blind Image Quality Assessment

1 code implementation19 Feb 2021 Weixia Zhang, Dingquan Li, Chao Ma, Guangtao Zhai, Xiaokang Yang, Kede Ma

In this paper, we formulate continual learning for BIQA, where a model learns continually from a stream of IQA datasets, building on what was learned from previously seen data.

Blind Image Quality Assessment Continual Learning

Learning Interpretable Deep State Space Model for Probabilistic Time Series Forecasting

no code implementations31 Jan 2021 Longyuan Li, Junchi Yan, Xiaokang Yang, Yaohui Jin

We propose a deep state space model for probabilistic time series forecasting whereby the non-linear emission model and transition model are parameterized by networks and the dependency is modeled by recurrent neural nets.

Decision Making Management +2

Self-supervised representation learning via adaptive hard-positive mining

no code implementations1 Jan 2021 Shaofeng Zhang, Junchi Yan, Xiaokang Yang

Despite their success in perception over the last decade, deep neural networks are also known ravenous to labeled data for training, which limits their applicability to real-world problems.

Contrastive Learning Representation Learning +1

Rethinking Pseudo-labeled Sample Mining for Semi-Supervised Object Detection

no code implementations1 Jan 2021 Duo Li, Sanli Tang, Zhanzhan Cheng, ShiLiang Pu, Yi Niu, Wenming Tan, Fei Wu, Xiaokang Yang

However, the impact of the pseudo-labeled samples' quality as well as the mining strategies for high quality training sample have rarely been studied in SSL.

object-detection Object Detection +1

Graduated Assignment for Joint Multi-Graph Matching and Clustering with Application to Unsupervised Graph Matching Network Learning

1 code implementation NeurIPS 2020 Runzhong Wang, Junchi Yan, Xiaokang Yang

This paper considers the setting of jointly matching and clustering multiple graphs belonging to different groups, which naturally rises in many realistic problems.

Clustering Graph Matching

Combinatorial Learning of Graph Edit Distance via Dynamic Embedding

no code implementations CVPR 2021 Runzhong Wang, Tianqi Zhang, Tianshu Yu, Junchi Yan, Xiaokang Yang

This paper presents a hybrid approach by combing the interpretability of traditional search-based techniques for producing the edit path, as well as the efficiency and adaptivity of deep embedding models to achieve a cost-effective GED solver.

ROME: Robustifying Memory-Efficient NAS via Topology Disentanglement and Gradient Accumulation

no code implementations ICCV 2023 Xiaoxing Wang, Xiangxiang Chu, Yuda Fan, Zhexi Zhang, Bo Zhang, Xiaokang Yang, Junchi Yan

Albeit being a prevalent architecture searching approach, differentiable architecture search (DARTS) is largely hindered by its substantial memory cost since the entire supernet resides in the memory.

Disentanglement Neural Architecture Search

Language-guided Navigation via Cross-Modal Grounding and Alternate Adversarial Learning

no code implementations22 Nov 2020 Weixia Zhang, Chao Ma, Qi Wu, Xiaokang Yang

We then propose to recursively alternate the learning schemes of imitation and exploration to narrow the discrepancy between training and inference.

Imitation Learning Navigate +1

Hierarchical Style-based Networks for Motion Synthesis

no code implementations ECCV 2020 Jingwei Xu, Huazhe Xu, Bingbing Ni, Xiaokang Yang, Xiaolong Wang, Trevor Darrell

Generating diverse and natural human motion is one of the long-standing goals for creating intelligent characters in the animated world.

Motion Synthesis

Cross-Modality 3D Object Detection

no code implementations16 Aug 2020 Ming Zhu, Chao Ma, Pan Ji, Xiaokang Yang

In this paper, we focus on exploring the fusion of images and point clouds for 3D object detection in view of the complementary nature of the two modalities, i. e., images possess more semantic information while point clouds specialize in distance sensing.

3D Classification 3D Object Detection +4

Robust Tracking against Adversarial Attacks

2 code implementations ECCV 2020 Shuai Jia, Chao Ma, Yibing Song, Xiaokang Yang

On one hand, we add the temporal perturbations into the original video sequences as adversarial examples to greatly degrade the tracking performance.

Adversarial Attack

Semantic Equivalent Adversarial Data Augmentation for Visual Question Answering

1 code implementation ECCV 2020 Ruixue Tang, Chao Ma, Wei Emma Zhang, Qi Wu, Xiaokang Yang

However, there are few works studying the data augmentation problem for VQA and none of the existing image based augmentation schemes (such as rotation and flipping) can be directly applied to VQA due to its semantic structure -- an $\langle image, question, answer\rangle$ triplet needs to be maintained correctly.

Adversarial Attack Data Augmentation +2

Video Prediction via Example Guidance

1 code implementation ICML 2020 Jingwei Xu, Huazhe Xu, Bingbing Ni, Xiaokang Yang, Trevor Darrell

In video prediction tasks, one major challenge is to capture the multi-modal nature of future contents and dynamics.

Video Prediction

Collaborative Learning for Faster StyleGAN Embedding

no code implementations3 Jul 2020 Shanyan Guan, Ying Tai, Bingbing Ni, Feida Zhu, Feiyue Huang, Xiaokang Yang

The latent code of the recent popular model StyleGAN has learned disentangled representations thanks to the multi-layer style-based generator.

Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wild

1 code implementation28 May 2020 Weixia Zhang, Kede Ma, Guangtao Zhai, Xiaokang Yang

Nevertheless, due to the distributional shift between images simulated in the laboratory and captured in the wild, models trained on databases with synthetic distortions remain particularly weak at handling realistic distortions (and vice versa).

Blind Image Quality Assessment Learning-To-Rank

Permutation Matters: Anisotropic Convolutional Layer for Learning on Point Clouds

1 code implementation27 May 2020 Zhongpai Gao, Guangtao Zhai, Junchi Yan, Xiaokang Yang

Various point neural networks have been developed with isotropic filters or using weighting matrices to overcome the structure inconsistency on point clouds.

Representation Learning Semantic Segmentation

Toward Better Understanding of Saliency Prediction in Augmented 360 Degree Videos

no code implementations12 Dec 2019 Yucheng Zhu, Xiongkuo Min, Dandan Zhu, Ke Gu, Jiantao Zhou, Guangtao Zhai, Xiaokang Yang, Wenjun Zhang

The saliency annotations of head and eye movements for both original and augmented videos are collected and together constitute the ARVR dataset.

Object Recognition Optical Flow Estimation +1

Robust Invisible Hyperlinks in Physical Photographs Based on 3D Rendering Attacks

no code implementations3 Dec 2019 Jun Jia, Zhongpai Gao, Kang Chen, Menghan Hu, Guangtao Zhai, Guodong Guo, Xiaokang Yang

To train a robust decoder against the physical distortion from the real world, a distortion network based on 3D rendering is inserted between the encoder and the decoder to simulate the camera imaging process.

Decoder

Decoding Spiking Mechanism with Dynamic Learning on Neuron Population

no code implementations21 Nov 2019 Zhijie Chen, Junchi Yan, Longyuan Li, Xiaokang Yang

Our model is aimed to reconstruct neuron information while inferring representations of neuron spiking states.

Deep Unsupervised Clustering with Clustered Generator Model

no code implementations19 Nov 2019 Dandan Zhu, Tian Han, Linqi Zhou, Xiaokang Yang, Ying Nian Wu

We propose the clustered generator model for clustering which contains both continuous and discrete latent variables.

Clustering

Composable Semi-parametric Modelling for Long-range Motion Generation

no code implementations25 Sep 2019 Jingwei Xu, Huazhe Xu, Bingbing Ni, Xiaokang Yang, Trevor Darrell

Learning diverse and natural behaviors is one of the longstanding goal for creating intelligent characters in the animated world.

Semi-supervised 3D Face Reconstruction with Nonlinear Disentangled Representations

no code implementations25 Sep 2019 Zhongpai Gao, Juyong Zhang, Yudong Guo, Chao Ma, Guangtao Zhai, Xiaokang Yang

Moreover, the identity and expression representations are entangled in these models, which hurdles many facial editing applications.

3D Face Reconstruction Facial Editing

Learning to Blindly Assess Image Quality in the Laboratory and Wild

1 code implementation1 Jul 2019 Weixia Zhang, Kede Ma, Guangtao Zhai, Xiaokang Yang

Computational models for blind image quality assessment (BIQA) are typically trained in well-controlled laboratory environments with limited generalizability to realistically distorted images.

Blind Image Quality Assessment Learning-To-Rank

Gated-GAN: Adversarial Gated Networks for Multi-Collection Style Transfer

2 code implementations4 Apr 2019 Xinyuan Chen, Chang Xu, Xiaokang Yang, Li Song, DaCheng Tao

We propose adversarial gated networks (Gated GAN) to transfer multiple styles in a single model.

Decoder Style Transfer

Learning Combinatorial Embedding Networks for Deep Graph Matching

1 code implementation ICCV 2019 Runzhong Wang, Junchi Yan, Xiaokang Yang

In addition with its NP-completeness nature, another important challenge is effective modeling of the node-wise and structure-wise affinity across graphs and the resulting objective, to guide the matching procedure effectively finding the true matching against noises.

Graph Embedding Graph Matching

Video Prediction via Selective Sampling

1 code implementation NeurIPS 2018 Jingwei Xu, Bingbing Ni, Xiaokang Yang

Most adversarial learning based video prediction methods suffer from image blur, since the commonly used adversarial and regression loss pair work rather in a competitive way than collaboration, yielding compromised blur effect.

Multiple-choice Video Prediction

Correlation Propagation Networks for Scene Text Detection

no code implementations30 Sep 2018 Zichuan Liu, Guosheng Lin, Wang Ling Goh, Fayao Liu, Chunhua Shen, Xiaokang Yang

In this work, we propose a novel hybrid method for scene text detection namely Correlation Propagation Network (CPN).

Scene Text Detection Text Detection

Deep Regression Tracking with Shrinkage Loss

1 code implementation ECCV 2018 Xiankai Lu, Chao Ma, Bingbing Ni, Xiaokang Yang, Ian Reid, Ming-Hsuan Yang

Regression trackers directly learn a mapping from regularly dense samples of target objects to soft labels, which are usually generated by a Gaussian function, to estimate target positions.

regression

Structure Preserving Video Prediction

no code implementations CVPR 2018 Jingwei Xu, Bingbing Ni, Zefan Li, Shuo Cheng, Xiaokang Yang

Despite recent emergence of adversarial based methods for video prediction, existing algorithms often produce unsatisfied results in image regions with rich structural information (i. e., object boundary) and detailed motion (i. e., articulated body movement).

Object Video Prediction

Fine-Grained Video Captioning for Sports Narrative

no code implementations CVPR 2018 Huanyu Yu, Shuo Cheng, Bingbing Ni, Minsi Wang, Jian Zhang, Xiaokang Yang

First, to facilitate this novel research of fine-grained video caption, we collected a novel dataset called Fine-grained Sports Narrative dataset (FSN) that contains 2K sports videos with ground-truth narratives from YouTube. com.

2k Video Captioning

Multiple Granularity Group Interaction Prediction

no code implementations CVPR 2018 Taiping Yao, Minsi Wang, Bingbing Ni, Huawei Wei, Xiaokang Yang

Most human activity analysis works (i. e., recognition or prediction) only focus on a single granularity, i. e., either modelling global motion based on the coarse level movement such as human trajectories or forecasting future detailed action based on body parts’ movement such as skeleton motion.

Crowd Counting via Adversarial Cross-Scale Consistency Pursuit

1 code implementation CVPR 2018 Zan Shen, Yi Xu, Bingbing Ni, Minsi Wang, Jianguo Hu, Xiaokang Yang

Crowd counting or density estimation is a challenging task in computer vision due to large scale variations, perspective distortions and serious occlusions, etc.

Crowd Counting Density Estimation

Decoupled Learning for Factorial Marked Temporal Point Processes

no code implementations21 Jan 2018 Weichang Wu, Junchi Yan, Xiaokang Yang, Hongyuan Zha

In conventional (multi-dimensional) marked temporal point process models, event is often encoded by a single discrete variable i. e. a marker.

Point Processes

Terahertz Security Image Quality Assessment by No-reference Model Observers

no code implementations12 Jul 2017 Menghan Hu, Xiongkuo Min, Guangtao Zhai, Wenhan Zhu, Yucheng Zhu, Zhaodi Wang, Xiaokang Yang, Guang Tian

Subsequently, the existing no-reference IQA algorithms, which were 5 opinion-aware approaches viz., NFERM, GMLF, DIIVINE, BRISQUE and BLIINDS2, and 8 opinion-unaware approaches viz., QAC, SISBLIM, NIQE, FISBLIM, CPBD, S3 and Fish_bb, were executed for the evaluation of the THz security image quality.

Image Quality Assessment

Robust Visual Tracking via Hierarchical Convolutional Features

1 code implementation12 Jul 2017 Chao Ma, Jia-Bin Huang, Xiaokang Yang, Ming-Hsuan Yang

Specifically, we learn adaptive correlation filters on the outputs from each convolutional layer to encode the target appearance.

Object Recognition Visual Tracking

Adaptive Correlation Filters with Long-Term and Short-Term Memory for Object Tracking

1 code implementation7 Jul 2017 Chao Ma, Jia-Bin Huang, Xiaokang Yang, Ming-Hsuan Yang

Second, we learn a correlation filter over a feature pyramid centered at the estimated target position for predicting scale changes.

Object Tracking Position

Recurrent Modeling of Interaction Context for Collective Activity Recognition

no code implementations CVPR 2017 Minsi Wang, Bingbing Ni, Xiaokang Yang

However, most of the previous activity recognition methods do not offer a flexible and scalable scheme to handle the high order context modeling problem.

Descriptive Group Activity Recognition

Image Matching via Loopy RNN

no code implementations10 Jun 2017 Donghao Luo, Bingbing Ni, Yichao Yan, Xiaokang Yang

Towards this end, we propose a novel loopy recurrent neural network (Loopy RNN), which is capable of aggregating relationship information of two input images in a progressive/iterative manner and outputting the consolidated matching score in the final iteration.

Depth Structure Preserving Scene Image Generation

no code implementations1 Jun 2017 Wendong Zhang, Bingbing Ni, Yichao Yan, Jingwei Xu, Xiaokang Yang

Key to automatically generate natural scene images is to properly arrange among various spatial elements, especially in the depth direction.

Image Generation Scene Generation

Predicting Human Interaction via Relative Attention Model

no code implementations26 May 2017 Yichao Yan, Bingbing Ni, Xiaokang Yang

Predicting human interaction is challenging as the on-going activity has to be inferred based on a partially observed video.

Modeling The Intensity Function Of Point Process Via Recurrent Neural Networks

2 code implementations24 May 2017 Shuai Xiao, Junchi Yan, Stephen M. Chu, Xiaokang Yang, Hongyuan Zha

In this paper, we model the background by a Recurrent Neural Network (RNN) with its units aligned with time series indexes while the history effect is modeled by another RNN whose units are aligned with asynchronous events to capture the long-range dynamics.

Point Processes Time Series +1