no code implementations • 6 Feb 2017 • Xinyu Li, Yanyi Zhang, Jianyu Zhang, Shuhong Chen, Ivan Marsic, Richard A. Farneth, Randall S. Burd
Our system is the first to address the concurrent activity recognition with multisensory data using a single model, which is scalable, simple to train and easy to deploy.
no code implementations • 10 Feb 2017 • Xinyu Li, Yanyi Zhang, Ivan Marsic, Randall S. Burd
We introduce a novel, accurate and practical system for real-time people tracking and identification.
no code implementations • 11 Feb 2017 • Bing Zeng, Liang Gao, Xinyu Li
Increasing nature-inspired metaheuristic algorithms are applied to solving the real-world optimization problems, as they have some advantages over the classical methods of numerical optimization.
no code implementations • 28 Feb 2017 • Xinyu Li, Yanyi Zhang, Jianyu Zhang, Yueyang Chen, Shuhong Chen, Yue Gu, Moliang Zhou, Richard A. Farneth, Ivan Marsic, Randall S. Burd
For the Olympic swimming dataset, our system achieved an accuracy of 88%, an F1-score of 0. 58, a completeness estimation error of 6. 3% and a remaining-time estimation error of 2. 9 minutes.
no code implementations • 9 Apr 2018 • Bing Zeng, Xinyu Li, Liang Gao, Yuyan Zhang, Haozhen Dong
However, there are two difficulties urgently to be solved for most existing niching metaheuristic algorithms: how to set the optimal values of niching parameters for different optimization problems, and how to jump out of the local optima efficiently.
no code implementations • ACL 2018 • Yue Gu, Kangning Yang, Shiyu Fu, Shuhong Chen, Xinyu Li, Ivan Marsic
Multimodal affective computing, learning to recognize and interpret human affects and subjective information from multiple data sources, is still challenging because: (i) it is hard to extract informative features to represent human affects from heterogeneous inputs; (ii) current fusion strategies only fuse different modalities at abstract level, ignoring time-dependent interactions between modalities.
no code implementations • COLING 2018 • Yue Gu, Kangning Yang, Shiyu Fu, Shuhong Chen, Xinyu Li, Ivan Marsic
The proposed hybrid attention architecture helps the system focus on learning informative representations for both modality-specific feature extraction and model fusion.
no code implementations • 29 Oct 2018 • Haozhen Dong, Liang Gao, Xinyu Li, Haoran Zhong, Bing Zeng
Differential evolution(DE) is a conventional algorithm with fast convergence speed.
no code implementations • 6 Dec 2018 • Yanyi Zhang, Xinyu Li, Kaixiang Huang, Yehan Wang, Shuhong Chen, Ivan Marsic
We present a system for concurrent activity recognition.
no code implementations • 20 Apr 2019 • Xinyu Li, Wei zhang, Tong Shen, Tao Mei
Selfie and cartoon are two popular artistic forms that are widely presented in our daily life.
1 code implementation • 18 May 2019 • Dongfang Li, Yifei Yu, Qingcai Chen, Xinyu Li
we are the first to explore the performance of fine-tuning BERT for answer selection.
no code implementations • 2 Apr 2020 • Lam Hui, Austin Joyce, Michael J. Landry, Xinyu Li
(4) The density near a vortex scales as $r^2$ while the velocity goes as $1/r$, where $r$ is the distance to vortex.
Cosmology and Nongalactic Astrophysics Astrophysics of Galaxies General Relativity and Quantum Cosmology High Energy Physics - Phenomenology High Energy Physics - Theory
no code implementations • ECCV 2020 • Xinyu Li, Bing Shuai, Joseph Tighe
Many current activity recognition models use 3D convolutional neural networks (e. g. I3D, I3D-NL) to generate local spatial-temporal features.
no code implementations • CVPR 2021 • Yanyi Zhang, Xinyu Li, Ivan Marsic
Multi-label activity recognition is designed for recognizing multiple activities that are performed simultaneously or sequentially in each video.
1 code implementation • 11 Dec 2020 • Yi Zhu, Xinyu Li, Chunhui Liu, Mohammadreza Zolfaghari, Yuanjun Xiong, Chongruo wu, Zhi Zhang, Joseph Tighe, R. Manmatha, Mu Li
Video action recognition is one of the representative tasks for video understanding.
no code implementations • 15 Dec 2020 • Xinyu Li, Chunhui Liu, Bing Shuai, Yi Zhu, Hao Chen, Joseph Tighe
In the world of action recognition research, one primary focus has been on how to construct and train networks to model the spatial-temporal volume of an input video.
no code implementations • 16 Dec 2020 • Xiaonan Liu, Xinyu Li, Yansha Deng
While for the online learning algorithm, based on the VR user's actual viewpoint delivered through uplink transmission, we compare it with the predicted viewpoint and update the parameters of the online learning algorithm to further improve the prediction accuracy.
1 code implementation • IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS 2021 • Qian Wan, Liang Gao, Xinyu Li, long wen
Anomaly localization is valuable for improvement of complex production processing in smart manufacturing system.
Ranked #66 on Anomaly Detection on MVTec AD
no code implementations • ICCV 2021 • Chunhui Liu, Xinyu Li, Hao Chen, Davide Modolo, Joseph Tighe
In this work, we focus on improving the inference efficiency of current action recognition backbones on trimmed videos, and illustrate that one action model can also cover then informative region by dropping non-informative features.
1 code implementation • CVPR 2022 • Jiaojiao Zhao, Yanyi Zhang, Xinyu Li, Hao Chen, Shuai Bing, Mingze Xu, Chunhui Liu, Kaustav Kundu, Yuanjun Xiong, Davide Modolo, Ivan Marsic, Cees G. M. Snoek, Joseph Tighe
We propose TubeR: a simple solution for spatio-temporal video action detection.
no code implementations • ICCV 2021 • Yanyi Zhang, Xinyu Li, Chunhui Liu, Bing Shuai, Yi Zhu, Biagio Brattoli, Hao Chen, Ivan Marsic, Joseph Tighe
We first introduce the vanilla video transformer and show that transformer module is able to perform spatio-temporal modeling from raw pixels, but with heavy memory usage.
Ranked #15 on Action Classification on Charades
no code implementations • 17 May 2021 • Haotian Gu, Xin Guo, Xinyu Li
Adversarial training has gained great popularity as one of the most effective defenses for deep neural network and more generally for gradient-based machine learning models against adversarial perturbations on data points.
1 code implementation • CVPR 2021 • Bing Shuai, Andrew Berneshawi, Xinyu Li, Davide Modolo, Joseph Tighe
In this paper, we focus on improving online multi-object tracking (MOT).
no code implementations • 29 May 2021 • Zhe Wang, Hao Chen, Xinyu Li, Chunhui Liu, Yuanjun Xiong, Joseph Tighe, Charless Fowlkes
However, it is quite expensive to annotate every frame in a large corpus of videos to construct a comprehensive supervised training dataset.
2 code implementations • NeurIPS 2021 • Mingze Xu, Yuanjun Xiong, Hao Chen, Xinyu Li, Wei Xia, Zhuowen Tu, Stefano Soatto
We present Long Short-term TRansformer (LSTR), a temporal modeling algorithm for online action detection, which employs a long- and short-term memory mechanism to model prolonged sequence data.
Ranked #3 on Online Action Detection on TVSeries
1 code implementation • 5 Aug 2021 • Haofei Kuang, Yi Zhu, Zhi Zhang, Xinyu Li, Joseph Tighe, Sören Schwertfeger, Cyrill Stachniss, Mu Li
Our formulation is able to capture global context in a video, thus robust to temporal content change.
1 code implementation • IEEE Transactions on Industrial Informatics 2021 • Qian Wan, Liang Gao, Xinyu Li, long wen
This paper proposes a novel framework, named as Pre-trained Feature Mapping (PFM), for unsupervised image anomaly detection and segmentation.
Ranked #48 on Anomaly Detection on MVTec AD
no code implementations • 7 Sep 2021 • Jin Xie, Xinyu Li, Liang Gao, Lin Gui
According to the above finding, this paper proposes a new N8 neighborhood structure considering the movement of critical operations within a critical block and the movement of critical operations outside the critical block.
no code implementations • CVPR 2022 • Bing Shuai, Xinyu Li, Kaustav Kundu, Joseph Tighe
In this work, we explore training such a model by only using person box annotations, thus removing the necessity of manually labeling a training dataset with additional person identity annotation as these are expensive to collect.
no code implementations • 9 Feb 2022 • Xinyu Li, Yang Xu, Xiaohu Zhang, Wenzhong Shi, Yang Yue, Qingquan Li
As an important task for the management of bike sharing systems, accurate forecast of travel demand could facilitate dispatch and relocation of bicycles to improve user satisfaction.
no code implementations • 19 Feb 2022 • Xinyu Li, Yuanhao Cui, J. Andrew Zhang, Fan Liu, Daqing Zhang, Lajos Hanzo
In this article, we provide a review of human related sensing in the context of ISAC.
1 code implementation • CVPR 2022 • Feng Cheng, Mingze Xu, Yuanjun Xiong, Hao Chen, Xinyu Li, Wei Li, Wei Xia
We propose a memory efficient method, named Stochastic Backpropagation (SBP), for training deep neural networks on videos.
no code implementations • CVPR 2022 • A S M Iftekhar, Hao Chen, Kaustav Kundu, Xinyu Li, Joseph Tighe, Davide Modolo
We propose a novel one-stage Transformer-based semantic and spatial refined transformer (SSRT) to solve the Human-Object Interaction detection task, which requires to localize humans and objects, and predicts their interactions.
1 code implementation • 2022 IEEE 18th International Conference on Automation Science and Engineering (CASE) 2022 • Qian Wan, Yunkang Cao, Liang Gao, Weiming Shen, Xinyu Li
Image anomaly detection is an important stage for automatic visual inspection in intelligent manufacturing systems.
Ranked #8 on Anomaly Detection on MVTec AD (Segmentation AUPRO metric)
1 code implementation • 24 Jul 2022 • Xinyu Li
Machine sound classification has been one of the fundamental tasks of music technology.
1 code implementation • 1 Sep 2022 • Chen Sun, Liang Gao, Xinyu Li, Yiping Gao
The proposed DKAN method follows a pretraining-finetuning transfer learning paradigm and a knowledge distillation framework is designed for fine-tuning.
no code implementations • 25 Sep 2022 • Xinyu Li, Zihan Tang
We implement traditional machine learning and deep learning methods for global tweets from 2017-2022 to build a high-frequency measure of the public's sentiment index on inflation and analyze its correlation with other online data sources such as google trend and market-oriented inflation index.
no code implementations • 1 Nov 2022 • Xinyu Li, Yilin Li, Qing Cui, Longfei Li, Jun Zhou
In the era of big data, the explosive growth of multi-source heterogeneous data offers many exciting challenges and opportunities for improving the inference of conditional average treatment effects.
no code implementations • 22 Nov 2022 • Xinyu Li
Over the past decades, breakthroughs such as Reinforcement Learning (RL) and Agent-based modeling (ABM) have made simulations of economic models feasible.
no code implementations • 13 Mar 2023 • David Fan, Deyu Yang, Xinyu Li, Vimal Bhat, Rohith MV
Contrastive learning has recently narrowed the gap between self-supervised and supervised methods in image and video domain.
no code implementations • 17 Mar 2023 • Lixiang Yan, Lele Sha, Linxuan Zhao, Yuheng Li, Roberto Martinez-Maldonado, Guanliang Chen, Xinyu Li, Yueqiao Jin, Dragan Gašević
Educational technology innovations leveraging large language models (LLMs) have shown the potential to automate the laborious process of generating and analysing textual content.
no code implementations • 20 Mar 2023 • Xinyu Li
This study rigorously investigates the Keynesian cross model of a national economy with a focus on the dynamic relationship between government spending and economic equilibrium.
1 code implementation • CVPR 2023 • Yuxiao Chen, Jianbo Yuan, Yu Tian, Shijie Geng, Xinyu Li, Ding Zhou, Dimitris N. Metaxas, Hongxia Yang
However, direct aligning cross-modal information using such representations is challenging, as visual patches and text tokens differ in semantic levels and granularities.
1 code implementation • 1 May 2023 • Xinyu Li
Music information retrieval (MIR) has gone through an explosive development with the advancement of deep learning in recent years.
no code implementations • 18 May 2023 • Xinyu Li, Jianjun Xu, Wenquan Cui, Haoyang Cheng
Considering the case where the response variable is a categorical variable and the predictor is a random function, two novel functional sufficient dimensional reduction (FSDR) methods are proposed based on mutual information and square loss mutual information.
no code implementations • 21 May 2023 • Xin Guo, Xinyu Li, Chinmay Maheshwari, Shankar Sastry, Manxi Wu
In this new framework, Markov games are shown to be Markov $\alpha$-potential games, and the existence of an associated $\alpha$-potential function is established.
no code implementations • 22 Jun 2023 • Xinyu Li
And many watermark attack algorithms only care about interfering with the normal extraction of the watermark, and the watermark attack will cause great visual loss to the image.
no code implementations • 22 Jul 2023 • Yuwen Zhai, Jing Hao, Liang Gao, Xinyu Li, Yiping Gao, Shumin Han
The hybrid model of self-attention and convolution is one of the methods to lighten ViT.
no code implementations • ICCV 2023 • Najmeh Sadoughi, Xinyu Li, Avijit Vajpayee, David Fan, Bing Shuai, Hector Santos-Villalobos, Vimal Bhat, Rohith MV
Previous research has studied the task of segmenting cinematic videos into scenes and into narrative acts.
no code implementations • ICCV 2023 • David Fan, Jue Wang, Shuai Liao, Yi Zhu, Vimal Bhat, Hector Santos-Villalobos, Rohith MV, Xinyu Li
This suggests that the random masking strategy that is inherited from the image MAE is less effective for video MAE.
1 code implementation • 17 Oct 2023 • Xinyu Li, Yao Xiao, Yuchen Zhou
Performing SPLEE to obtain a high-dimensional embedding of the large-scale graph and then using t-SGNE to reduce its dimension for visualization, we are able to visualize graphs with up to 300K nodes and 1M edges within 5 minutes and achieve approximately 10% improvement in visualization quality.
no code implementations • 14 Nov 2023 • Xinyu Li, Jian Wei You, Ze Gu, Qian Ma, Long Chen, Jingyuan Zhang, Shi Jin, Tie Jun Cui
Reconfigurable intelligent surfaces (RISs) have flexible and exceptional performance in manipulating electromagnetic waves and customizing wireless channels.
no code implementations • 23 Nov 2023 • Xin Guo, Xinyu Li, Renyuan Xu
This paper proposes and analyzes two new policy learning methods: regularized policy gradient (RPG) and iterative policy optimization (IPO), for a class of discounted linear-quadratic control (LQC) problems over an infinite time horizon with entropy regularization.
no code implementations • 10 Jan 2024 • Haotian Gu, Xin Guo, Timothy L. Jacobs, Philip Kaminsky, Xinyu Li
Freight transportation marketplace rates are typically challenging to forecast accurately.
no code implementations • 15 Jan 2024 • Xinyu Li, Jian Wei You, Ze Gu, Qian Ma, Jingyuan Zhang, Long Chen, Tie Jun Cui
Passive human sensing using wireless signals has attracted increasing attention due to its superiorities of non-contact and robustness in various lighting conditions.
no code implementations • 6 Feb 2024 • Xinyu Li, Zachary C. Lipton, Liu Leqi
Reinforcement Learning from Human Feedback (RLHF) is the current dominating framework to fine-tune large language models to better align with human preferences.
no code implementations • NAACL 2022 • Zijie Zeng, Xinyu Li, Dragan Gasevic, Guanliang Chen
Deep Learning (DL) techniques have been increasingly adopted for Automatic Text Scoring in education.
1 code implementation • LREC 2022 • Yuru Jiang, Yang Xu, Yuhang Zhan, WeiKai He, Yilin Wang, Zixuan Xi, Meiyun Wang, Xinyu Li, Yu Li, Yanchao Yu
We describe a new freely available Chinese multi-party dialogue dataset for automatic extraction of dialogue-based character relationships.