no code implementations • Findings (EMNLP) 2021 • Peiyang Liu, Xi Wang, Sen Wang, Wei Ye, Xiangyu Xi, Shikun Zhang
Current embedding-based large-scale retrieval models are trained with 0-1 hard label that indicates whether a query is relevant to a document, ignoring rich information of the relevance degree.
no code implementations • 13 Mar 2025 • Sen Wang, Dongliang Zhou, Liang Xie, Chao Xu, Ye Yan, Erwei Yin
Vision-and-language navigation (VLN) tasks require agents to navigate three-dimensional environments guided by natural language instructions, offering substantial potential for diverse applications.
no code implementations • 8 Mar 2025 • Ruiyu Wang, Sen Wang, Xinxin Zuo, Qiang Sun
Lifelong learning (LL) aims to continuously acquire new knowledge while retaining previously learned knowledge.
1 code implementation • 29 Jan 2025 • Haodong Hong, Yanyuan Qiao, Sen Wang, Jiajun Liu, Qi Wu
To evaluate the proposed task, one has to address two challenges in existing VLN datasets: the lack of OOD data, and the limited number and style diversity of instructions for each scene.
1 code implementation • 18 Dec 2024 • Zhuo Cao, Bingqing Zhang, Heming Du, Xin Yu, Xue Li, Sen Wang
For short-moment retrieval, FlashVTG increases mAP to 125% of previous SOTA performance.
Ranked #1 on
Highlight Detection
on TvSum
no code implementations • 13 Dec 2024 • Siyun Liang, Sen Wang, Kunyi Li, Michael Niemeyer, Stefano Gasperini, Nassir Navab, Federico Tombari
3D Gaussian Splatting has recently gained traction for its efficient training and real-time rendering.
1 code implementation • 29 Oct 2024 • Sun-Young Jeon, Sen Wang, Adam S. Wang, Garry E. Gold, Jang-Hwan Choi
Noise reduction is crucial for maintaining image quality, especially given such challenges as motion artifacts and the limited availability of clean data in medical imaging.
1 code implementation • 16 Oct 2024 • Zixin Wang, Dong Gong, Sen Wang, Zi Huang, Yadan Luo
To address these questions, we propose Token Condensation as Adaptation (TCA), a training-free adaptation method for CLIP by pruning class-irrelevant visual tokens while merging class-ambiguous tokens.
no code implementations • 30 Sep 2024 • Qinglong Ma, Peizhi Zhao, Sen Wang, Tao Song
In this study, we propose a Deep Parallel Spectral Neural Operator (DPNO) to enhance the ability to learn low-frequency information.
no code implementations • 30 Sep 2024 • Bingqing Zhang, Zhuo Cao, Heming Du, Xin Yu, Xue Li, Jiajun Liu, Sen Wang
Text-Video Retrieval (TVR) methods typically match query-candidate pairs by aligning text and video features in coarse-grained, fine-grained, or combined (coarse-to-fine) manners.
1 code implementation • 25 Sep 2024 • Hrishikesh Patel, Ruihong Qiu, Adam Irwin, Shazia Sadiq, Sen Wang
Irregular time series, where data points are recorded at uneven intervals, are prevalent in healthcare settings, such as emergency wards where vital signs and laboratory results are captured at varying times.
no code implementations • 20 Sep 2024 • Sen Wang, Peizhi Zhao, Tao Song
In this manuscript, We propose Asymptotic Physics-Informed Neural Networks (ASPINN), a generalization of Physics-Informed Neural Networks (PINN) and General-Kindred Physics-Informed Neural Networks (GKPINN) approaches.
no code implementations • 27 Aug 2024 • Sen Wang, Peizhi Zhao, Qinglong Ma, Tao Song
This approach utilizes asymptotic analysis to acquire prior knowledge of the boundary layer from the equation and establishes a novel network to assist PINN in approximating the boundary layer.
1 code implementation • 4 Aug 2024 • Mateusz Ochal, Massimiliano Patacchiola, Malik Boudiaf, Sen Wang
In Few-Shot Learning (FSL), models are trained to recognise unseen objects from a query set, given a few labelled examples from a support set.
1 code implementation • 31 Jul 2024 • Haodong Hong, Sen Wang, Zi Huang, Qi Wu, Jiajun Liu
Real-world navigation often involves dealing with unexpected obstructions such as closed doors, moved objects, and unpredictable entities.
1 code implementation • 18 Jul 2024 • Yi Zhang, Ruihong Qiu, Jiajun Liu, Sen Wang
In this paper, a novel model-based Reward Shaping in Offline Reinforcement Learning for Recommender Systems, ROLeR, is proposed for reward and uncertainty estimation in recommendation systems.
1 code implementation • 19 Jun 2024 • Zhuoxiao Chen, Zixin Wang, Yadan Luo, Sen Wang, Zi Huang
We minimize the sharpness to cultivate a flat loss landscape to ensure model resiliency to minor data variations, thereby enhancing the generalization of the adaptation process.
1 code implementation • 15 Jun 2024 • Zhifeng Xie, Rui Qiu, Sen Wang, Xin Tan, Yuan Xie, Lizhuang Ma
In this paper, we leverage Prompt Images Guidance (PIG) to enhance UDA with supplementary night knowledge.
1 code implementation • 4 Jun 2024 • Haodong Hong, Sen Wang, Zi Huang, Qi Wu, Jiajun Liu
Current Vision-and-Language Navigation (VLN) tasks mainly employ textual instructions to guide agents.
no code implementations • 28 May 2024 • Shengnan Wang, Youhui Bai, Lin Zhang, Pingyi Zhou, Shixiong Zhao, Gong Zhang, Sen Wang, Renhai Chen, Hua Xu, Hongwei Sun
Under the XL3M framework, the input context will be firstly decomposed into multiple short sub-contexts, where each sub-context contains an independent segment and a common ``question'' which is a few tokens from the end of the original context.
no code implementations • 9 Apr 2024 • Sen Wang, Tianxiong Wang, Shulun Zhao, Zhen Feng, Guangyi Liu, Chunfeng Cui, Chih-Lin I, Jiangzhou Wang
The proposed system architecture and the dedicated signal processing methods enable the scheme to transmit a bigger number of parallel data streams than the number of receiving RF chains, achieving a spectral efficiency performance close to that of a fully digital (FD) MIMO system with the same number of antenna elements, each equipped with an RF chain.
no code implementations • 9 Feb 2024 • Eren Gultepe, Sen Wang, Byron Blomquist, Harindra J. S. Fernando, O. Patrick Kreidl, David J. Delene, Ismail Gultepe
Generative nowcasting of Vis time series for lead times of 30 and 60 minutes were performed using conditional generative adversarial networks (cGAN) regression at visibility thresholds of Vis < 1 km and < 10 km.
no code implementations • 21 Jan 2024 • Sen Wang, Dong Li, Shao-Yu Huang, Xuanliang Deng, Ashrarul H. Sifat, Changhee Jung, Ryan Williams, Haibo Zeng
When optimizing real-time systems, designers often face a challenging problem where the schedulability constraints are non-convex, non-continuous, or lack an analytical form to understand their properties.
no code implementations • 6 Jan 2024 • Sen Wang, Dong Li, Shao-Yu Huang, Xuanliang Deng, Ashrarul H. Sifat, Changhee Jung, Ryan Williams, Haibo Zeng
In real-time systems optimization, designers often face a challenging problem posed by the non-convex and non-continuous schedulability conditions, which may even lack an analytical form to understand their properties.
no code implementations • 23 Dec 2023 • Abdullah-Al-Zubaer Imran, Sen Wang, Debashish Pal, Sandeep Dutta, Bhavik Patel, Evan Zucker, Adam Wang
To optimize CT acquisitions before scanning, rapid prediction of patient-specific organ dose is needed prospectively, using available scout images.
1 code implementation • CVPR 2024 • Chuan Guo, Yuxuan Mu, Muhammad Gohar Javed, Sen Wang, Li Cheng
For the base-layer motion tokens, a Masked Transformer is designated to predict randomly masked motion tokens conditioned on text input at training stage.
Ranked #4 on
Motion Synthesis
on HumanML3D
no code implementations • 9 Nov 2023 • Sen Wang, Qing Cheng, Stefano Gasperini, Wei zhang, Shun-Cheng Wu, Niclas Zeller, Daniel Cremers, Nassir Navab
The generation of high-fidelity view synthesis is essential for robotic navigation and interaction but remains challenging, particularly in indoor environments and real-time scenarios.
1 code implementation • 6 Nov 2023 • Xuwei Xu, Sen Wang, Yudong Chen, Yanping Zheng, Zhewei Wei, Jiajun Liu
Vision Transformers (ViTs) have revolutionized the field of computer vision, yet their deployments on resource-constrained devices remain challenging due to high computational demands.
Ranked #189 on
Image Classification
on ImageNet
1 code implementation • 31 Oct 2023 • Zixin Wang, Yadan Luo, Liang Zheng, Zhuoxiao Chen, Sen Wang, Zi Huang
This article presents a comprehensive survey of online test-time adaptation (OTTA), focusing on effectively adapting machine learning models to distributionally different target data upon batch arrival.
no code implementations • 30 Oct 2023 • Sen Wang, Dong Li, Ashrarul H. Sifat, Shao-Yu Huang, Xuanliang Deng, Changhee Jung, Ryan Williams, Haibo Zeng
Therefore, fLET has the potential to significantly improve the end-to-end timing performance while keeping the benefits of deterministic behavior on timing and dataflow.
1 code implementation • 26 Oct 2023 • Yudong Chen, Sen Wang, Jiajun Liu, Xuwei Xu, Frank de Hoog, Brano Kusy, Zi Huang
Interestingly, we discovered that even if the student and the teacher have the same feature dimensions, adding a projector still helps to improve the distillation performance.
1 code implementation • 17 Oct 2023 • Sen Wang, Jin Zheng
Monocular 3D object detection is an inherently ill-posed problem, as it is challenging to predict accurate 3D localization from a single image.
no code implementations • 9 Oct 2023 • Xuwei Xu, Sen Wang, Yudong Chen, Jiajun Liu
Inspired by the channel shuffle design in ShuffleNetV2 \cite{ma2018shufflenet}, our module expands the feature channels of a tiny ViT and partitions the channels into two groups: the \textit{Attended} and \textit{Idle} groups.
1 code implementation • 9 Oct 2023 • Xuwei Xu, Changlin Li, Yudong Chen, Xiaojun Chang, Jiajun Liu, Sen Wang
By allowing the idle tokens to be re-selected in the following layers, IdleViT mitigates the negative impact of improper pruning in the early stages.
no code implementations • 7 Oct 2023 • Wei zhang, Tiecheng Sun, Sen Wang, Qing Cheng, Norbert Haala
For global consistency, we propose an efficient Sim(3)-based pose graph bundle adjustment (PGBA) approach to run online loop closing and mitigate the pose and scale drift.
1 code implementation • 22 Aug 2023 • Bingqing Zhang, Sen Wang, Yifan Liu, Brano Kusy, Xue Li, Jiajun Liu
The ODD score enhances the VOD system in two ways: 1) it enables the VOD system to select superior global reference frames, thereby improving overall accuracy; and 2) it serves as an indicator in the newly designed ODD Scheduler to eliminate the aggregation of frames that are easy to detect, thus accelerating the VOD process.
no code implementations • 10 Aug 2023 • Pierre Nicolay, Yvan Petillot, Mykhaylo Marfeychuk, Sen Wang, Ignacio Carlucho
However, in order to ensure that the AUV is able to carry out its mission successfully, a control system capable of adapting to changing environmental conditions is required.
1 code implementation • 6 Aug 2023 • Zixin Wang, Yadan Luo, Zhi Chen, Sen Wang, Zi Huang
The prevalence of domain adaptive semantic segmentation has prompted concerns regarding source domain data leakage, where private information from the source domain could inadvertently be exposed in the target domain.
1 code implementation • 1 Aug 2023 • Zhi Chen, Pengfei Zhang, Jingjing Li, Sen Wang, Zi Huang
To take the advantage of image augmentations while mitigating the semantic distortion issue, we propose a novel ZSL approach by Harnessing Adversarial Samples (HAS).
1 code implementation • 16 Mar 2023 • Shihao Zou, Yuxuan Mu, Xinxin Zuo, Sen Wang, Li Cheng
Motivated by the above mentioned issues, we present in this paper a dedicated end-to-end sparse deep learning approach for event-based pose tracking: 1) to our knowledge this is the first time that 3D human pose tracking is obtained from events only, thus eliminating the need of accessing to any frame-based images as part of input; 2) our approach is based entirely upon the framework of Spiking Neural Networks (SNNs), which consists of Spike-Element-Wise (SEW) ResNet and a novel Spiking Spatiotemporal Transformer; 3) a large-scale synthetic dataset is constructed that features a broad and diverse set of annotated 3D human motions, as well as longer hours of event stream data, named SynEventHPD.
3 code implementations • CVPR 2023 • Haiyang Wang, Chen Shi, Shaoshuai Shi, Meng Lei, Sen Wang, Di He, Bernt Schiele, LiWei Wang
However, due to the sparse characteristics of point clouds, it is non-trivial to apply a standard transformer on sparse points.
Ranked #1 on
3D Object Detection
on waymo cyclist
1 code implementation • 27 Oct 2022 • Yudong Chen, Sen Wang, Jiajun Liu, Xuwei Xu, Frank de Hoog, Zi Huang
Motivated by the positive effect of the projector in feature distillation, we propose an ensemble of projectors to further improve the quality of student features.
no code implementations • 26 Oct 2022 • Yi Dong, Xingyu Zhao, Sen Wang, Xiaowei Huang
Deep Reinforcement Learning (DRL) has achieved impressive performance in robotics and autonomous systems (RAS).
no code implementations • 5 Sep 2022 • Zhi Chen, Yadan Luo, Sen Wang, Jingjing Li, Zi Huang
We identify two key challenges in our FedZSL protocol: 1) the trained models are prone to be biased to the locally observed classes, thus failing to generalize to the unseen classes and/or seen classes appeared on other devices; 2) as each category in the training data comes from a single source, the central model is highly vulnerable to model replacement (backdoor) attacks.
1 code implementation • 30 Aug 2022 • Zhifeng Xie, Sen Wang, Ke Xu, Zhizhong Zhang, Xin Tan, Yuan Xie, Lizhuang Ma
Based on this, we propose to exploit the image frequency distributions for night-time scene parsing.
1 code implementation • 17 Aug 2022 • Dong Huang, Qingwen Bu, Yuhao QING, Haowen Pi, Sen Wang, Heming Cui
Compared to all methods that do not use additional data for training, our models achieve 67. 3% and 41. 5% robust accuracy on CIFAR-10 and CIFAR-100 (improving upon the state-of-the-art by +7. 23% and +9. 07%).
1 code implementation • 11 Jul 2022 • Zixin Wang, Yadan Luo, Peng-Fei Zhang, Sen Wang, Zi Huang
A typical multi-source domain adaptation (MSDA) approach aims to transfer knowledge learned from a set of labeled source domains, to an unlabeled target domain.
no code implementations • 5 Jul 2022 • Zhi Chen, Yadan Luo, Sen Wang, Jingjing Li, Zi Huang
To address this issue, we propose a novel flow-based generative framework that consists of multiple conditional affine coupling layers for learning unseen data generation.
1 code implementation • 4 Jul 2022 • Chuan Guo, Xinxin Zuo, Sen Wang, Li Cheng
Our approach is flexible, could be used for both text2motion and motion2text tasks.
Ranked #3 on
Motion Captioning
on HumanML3D
1 code implementation • CVPR 2022 • Chuan Guo, Shihao Zou, Xinxin Zuo, Sen Wang, Wei Ji, Xingyu Li, Li Cheng
Automated generation of 3D human motions from text is a challenging problem.
Ranked #3 on
Motion Synthesis
on Inter-X
1 code implementation • 30 Nov 2021 • Sen Wang, Hengchao Wang, Fan Jiang, Anqi Wang, Hangwei Liu, Hanbo Zhao, Boyuan Yang, Dong Xu, Yan Zhang, Wei Fan
As the Hi-C links of two adjacent contigs concentrate only at the neighbor ends of the contigs, larger contig size will reduce the power to differentiate adjacent (signal) and non-adjacent (noise) contig linkages, leading to a higher rate of mis-assembly.
no code implementations • 30 Nov 2021 • Yi Dong, Wei Huang, Vibhav Bharti, Victoria Cox, Alec Banks, Sen Wang, Xingyu Zhao, Sven Schewe, Xiaowei Huang
The increasing use of Machine Learning (ML) components embedded in autonomous systems -- so-called Learning-Enabled Systems (LESs) -- has resulted in the pressing need to assure their functional safety.
no code implementations • 26 Nov 2021 • Ji Yang, Youdong Ma, Xinxin Zuo, Sen Wang, Minglun Gong, Li Cheng
This paper considers to jointly tackle the highly correlated tasks of estimating 3D human body poses and predicting future 3D motions from RGB image sequences.
no code implementations • 12 Nov 2021 • Chuan Guo, Xinxin Zuo, Sen Wang, Xinshuang Liu, Shihao Zou, Minglun Gong, Li Cheng
Action2motion stochastically generates plausible 3D pose sequences of a prescribed action category, which are processed and rendered by motion2video to form 2D videos.
no code implementations • 29 Sep 2021 • Fanxin Li, Shixiong Zhao, Haowen Pi, Yuhao QING, Yichao Fu, Sen Wang, Heming Cui
Neural Architecture Search (NAS) automatically searches for well-performed network architectures from a given search space.
1 code implementation • 7 Sep 2021 • Xueping Peng, Guodong Long, Tao Shen, Sen Wang, Jing Jiang
Sequential diagnosis prediction on the Electronic Health Record (EHR) has been proven crucial for predictive analytics in the medical domain.
1 code implementation • 2 Sep 2021 • Xuesong Wang, Lina Yao, Xianzhi Wang, Hye-Young Paik, Sen Wang
Latent neural process, a member of NPF, is believed to be capable of modelling the uncertainty on certain points (local uncertainty) as well as the general function priors (global uncertainties).
1 code implementation • ICCV 2021 • Shihao Zou, Chuan Guo, Xinxin Zuo, Sen Wang, Pengyu Wang, Xiaoqin Hu, Shoushun Chen, Minglun Gong, Li Cheng
Event camera is an emerging imaging sensor for capturing dynamics of moving objects as events, which motivates our work in estimating 3D human pose and shape from the event signals.
1 code implementation • 15 Aug 2021 • Shihao Zou, Xinxin Zuo, Sen Wang, Yiming Qian, Chuan Guo, Li Cheng
This paper focuses on a new problem of estimating human pose and shape from single polarization images.
no code implementations • 6 Aug 2021 • Hao Zhu, Xinxin Zuo, Haotian Yang, Sen Wang, Xun Cao, Ruigang Yang
In this paper, we propose a novel learning-based framework that combines the robustness of the parametric model with the flexibility of free-form 3D deformation.
no code implementations • 5 Aug 2021 • Ji Yang, Xinxin Zuo, Sen Wang, Zhenbo Yu, Xingyu Li, Bingbing Ni, Minglun Gong, Li Cheng
A dataset of generic 3D objects with ground-truth annotated skeletons is collected.
no code implementations • 28 Jul 2021 • Tomasz Luczynski, Jonatan Scharff Willners, Elizabeth Vargas, Joshua Roe, Shida Xu, Yu Cao, Yvan Petillot, Sen Wang
This paper presents a novel dataset for the development of visual navigation and simultaneous localisation and mapping (SLAM) algorithms as well as for underwater intervention tasks.
1 code implementation • 20 Jul 2021 • Xueping Peng, Guodong Long, Sen Wang, Jing Jiang, Allison Clarke, Clement Schlegel, Chengqi Zhang
Hence, some recent works train healthcare representations by incorporating medical ontology, by self-supervised tasks like diagnosis prediction, but (1) the small-scale, monotonous ontology is insufficient for robust learning, and (2) critical contexts or dependencies underlying patient journeys are barely exploited to enhance ontology learning.
1 code implementation • 15 Jul 2021 • Xinxin Zuo, Sen Wang, Qiang Sun, Minglun Gong, Li Cheng
However, Chamfer distance is quite sensitive to noise and outliers, thus could be unreliable to assign correspondences.
1 code implementation • 7 Jul 2021 • Zhi Chen, Yadan Luo, Sen Wang, Ruihong Qiu, Jingjing Li, Zi Huang
Generalized Zero-Shot Learning (GZSL) is the task of leveraging semantic information (e. g., attributes) to recognize the seen and unseen samples, where unseen classes are not observable during training.
1 code implementation • 6 Jul 2021 • Ruihong Qiu, Sen Wang, Zhi Chen, Hongzhi Yin, Zi Huang
Existing visually-aware models make use of the visual features as a separate collaborative signal similarly to other features to directly predict the user's preference without considering a potential bias, which gives rise to a visually biased recommendation.
2 code implementations • 21 Jun 2021 • Jing Xu, Sen Wang, LiWei Wang, Andrew Chi-Chih Yao
Federated Learning is a distributed machine learning approach which enables model training without data sharing.
no code implementations • CVPR 2021 • Jin Fang, Xinxin Zuo, Dingfu Zhou, Shengze Jin, Sen Wang, Liangjun Zhang
Finally, we verify the proposed framework on the public KITTI dataset with different 3D object detectors.
no code implementations • NAACL 2021 • Peiyang Liu, Sen Wang, Xi Wang, Wei Ye, Shikun Zhang
The embedding-based large-scale query-document retrieval problem is a hot topic in the information retrieval (IR) field.
1 code implementation • ICLR Workshop Learning_to_Learn 2021 • Mateusz Ochal, Massimiliano Patacchiola, Amos Storkey, Jose Vazquez, Sen Wang
Meta-Learning (ML) has proven to be a useful tool for training Few-Shot Learning (FSL) algorithms by exposure to batches of tasks sampled from a meta-dataset.
1 code implementation • ICCV 2021 • Zhi Chen, Yadan Luo, Ruihong Qiu, Sen Wang, Zi Huang, Jingjing Li, Zheng Zhang
Generalized zero-shot learning (GZSL) aims to classify samples under the assumption that some classes are not observable during training.
1 code implementation • 7 Jan 2021 • Mateusz Ochal, Massimiliano Patacchiola, Amos Storkey, Jose Vazquez, Sen Wang
Few-Shot Learning (FSL) algorithms are commonly trained through Meta-Learning (ML), which exposes models to batches of tasks sampled from a meta-dataset to mimic tasks seen during evaluation.
no code implementations • 1 Jan 2021 • Mateusz Ochal, Massimiliano Patacchiola, Jose Vazquez, Amos Storkey, Sen Wang
Few-shot learning aims to train models on a limited number of labeled samples from a support set in order to generalize to unseen samples from a query set.
1 code implementation • 19 Nov 2020 • Yujie Zhong, Linhai Xie, Sen Wang, Lucia Specia, Yishu Miao
In this paper, we teach machines to understand visuals and natural language by learning the mapping between sentences and noisy video snippets without explicit annotations.
1 code implementation • 18 Oct 2020 • Marcel Sheeny, Emanuele De Pellegrin, Saptarshi Mukherjee, Alireza Ahrabian, Sen Wang, Andrew Wallace
To the best of our knowledge, this is the first public radar dataset which provides high-resolution radar images on public roads with a large amount of road actors labelled.
1 code implementation • 24 Sep 2020 • Xueping Peng, Guodong Long, Tao Shen, Sen Wang, Jing Jiang, Chengqi Zhang
Electronic health records (EHRs) are longitudinal records of a patient's interactions with healthcare systems.
1 code implementation • 30 Jul 2020 • Chuan Guo, Xinxin Zuo, Sen Wang, Shihao Zou, Qingyao Sun, Annan Deng, Minglun Gong, Li Cheng
Action recognition is a relatively established task, where givenan input sequence of human motion, the goal is to predict its ac-tion category.
no code implementations • 27 Jul 2020 • Zhi Chen, Sen Wang, Jingjing Li, Zi Huang
A voting strategy averages the probability distributions output from the classifiers and, given that some patches are more discriminative than others, a discrimination-based attention mechanism helps to weight each patch accordingly.
no code implementations • ECCV 2020 • Shihao Zou, Xinxin Zuo, Yiming Qian, Sen Wang, Chi Xu, Minglun Gong, Li Cheng
Inspired by the recent advances in human shape estimation from single color images, in this paper, we attempt at estimating human body shapes by leveraging the geometric cues from single polarization images.
1 code implementation • 15 Jun 2020 • Xueping Peng, Guodong Long, Tao Shen, Sen Wang, Jing Jiang
The key challenge of patient journey understanding is to design an effective encoding mechanism which can properly tackle the aforementioned multi-level structured patient journey data with temporal sequential visits and a set of medical codes.
no code implementations • 7 Jun 2020 • Cong Wang, Qifeng Zhang, Qiyan Tian, Shuo Li, Xiaohui Wang, David Lane, Yvan Petillot, Ziyang Hong, Sen Wang
Tracking and grasping a dynamic object with a random trajectory is even harder.
no code implementations • 5 Jun 2020 • Xinxin Zuo, Sen Wang, Jiangbin Zheng, Weiwei Yu, Minglun Gong, Ruigang Yang, Li Cheng
First, based on a generative human template, for every two frames having sufficient overlap, an initial pairwise alignment is performed; It is followed by a global non-rigid registration procedure, in which partial results from RGBD frames are collected into a unified 3D shape, under the guidance of correspondences from the pairwise alignment; Finally, the texture map of the reconstructed human model is optimized to deliver a clear and spatially consistent texture.
no code implementations • 10 May 2020 • Mateusz Ochal, Jose Vazquez, Yvan Petillot, Sen Wang
Deep convolutional neural networks generally perform well in underwater object recognition tasks on both optical and sonar images.
no code implementations • 30 Apr 2020 • Shihao Zou, Xinxin Zuo, Yiming Qian, Sen Wang, Chuan Guo, Chi Xu, Minglun Gong, Li Cheng
Polarization images are known to be able to capture polarized reflected lights that preserve rich geometric cues of an object, which has motivated its recent applications in reconstructing detailed surface normal of the objects of interest.
1 code implementation • 26 Mar 2020 • Hengchao Wang, Bo Liu, Yan Zhang, Fan Jiang, Yuwei Ren, Lijuan Yin, Hangwei Liu, Sen Wang, Wei Fan
We show that corrected third-generation data can be used to count k-mer frequencies and estimate genome size reliably, in replacement of using second-generation data.
no code implementations • CVPR 2020 • Lingling Zhang, Xiaojun Chang, Jun Liu, Minnan Luo, Sen Wang, ZongYuan Ge, Alexander Hauptmann
An integral part of video analysis and surveillance is temporal activity detection, which means to simultaneously recognize and localize activities in long untrimmed videos.
no code implementations • 2 Mar 2020 • Sen Wang, Jiaqi Chen, Xuanliang Deng, Seth Hutchinson, Frank Dellaert
Chinese calligraphy is a unique art form with great artistic value but difficult to master.
no code implementations • 9 Feb 2020 • Sen Wang, J. Morris Chang
To protect the image privacy, we propose to locally perturb the image representation before revealing to the data user.
no code implementations • 6 Feb 2020 • Sen Wang, J. Morris Chang
The privacy concern raises when such data leaves the hand of the owners and be further explored or mined.
1 code implementation • 10 Dec 2019 • Chris Xiaoxuan Lu, Bowen Du, Hongkai Wen, Sen Wang, Andrew Markham, Ivan Martinovic, Yiran Shen, Niki Trigoni
Demand for smartwatches has taken off in recent years with new models which can run independently from smartphones and provide more useful features, becoming first-class mobile platforms.
no code implementations • 6 Dec 2019 • Marcel Sheeny, Andrew Wallace, Sen Wang
For high resolution scene mapping and object recognition, optical technologies such as cameras and LiDAR are the sensors of choice.
no code implementations • 18 Nov 2019 • Sen Wang, Jiaqi Chen, Xuanliang Deng, Seth Hutchinson, Frank Dellaert
Chinese calligraphy is a unique form of art that has great artistic value but is difficult to master.
Robotics
1 code implementation • 15 Sep 2019 • Xueping Peng, Guodong Long, Tao Shen, Sen Wang, Jing Jiang, Michael Blumenstein
In this paper, we propose a medical concept embedding method based on applying a self-attention mechanism to represent each medical concept.
1 code implementation • 18 Aug 2019 • Shining Liang, Wanli Zuo, Zhenkun Shi, Sen Wang, Junhu Wang, Xianglin Zuo
Mining causality from text is a complex and crucial natural language understanding task corresponding to the human cognition.
1 code implementation • NeurIPS 2019 • Bo Yang, Jianan Wang, Ronald Clark, Qingyong Hu, Sen Wang, Andrew Markham, Niki Trigoni
The framework directly regresses 3D bounding boxes for all instances in a point cloud, while simultaneously predicting a point-level mask for each instance.
Ranked #14 on
3D Instance Segmentation
on S3DIS
(mPrec metric)
1 code implementation • CVPR 2019 • Hao Zhu, Xinxin Zuo, Sen Wang, Xun Cao, Ruigang Yang
This paper presents a novel framework to recover detailed human body shapes from a single image.
no code implementations • 25 Mar 2019 • Muhamad Risqi U. Saputra, Pedro P. B. de Gusmao, Sen Wang, Andrew Markham, Niki Trigoni
Inspired by the cognitive process of humans and animals, Curriculum Learning (CL) trains a model by gradually increasing the difficulty of the training data.
1 code implementation • 28 Nov 2018 • Sen Wang, Daoyuan Jia, Xinshuo Weng
To deal with these challenges, we first adopt the deep deterministic policy gradient (DDPG) algorithm, which has the capacity to handle complex state and action spaces in continuous domain.
no code implementations • 27 Nov 2018 • Qichuan Geng, Hong Zhang, Xinyu Huang, Sen Wang, Feixiang Lu, Xinjing Cheng, Zhong Zhou, Ruigang Yang
As it is labor-intensive to annotate semantic parts on real street views, we propose a specific approach to implicitly transfer part features from synthesized images to real street views.
1 code implementation • 27 Nov 2018 • Linhai Xie, Yishu Miao, Sen Wang, Phil Blunsom, Zhihua Wang, Changhao Chen, Andrew Markham, Niki Trigoni
Due to the sparse rewards and high degree of environment variation, reinforcement learning approaches such as Deep Deterministic Policy Gradient (DDPG) are plagued by issues of high variance when applied in complex real world environments.
Robotics
no code implementations • 12 Nov 2018 • Kaixuan Chen, Lina Yao, Dalin Zhang, Xiaojun Chang, Guodong Long, Sen Wang
Semi-supervised learning is crucial for alleviating labelling burdens in people-centric sensing.
1 code implementation • 2 Aug 2018 • Bo Yang, Sen Wang, Andrew Markham, Niki Trigoni
However, GRU based approaches are unable to consistently estimate 3D shapes given different permutations of the same set of input images as the recurrent unit is permutation variant.
Ranked #1 on
3D Reconstruction
on Data3D−R2N2
no code implementations • 8 May 2018 • Shuai Zhang, Lina Yao, Aixin Sun, Sen Wang, Guodong Long, Manqing Dong
Modeling user-item interaction patterns is an important task for personalized recommendations.
1 code implementation • 25 Apr 2018 • Zhihua Wang, Stefano Rosa, Bo Yang, Sen Wang, Niki Trigoni, Andrew Markham
This is further confounded by the fact that shape information about encountered objects in the real world is often impaired by occlusions, noise and missing regions e. g. a robot manipulating an object will only be able to observe a partial view of the entire solid.
no code implementations • 16 Apr 2018 • Xiang Zhang, Lina Yao, Chaoran Huang, Sen Wang, Mingkui Tan, Guodong Long, Can Wang
Multimodal wearable sensor data classification plays an important role in ubiquitous computing and has a wide range of applications in scenarios from healthcare to entertainment.
1 code implementation • 16 Apr 2018 • Zhihua Wang, Stefano Rosa, Linhai Xie, Bo Yang, Sen Wang, Niki Trigoni, Andrew Markham
Modelling the physical properties of everyday objects is a fundamental prerequisite for autonomous robots.
Robotics
no code implementations • 7 Apr 2018 • Marcel Sheeny, Andrew Wallace, Mehryar Emambakhsh, Sen Wang, Barry Connor
For vehicle autonomy, driver assistance and situational awareness, it is necessary to operate at day and night, and in all weather conditions.
2 code implementations • 3 Feb 2018 • Minghai Chen, Sen Wang, Paul Pu Liang, Tadas Baltrušaitis, Amir Zadeh, Louis-Philippe Morency
In this paper, we propose the Gated Multimodal Embedding LSTM with Temporal Attention (GME-LSTM(A)) model that is composed of 2 modules.
1 code implementation • 31 Jan 2018 • Tao Shen, Tianyi Zhou, Guodong Long, Jing Jiang, Sen Wang, Chengqi Zhang
In this paper, we integrate both soft and hard attention into one context fusion model, "reinforced self-attention (ReSA)", for the mutual benefit of each other.
Ranked #56 on
Natural Language Inference
on SNLI
no code implementations • 16 Oct 2017 • Fang Gong, Meng Wang, Haofen Wang, Sen Wang, Mengyue Liu
To our best knowledge, SMR is the first to learn embeddings of a patient-disease-medicine graph for medicine recommendation in the world.
5 code implementations • 25 Sep 2017 • Sen Wang, Ronald Clark, Hongkai Wen, Niki Trigoni
This paper presents a novel end-to-end framework for monocular VO by using deep Recurrent Convolutional Neural Networks (RCNNs).
no code implementations • 20 Sep 2017 • Ruihao Li, Sen Wang, Zhiqiang Long, Dongbing Gu
UnDeepVO is able to estimate the 6-DoF pose of a monocular camera and the depth of its view by using deep neural networks.
2 code implementations • 26 Aug 2017 • Bo Yang, Hongkai Wen, Sen Wang, Ronald Clark, Andrew Markham, Niki Trigoni
In this paper, we propose a novel 3D-RecGAN approach, which reconstructs the complete 3D structure of a given object from a single arbitrary depth view using generative adversarial networks.
no code implementations • 22 Aug 2017 • Dalin Zhang, Lina Yao, Xiang Zhang, Sen Wang, Weitong Chen, Robert Boots
Brain-Computer Interface (BCI) is a system empowering humans to communicate with or control the outside world with exclusively brain intentions.
Human-Computer Interaction Neurons and Cognition
no code implementations • 17 Jul 2017 • Meng Wang, Jiaheng Zhang, Jun Liu, Wei Hu, Sen Wang, Xue Li, Wenqiang Liu
Electronic medical records contain multi-format electronic medical data that consist of an abundance of medical knowledge.
no code implementations • CVPR 2017 • Ronald Clark, Sen Wang, Andrew Markham, Niki Trigoni, Hongkai Wen
Machine learning techniques, namely convolutional neural networks (CNN) and regression forests, have recently shown great promise in performing 6-DoF localization of monocular images.
no code implementations • ICCV 2017 • Xinxin Zuo, Sen Wang, Jiangbin Zheng, Ruigang Yang
In this paper we present a novel approach for depth map enhancement from an RGB-D video sequence.
no code implementations • 29 Jan 2017 • Ronald Clark, Sen Wang, Hongkai Wen, Andrew Markham, Niki Trigoni
In this paper we present an on-manifold sequence-to-sequence learning approach to motion estimation using visual and inertial sensors.
2 code implementations • 21 Oct 2016 • Xiaowei Huang, Marta Kwiatkowska, Sen Wang, Min Wu
Our method works directly with the network code and, in contrast to existing methods, can guarantee that adversarial examples, if they exist, are found for the given region and family of manipulations.
no code implementations • 9 Jul 2016 • Sen Wang, Feiping Nie, Xiaojun Chang, Xue Li, Quan Z. Sheng, Lina Yao
We propose a method that utilizes both the manifold structure of data and local discriminant information.
no code implementations • ICCV 2015 • Xinxin Zuo, Chao Du, Sen Wang, Jiangbin Zheng, Ruigang Yang
We discovered that these internal contours, which are results of convex parts on an object's surface, can lead to a tighter fit than the original visual hull.
no code implementations • 3 Jun 2015 • Sen Wang, Feiping Nie, Xiaojun Chang, Lina Yao, Xue Li, Quan Z. Sheng
In this paper, we propose an unsupervised feature selection method seeking a feature coefficient matrix to select the most distinctive features.
no code implementations • 23 Nov 2014 • Xiaojun Chang, Feiping Nie, Sen Wang, Yi Yang, Xiaofang Zhou, Chengqi Zhang
In many real-world applications, data are represented by matrices or high-order tensors.