1 code implementation • 20 Feb 2025 • Ruochen Li, Stamos Katsigiannis, Tae-Kyun Kim, Hubert P. H. Shum
In this work, we introduce the behavioral pseudo-labels that effectively capture the behavior distributions of pedestrians and heterogeneous agents solely based on their motion features, significantly improving the accuracy of trajectory prediction.
1 code implementation • 4 Feb 2025 • Ruochen Li, Tanqiu Qiao, Stamos Katsigiannis, Zhanxing Zhu, Hubert P. H. Shum
We propose the Edge-to-Edge-Node-to-Node Graph Convolution (E2E-N2N-GCN), a novel dual-graph network that jointly models explicit N2N social interactions among pedestrians and implicit E2E influence propagation across these interaction patterns.
no code implementations • 15 Dec 2024 • Kanglei Zhou, Ruizhi Cai, Liyuan Wang, Hubert P. H. Shum, Xiaohui Liang
In this work, we address these gaps by systematically analyzing over 150 AQA-related papers to develop a hierarchical taxonomy, construct a unified benchmark, and provide an in-depth analysis of current trends, challenges, and future directions.
no code implementations • 9 Dec 2024 • Francis Xiatian Zhang, Jingjing Deng, Robert Lieck, Hubert P. H. Shum
First, we introduce a new representation of spatial information based on bounding boxes of surgical instruments and targets, including their detection confidence levels.
no code implementations • 2 Dec 2024 • Mridula Vijendran, Jingjing Deng, Shuang Chen, Edmond S. L. Ho, Hubert P. H. Shum
Artificial Intelligence significantly enhances the visual art industry by analyzing, identifying and generating digitized artistic images.
1 code implementation • 10 Nov 2024 • Shuang Chen, Haozheng Zhang, Amir Atapour-Abarghouei, Hubert P. H. Shum
Image inpainting aims to repair a partially damaged image based on the information from known regions of the images.
no code implementations • 2 Sep 2024 • Haiju Fan, Xiaona Qin, Shuang Chen, Hubert P. H. Shum, Ming Li
In this paper, we propose a novel one-index attack method in the VQ domain to generate adversarial images by a differential evolution algorithm, successfully resulting in image misclassification in victim models.
no code implementations • 25 Aug 2024 • Li Li, Tanqiu Qiao, Hubert P. H. Shum, Toby P. Breckon
3D point clouds are essential for perceiving outdoor scenes, especially within the realm of autonomous driving.
1 code implementation • 3 Aug 2024 • Mridula Vijendran, Frederick W. B. Li, Jingjing Deng, Hubert P. H. Shum
Painting classification plays a vital role in organizing, finding, and suggesting artwork for digital and classic art galleries.
1 code implementation • 23 Jul 2024 • Shuang Chen, Amir Atapour-Abarghouei, Haozheng Zhang, Hubert P. H. Shum
Image inpainting, or image completion, is a crucial task in computer vision that aims to restore missing or damaged regions of images with semantically coherent content.
1 code implementation • 14 Jul 2024 • Li Li, Hubert P. H. Shum, Toby P. Breckon
To effectively embed high-dimensional RAPiD features, we propose a double-nested autoencoder structure with a novel class-aware embedding objective to encode high-dimensional features into manageable voxel-wise embeddings.
1 code implementation • 2 Jul 2024 • Francis Xiatian Zhang, Shuang Chen, Xianghua Xie, Hubert P. H. Shum
Video inpainting fills in corrupted video content with plausible replacements.
no code implementations • 1 Jul 2024 • Tanqiu Qiao, Ruochen Li, Frederick W. B. Li, Hubert P. H. Shum
Video-based Human-Object Interaction (HOI) recognition explores the intricate dynamics between humans and objects, which are essential for a comprehensive understanding of human behavior and intentions.
1 code implementation • 26 Jun 2024 • Abril Corona-Figueroa, Hubert P. H. Shum, Chris G. Willcocks
This paper investigates a 2D to 3D image translation method with a straightforward technique, enabling correlated 2D X-ray to 3D CT-like reconstruction.
1 code implementation • 26 Jun 2024 • Manli Zhu, Edmond S. L. Ho, Shuang Chen, Longzhi Yang, Hubert P. H. Shum
Human-object interaction (HOI) detection is one of the most popular pattern detection approaches for captured human-centric visual scenes.
1 code implementation • International Conference on 3D Vision (3DV) 2021 • Li Li, Khalid N. Ismail, Hubert P. H. Shum, Toby P. Breckon
We present DurLAR, a high-fidelity 128-channel 3D LiDAR dataset with panoramic ambient (near infrared) and reflectivity imagery, as well as a sample benchmark task using depth estimation for autonomous driving applications.
no code implementations • 8 Apr 2024 • Baiyi Li, Edmond S. L. Ho, Hubert P. H. Shum, He Wang
Close and continuous interaction with rich contacts is a crucial aspect of human activities (e. g. hugging, dancing) and of interest in many domains like activity recognition, motion prediction, character animation, etc.
1 code implementation • 7 Mar 2024 • Kanglei Zhou, Liyuan Wang, Xingxing Zhang, Hubert P. H. Shum, Frederick W. B. Li, Jianguo Li, Xiaohui Liang
We propose Continual AQA (CAQA) to refine models using sparse new data.
1 code implementation • 22 Feb 2024 • Shuang Chen, Amir Atapour-Abarghouei, Hubert P. H. Shum
In this paper, we propose an end-to-end High-quality INpainting Transformer, abbreviated as HINT, which consists of a novel mask-aware pixel-shuffle downsampling module (MPD) to preserve the visible information extracted from the corrupted image while maintaining the integrity of the information available for high-level inferences made within the model.
no code implementations • 17 Feb 2024 • Merryn D. Constable, Hubert P. H. Shum, Stephen Clark
When technical requirements are high, and patient outcomes are critical, opportunities for monitoring and improving surgical skills via objective motion analysis feedback may be particularly beneficial.
no code implementations • 21 Dec 2023 • Haozheng Zhang, Edmond S. L. Ho, Xiatian Zhang, Silvia Del Din, Hubert P. H. Shum
The accuracy of diagnosis ranges between 73% and 84%, and is influenced by the experience of the clinical assessor.
1 code implementation • 17 Nov 2023 • Xiatian Zhang, Sisi Zheng, Hubert P. H. Shum, Haozheng Zhang, Nan Song, Mingkang Song, Hongxiao Jia
To overcome that, we propose a graph learning framework that captures comprehensive features by integrating both correlation and distance-based similarity measures under a contrastive loss.
no code implementations • 10 Nov 2023 • Jiaxu Liu, Zhengdi Yu, Toby P. Breckon, Hubert P. H. Shum
To achieve this, U3DS$^3$ leverages a generalized unsupervised segmentation method for both object and background across both indoor and outdoor static 3D point clouds with no requirement for model pre-training, by leveraging only the inherent information of the point cloud to achieve full 3D scene segmentation.
1 code implementation • ICCV 2023 • Abril Corona-Figueroa, Sam Bond-Taylor, Neelanjan Bhowmik, Yona Falinie A. Gaus, Toby P. Breckon, Hubert P. H. Shum, Chris G. Willcocks
Generating 3D images of complex objects conditionally from a few 2D views is a difficult synthesis problem, compounded by issues such as domain gap and geometric misalignment.
no code implementations • 24 Aug 2023 • Qi Feng, Hubert P. H. Shum, Shigeo Morishima
To explore this influence, we first propose a pilot study that captures real environments with multiple eye heights and asks participants to judge the egocentric distances and immersion.
1 code implementation • ICCV 2023 • Zhengzhi Lu, He Wang, Ziyi Chang, Guoan Yang, Hubert P. H. Shum
Specifically, we first learn a motion manifold where we define an adversarial loss to compute a new gradient for the attack, named skeleton-motion-informed (SMI) gradient.
no code implementations • 7 Jun 2023 • Ziyi Chang, George Alex Koulieris, Hubert P. H. Shum
Diffusion models are generative models, which gradually add and remove noise to learn the underlying distribution of training data for data generation.
no code implementations • 17 May 2023 • Shuang Chen, Amir Atapour-Abarghouei, Edmond S. L. Ho, Hubert P. H. Shum
We present a software that predicts non-cleft facial images for patients with cleft lip, thereby facilitating the understanding, awareness and discussion of cleft lip surgeries.
no code implementations • 3 Apr 2023 • Qianhui Men, Edmond S. L. Ho, Hubert P. H. Shum, Howard Leung
Learning view-invariant representation is a key to improving feature discrimination power for skeleton-based action recognition.
1 code implementation • CVPR 2023 • Li Li, Hubert P. H. Shum, Toby P. Breckon
Whilst the availability of 3D LiDAR point cloud data has significantly grown in recent years, annotation remains expensive and time-consuming, leading to a demand for semi-supervised semantic segmentation methods with application domains such as autonomous driving.
Ranked #1 on
3D Semantic Segmentation
on ScribbleKITTI
(mIoU-1% metric)
1 code implementation • 6 Jan 2023 • Mridula Vijendran, Frederick W. B. Li, Hubert P. H. Shum
We propose a system to handle data bias in small paintings datasets like the Kaokore dataset while simultaneously accounting for domain adaptation in fine-tuning a model trained on real world images.
1 code implementation • 16 Dec 2022 • Ziyi Chang, Edmund J. C. Findlay, Haozheng Zhang, Hubert P. H. Shum
To achieve high-quality results, we design a multi-task architecture of diffusion model that strategically generates aspects of human motions for local guidance.
1 code implementation • 9 Oct 2022 • Ziyi Chang, George Alex Koulieris, Hubert P. H. Shum
Acquiring the virtual equivalent of exhibits, such as sculptures, in virtual reality (VR) museums, can be labour-intensive and sometimes infeasible.
no code implementations • 29 Sep 2022 • Edmund J. C. Findlay, Haozheng Zhang, Ziyi Chang, Hubert P. H. Shum
Generating realistic motions for digital humans is time-consuming for many graphics applications.
no code implementations • 6 Sep 2022 • Haozheng Zhang, Edmond S. L. Ho, Hubert P. H. Shum
Early prediction is clinically considered one of the essential parts of cerebral palsy (CP) treatment.
1 code implementation • 18 Aug 2022 • Manli Zhu, Qianhui Men, Edmond S. L. Ho, Howard Leung, Hubert P. H. Shum
As a result, we propose a solution that explicitly takes both individual joint features and inter-joint features as input, relieving the system from the need of discovering more complicated features from small data.
1 code implementation • 7 Aug 2022 • Xiatian Zhang, Noura Al Moubayed, Hubert P. H. Shum
Hence, we propose a graph representation learning framework to comprehensively represent instrument motions in the surgical workflow anticipation problem.
1 code implementation • 1 Aug 2022 • Shuang Chen, Amir Atapour-Abarghouei, Jane Kerby, Edmond S. L. Ho, David C. G. Sainsbury, Sophie Butterworth, Hubert P. H. Shum
A Cleft lip is a congenital abnormality requiring surgical repair by a specialist.
1 code implementation • 19 Jul 2022 • Tanqiu Qiao, Qianhui Men, Frederick W. B. Li, Yoshiki Kubotani, Shigeo Morishima, Hubert P. H. Shum
Consider that geometric features such as human pose and object position provide meaningful information to understand HOIs, we argue to combine the benefits of both visual and geometric features in HOI recognition, and propose a novel Two-level Geometric feature-informed Graph Convolutional Network (2G-GCN).
no code implementations • 14 Jul 2022 • Haozheng Zhang, Edmond S. L. Ho, Xiatian Zhang, Hubert P. H. Shum
To this end, we propose to classify Parkinson's tremor since it is one of the most predominant symptoms of PD with strong generalizability.
1 code implementation • 11 Jul 2022 • Manli Zhu, Edmond S. L. Ho, Hubert P. H. Shum
Our network exploits the spatial connections between human keypoints and object keypoints to capture their fine-grained structural interactions via graph convolutions.
Ranked #22 on
Human-Object Interaction Detection
on V-COCO
1 code implementation • 30 Jun 2022 • Ruochen Li, Stamos Katsigiannis, Hubert P. H. Shum
Trajectory prediction of road users in real-world scenarios is challenging because their movement patterns are stochastic and complex.
Ranked #1 on
Trajectory Prediction
on SDD
no code implementations • 23 Apr 2022 • Haozheng Zhang, Hubert P. H. Shum, Edmond S. L. Ho
Our prediction performance achieves state-of-the-art research on both datasets.
no code implementations • 31 Mar 2022 • Daniel Organisciak, Hubert P. H. Shum, Ephraim Nwoye, Wai Lok Woo
We collect a data set of psychiatric observations of patients based on DSM-5 criteria.
1 code implementation • 16 Feb 2022 • Qi Feng, Hubert P. H. Shum, Shigeo Morishima
In this work, we first establish a large-scale dataset with varied settings called Depth360 to tackle the training data problem.
2 code implementations • 2 Feb 2022 • Abril Corona-Figueroa, Jonathan Frawley, Sam Bond-Taylor, Sarath Bethapudi, Hubert P. H. Shum, Chris G. Willcocks
Computed tomography (CT) is an effective medical imaging modality, widely used in the field of clinical medicine for the diagnosis of various pathologies.
no code implementations • 22 Oct 2021 • Asish Bera, Ratnadeep Dey, Debotosh Bhattacharjee, Mita Nasipuri, Hubert P. H. Shum
A presentation attack detection approach is addressed by assessing the visual quality of genuine and fake hand images.
no code implementations • 1 Oct 2021 • Qianhui Men, Hubert P. H. Shum, Edmond S. L. Ho, Howard Leung
Our key insights are two-fold.
no code implementations • 31 Aug 2021 • Haoran Duan, Fan Wan, Rui Sun, Zeyu Wang, Varun Ojha, Yu Guan, Hubert P. H. Shum, Bingzhang Hu, Yang Long
Our method achieved competitive performance in semi-supervised learning approaches on these crowd counting datasets.
1 code implementation • 10 Aug 2021 • Ben A. Rainbow, Qianhui Men, Hubert P. H. Shum
This is because they ignore the impact of the implicit correlations between different types of road users on the trajectory to be predicted - for example, a nearby pedestrian has a different level of influence from a nearby car.
no code implementations • 8 Jun 2021 • Manli Zhu, Qianhui Men, Edmond S. L. Ho, Howard Leung, Hubert P. H. Shum
To highlight the capacity of the deep network in modelling input features, we utilize raw joint positions instead of hand-crafted features.
1 code implementation • 13 Apr 2021 • Daniel Organisciak, Matthew Poyser, Aishah Alsehaim, Shanfeng Hu, Brian K. S. Isaac-Medina, Toby P. Breckon, Hubert P. H. Shum
As unmanned aerial vehicles (UAVs) become more accessible with a growing range of applications, the potential risk of UAV disruption increases.
1 code implementation • 25 Mar 2021 • Brian K. S. Isaac-Medina, Matt Poyser, Daniel Organisciak, Chris G. Willcocks, Toby P. Breckon, Hubert P. H. Shum
Unmanned Aerial Vehicles (UAV) can pose a major risk for aviation safety, due to both negligent and malicious use.
1 code implementation • 18 Oct 2019 • Dimitrios Sakkos, Hubert P. H. Shum, Edmond S. L. Ho
A core challenge in background subtraction (BGS) is handling videos with sudden illumination changes in consecutive frames.
no code implementations • 20 Aug 2019 • He Wang, Edmond S. L. Ho, Hubert P. H. Shum, Zhanxing Zhu
In this paper, we propose a new deep network to tackle these challenges by creating a natural motion manifold that is versatile for many applications.