Search Results for author: Lu Dong

Found 12 papers, 4 papers with code

Ig3D: Integrating 3D Face Representations in Facial Expression Inference

no code implementations29 Aug 2024 Lu Dong, Xiao Wang, Srirangaraj Setlur, Venu Govindaraju, Ifeoma Nwogu

Our experimental results demonstrate that our proposed method outperforms the state-of-the-art AffectNet VA estimation and RAF-DB classification tasks.

MSCT: Addressing Time-Varying Confounding with Marginal Structural Causal Transformer for Counterfactual Post-Crash Traffic Prediction

no code implementations19 Jul 2024 Shuang Li, Ziyuan Pu, Nan Zhang, Duxin Chen, Lu Dong, Daniel J. Graham, Yinhai Wang

In the absence of ground-truth data, a synthetic data generation procedure is proposed to emulate the causal mechanism between traffic speed, crashes, and covariates.

counterfactual Prediction +2

Towards Open Domain Text-Driven Synthesis of Multi-Person Motions

no code implementations28 May 2024 Mengyi Shan, Lu Dong, Yutao Han, Yuan YAO, Tao Liu, Ifeoma Nwogu, Guo-Jun Qi, Mitch Hill

To our knowledge, our method is the first to generate multi-subject motion sequences with high diversity and fidelity from a large variety of textual prompts.

Diversity Motion Generation

SignAvatar: Sign Language 3D Motion Reconstruction and Generation

no code implementations13 May 2024 Lu Dong, Lipisha Chaudhary, Fei Xu, Xiao Wang, Mason Lary, Ifeoma Nwogu

Achieving expressive 3D motion reconstruction and automatic generation for isolated sign words can be challenging, due to the lack of real-world 3D sign-word data, the complex nuances of signing motions, and the cross-modal understanding of sign language semantics.

EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real World

1 code implementation CVPR 2024 Yifei HUANG, Guo Chen, Jilan Xu, Mingfang Zhang, Lijin Yang, Baoqi Pei, Hongjie Zhang, Lu Dong, Yali Wang, LiMin Wang, Yu Qiao

Along with the videos we record high-quality gaze data and provide detailed multimodal annotations, formulating a playground for modeling the human ability to bridge asynchronous procedural actions from different viewpoints.

 Ranked #1 on Action Anticipation on EgoExoLearn (using extra training data)

Action Anticipation Action Quality Assessment +2

MoVQA: A Benchmark of Versatile Question-Answering for Long-Form Movie Understanding

no code implementations8 Dec 2023 Hongjie Zhang, Yi Liu, Lu Dong, Yifei HUANG, Zhen-Hua Ling, Yali Wang, LiMin Wang, Yu Qiao

While several long-form VideoQA datasets have been introduced, the length of both videos used to curate questions and sub-clips of clues leveraged to answer those questions have not yet reached the criteria for genuine long-form video understanding.

Question Answering Video Question Answering +1

Robust Navigation with Cross-Modal Fusion and Knowledge Transfer

1 code implementation23 Sep 2023 Wenzhe Cai, Guangran Cheng, Lingyue Kong, Lu Dong, Changyin Sun

We consider the problem of improving the generalization of mobile robots and achieving sim-to-real transfer for navigation skills.

Transfer Learning

Language-guided Human Motion Synthesis with Atomic Actions

1 code implementation18 Aug 2023 Yuanhao Zhai, Mingzhen Huang, Tianyu Luan, Lu Dong, Ifeoma Nwogu, Siwei Lyu, David Doermann, Junsong Yuan

In this paper, we propose ATOM (ATomic mOtion Modeling) to mitigate this problem, by decomposing actions into atomic actions, and employing a curriculum learning strategy to learn atomic action composition.

Diversity Motion Synthesis

Multi-robot Social-aware Cooperative Planning in Pedestrian Environments Using Multi-agent Reinforcement Learning

no code implementations29 Nov 2022 Zichen He, Chunwei Song, Lu Dong

Safe and efficient co-planning of multiple robots in pedestrian participation environments is promising for applications.

Multi-agent Reinforcement Learning

Cognitive Diagnosis with Explicit Student Vector Estimation and Unsupervised Question Matrix Learning

no code implementations1 Mar 2022 Lu Dong, ZhenHua Ling, Qiang Ling, Zefeng Lai

Then, based on the estimated student vectors, the probabilistic part of DINA can be modified to a student dependent model that the slip and guess rates are related to student vectors.

cognitive diagnosis

Multi-agent Soft Actor-Critic Based Hybrid Motion Planner for Mobile Robots

no code implementations13 Dec 2021 Zichen He, Lu Dong, Chunwei Song, Changyin Sun

In this paper, a novel hybrid multi-robot motion planner that can be applied under non-communication and local observable conditions is presented.

Cannot find the paper you are looking for? You can Submit a new open access paper.