Search Results for author: Panwen Hu

Found 9 papers, 1 papers with code

A Reinforcement Learning-Based Automatic Video Editing Method Using Pre-trained Vision-Language Model

no code implementations7 Nov 2024 Panwen Hu, Nan Xiao, Feifei Li, Yongquan Chen, Rui Huang

In this era of videos, automatic video editing techniques attract more and more attention from industry and academia since they can reduce workloads and lower the requirements for human editors.

Language Modeling Language Modelling +2

StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaboration

no code implementations7 Nov 2024 Panwen Hu, Jin Jiang, Jianqi Chen, Mingfei Han, Shengcai Liao, Xiaojun Chang, Xiaodan Liang

Our contributions include the introduction of StoryAgent, a versatile framework for video generation tasks, and novel techniques for preserving protagonist consistency.

Video Generation

A multi-purpose automatic editing system based on lecture semantics for remote education

no code implementations7 Nov 2024 Panwen Hu, Rui Huang

However, online students usually have a poor experience since the information acquired from the views provided by the broadcast platforms is limited.

Sitcom-Crafter: A Plot-Driven Human Motion Generation System in 3D Scenes

1 code implementation14 Oct 2024 Jianqi Chen, Panwen Hu, Xiaojun Chang, Zhenwei Shi, Michael Christian Kampffmeyer, Xiaodan Liang

Recent advancements in human motion synthesis have focused on specific types of motions, such as human-scene interaction, locomotion or human-human interaction, however, there is a lack of a unified system capable of generating a diverse combination of motion types.

Motion Generation Motion Synthesis +1

EasyControl: Transfer ControlNet to Video Diffusion for Controllable Generation and Interpolation

no code implementations23 Aug 2024 Cong Wang, Jiaxi Gu, Panwen Hu, Haoyu Zhao, Yuanfan Guo, Jianhua Han, Hang Xu, Xiaodan Liang

Specifically, for the sketch-to-video generation task, EasyControl achieves an improvement of 152. 0 on FVD and 19. 9 on IS, respectively, in UCF101 compared with VideoComposer.

Image Generation Video Generation

Towards Balanced RGB-TSDF Fusion for Consistent Semantic Scene Completion by 3D RGB Feature Completion and a Classwise Entropy Loss Function

no code implementations25 Mar 2024 Laiyan Ding, Panwen Hu, Jie Li, Rui Huang

To address this RGB-TSDF distribution difference, we propose a two-stage network with a 3D RGB feature completion module that completes RGB features with meaningful values for occluded areas.

DreamVideo: High-Fidelity Image-to-Video Generation with Image Retention and Text Guidance

no code implementations5 Dec 2023 Cong Wang, Jiaxi Gu, Panwen Hu, Songcen Xu, Hang Xu, Xiaodan Liang

Especially for fidelity, our model has a powerful image retention ability and delivers the best results in UCF101 compared to other image-to-video models to our best knowledge.

Image to Video Generation

Concentrated Multi-Grained Multi-Attention Network for Video Based Person Re-Identification

no code implementations28 Sep 2020 Panwen Hu, Jiazhen Liu, Rui Huang

The attention mechanism has been proved to be helpful in solving the occlusion problem by a large number of existing methods.

Video-Based Person Re-Identification

How Effectively Can Indoor Wireless Positioning Relieve Visual Tracking Pains: A Camera-Rao Bound Viewpoint

no code implementations9 Mar 2019 Panwen Hu, Zizheng Yan, Rui Huang, Feng Yin

Visual tracking is fragile in some difficult scenarios, for instance, appearance ambiguity and variation, occlusion can easily degrade most of visual trackers to some extent.

Visual Tracking

Cannot find the paper you are looking for? You can Submit a new open access paper.