no code implementations • 7 Nov 2024 • Panwen Hu, Nan Xiao, Feifei Li, Yongquan Chen, Rui Huang
In this era of videos, automatic video editing techniques attract more and more attention from industry and academia since they can reduce workloads and lower the requirements for human editors.
no code implementations • 7 Nov 2024 • Panwen Hu, Jin Jiang, Jianqi Chen, Mingfei Han, Shengcai Liao, Xiaojun Chang, Xiaodan Liang
Our contributions include the introduction of StoryAgent, a versatile framework for video generation tasks, and novel techniques for preserving protagonist consistency.
no code implementations • 7 Nov 2024 • Panwen Hu, Rui Huang
However, online students usually have a poor experience since the information acquired from the views provided by the broadcast platforms is limited.
1 code implementation • 14 Oct 2024 • Jianqi Chen, Panwen Hu, Xiaojun Chang, Zhenwei Shi, Michael Christian Kampffmeyer, Xiaodan Liang
Recent advancements in human motion synthesis have focused on specific types of motions, such as human-scene interaction, locomotion or human-human interaction, however, there is a lack of a unified system capable of generating a diverse combination of motion types.
no code implementations • 23 Aug 2024 • Cong Wang, Jiaxi Gu, Panwen Hu, Haoyu Zhao, Yuanfan Guo, Jianhua Han, Hang Xu, Xiaodan Liang
Specifically, for the sketch-to-video generation task, EasyControl achieves an improvement of 152. 0 on FVD and 19. 9 on IS, respectively, in UCF101 compared with VideoComposer.
no code implementations • 25 Mar 2024 • Laiyan Ding, Panwen Hu, Jie Li, Rui Huang
To address this RGB-TSDF distribution difference, we propose a two-stage network with a 3D RGB feature completion module that completes RGB features with meaningful values for occluded areas.
no code implementations • 5 Dec 2023 • Cong Wang, Jiaxi Gu, Panwen Hu, Songcen Xu, Hang Xu, Xiaodan Liang
Especially for fidelity, our model has a powerful image retention ability and delivers the best results in UCF101 compared to other image-to-video models to our best knowledge.
no code implementations • 28 Sep 2020 • Panwen Hu, Jiazhen Liu, Rui Huang
The attention mechanism has been proved to be helpful in solving the occlusion problem by a large number of existing methods.
no code implementations • 9 Mar 2019 • Panwen Hu, Zizheng Yan, Rui Huang, Feng Yin
Visual tracking is fragile in some difficult scenarios, for instance, appearance ambiguity and variation, occlusion can easily degrade most of visual trackers to some extent.