no code implementations • 23 Aug 2024 • Shuai Yang, Jing Tan, Mengchen Zhang, Tong Wu, Yixuan Li, Gordon Wetzstein, Ziwei Liu, Dahua Lin
A desired virtual 3D scene should 1) exhibit omnidirectional view consistency, and 2) allow for free exploration in complex scene hierarchies.
no code implementations • 22 Jul 2024 • Xin Jiang, Kaiqiang Wang, Yinlong Wang, Fengchang Lv, Taiyang Peng, Shuai Yang, Xianteng Wu, Pengye Zhang, Shuo Yuan, Yifan Zeng
In recommendation systems, the relevance and novelty of the final results are selected through a cascade system of Matching -> Ranking -> Strategy.
1 code implementation • 20 Jul 2024 • Yuhang Bai, Zichuan Huang, Wenshuo Gao, Shuai Yang, Jiaying Liu
Artistic text generation includes artistic text stylization and semantic typography.
1 code implementation • 11 Jul 2024 • Shuai Yang, Yuying Ge, Yang Li, Yukang Chen, Yixiao Ge, Ying Shan, Yingcong Chen
We further propose multimodal attention sink mechanism to enable the generation of stories with up to 25 sequences (only 10 for training) in a highly efficient autoregressive manner.
1 code implementation • 13 Jun 2024 • Ruiyuan Lyu, Tai Wang, Jingli Lin, Shuai Yang, Xiaohan Mao, Yilun Chen, Runsen Xu, Haifeng Huang, Chenming Zhu, Dahua Lin, Jiangmiao Pang
With the emergence of LLMs and their integration with other data modalities, multi-modal 3D perception attracts more attention due to its connectivity to the physical world and makes rapid progress.
1 code implementation • 5 Jun 2024 • Jiahang Zhang, Lilang Lin, Shuai Yang, Jiaying Liu
Following the taxonomy of context-based, generative learning, and contrastive learning approaches, we make a thorough review and benchmark of existing works and shed light on the future possible directions.
no code implementations • 23 May 2024 • Zeqi Xiao, Yifan Zhou, Shuai Yang, Xingang Pan
MOFT provides a distinct set of benefits, including the ability to encode comprehensive motion information with clear interpretability, extraction without the need for training, and generalizability across diverse architectures.
1 code implementation • 16 May 2024 • Yilun Chen, Shuai Yang, Haifeng Huang, Tai Wang, Ruiyuan Lyu, Runsen Xu, Dahua Lin, Jiangmiao Pang
Prior studies on 3D scene understanding have primarily developed specialized models for specific tasks or required task-specific fine-tuning.
1 code implementation • CVPR 2024 • Shuai Yang, Yifan Zhou, Ziwei Liu, Chen Change Loy
In this paper, we introduce FRESCO, intra-frame correspondence alongside inter-frame correspondence to establish a more robust spatial-temporal constraint.
1 code implementation • 18 Mar 2024 • Yushi Lan, Fangzhou Hong, Shuai Yang, Shangchen Zhou, Xuyi Meng, Bo Dai, Xingang Pan, Chen Change Loy
The latent is decoded by a transformer-based decoder into a high-capacity 3D neural field.
1 code implementation • 16 Mar 2024 • Namyong Park, Xing Wang, Antoine Simoulin, Shuai Yang, Grey Yang, Ryan Rossi, Puja Trivedi, Nesreen Ahmed
To address these limitations, the forward-forward algorithm (FF) was recently proposed as an alternative to BP in the image classification domain, which trains NNs by performing two forward passes over positive and negative data.
no code implementations • 11 Mar 2024 • Yukun Song, Dayuan Cao, Jiali Miao, Shuai Yang, Kui Yu
Multi-label feature selection serves as an effective mean for dealing with high-dimensional multi-label data.
1 code implementation • 4 Mar 2024 • Fangzhou Hong, Jiaxiang Tang, Ziang Cao, Min Shi, Tong Wu, Zhaoxi Chen, Shuai Yang, Tengfei Wang, Liang Pan, Dahua Lin, Ziwei Liu
Specifically, it is powered by a text-conditioned tri-plane latent diffusion model, which quickly generates coarse 3D samples for fast prototyping.
1 code implementation • 2 Feb 2024 • Guanlin Li, Shuai Yang, Jie Zhang, Tianwei Zhang
With the development of generative models, the quality of generated content keeps increasing.
1 code implementation • 17 Jan 2024 • Hao Yang, Jianxin Yuan, Shuai Yang, Linhe Xu, Shuo Yuan, Yifan Zeng
2) Prompt model is designed to generate individualized creatives for different user groups, which can further improve the diversity and quality.
1 code implementation • 17 Jan 2024 • Shuai Yang, Hao Yang, Zhuang Zou, Linhe Xu, Shuo Yuan, Yifan Zeng
These methods typically involve the training of calibrators using a validation set and subsequently applying these calibrators to correct the original estimated values during online inference.
no code implementations • 9 Jan 2024 • Qinyi Luo, Penghan Wang, Wei zhang, Fan Lai, Jiachen Mao, Xiaohan Wei, Jun Song, Wei-Yu Tsai, Shuai Yang, Yuxi Hu, Xuehai Qian
Huge embedding tables in modern Deep Learning Recommender Models (DLRM) require prohibitively large memory during training and inference.
no code implementations • CVPR 2024 • Lin Song, Yukang Chen, Shuai Yang, Xiaohan Ding, Yixiao Ge, Ying-Cong Chen, Ying Shan
We empirically show that sparse attention not only reduces computational demands but also enhances model performance in both NLP and multi-modal tasks.
no code implementations • 7 Dec 2023 • Tong Wu, Zhibing Li, Shuai Yang, Pan Zhang, Xinggang Pan, Jiaqi Wang, Dahua Lin, Ziwei Liu
Extensive experiments demonstrate the effectiveness of HyperDreamer in modeling region-aware materials with high-resolution textures and enabling user-friendly editing.
no code implementations • CVPR 2024 • Yuming Jiang, Tianxing Wu, Shuai Yang, Chenyang Si, Dahua Lin, Yu Qiao, Chen Change Loy, Ziwei Liu
In this paper, we study the task of video generation with image prompts, which provide more accurate and direct content control beyond the text prompts.
1 code implementation • 26 Oct 2023 • Shuai Yang, Zhifei Chen, Pengguang Chen, Xi Fang, Yixun Liang, Shu Liu, Yingcong Chen
Defect inspection is paramount within the closed-loop manufacturing system.
1 code implementation • 5 Oct 2023 • Shuai Yang, Yukang Chen, Luozhou Wang, Shu Liu, Yingcong Chen
Denoising Diffusion Probabilistic Models (DDPMs) have garnered popularity for data generation across various domains.
1 code implementation • 8 Sep 2023 • Junzhe Zhang, Yushi Lan, Shuai Yang, Fangzhou Hong, Quan Wang, Chai Kiat Yeo, Ziwei Liu, Chen Change Loy
In this paper, we address the challenging problem of 3D toonification, which involves transferring the style of an artistic domain onto a target 3D face with stylized geometry and texture.
1 code implementation • ICCV 2023 • Yuxin Jiang, Liming Jiang, Shuai Yang, Chen Change Loy
The challenges of this task lie in the complexity of the scenes, the unique features of anime style, and the lack of high-quality datasets to bridge the domain gap.
1 code implementation • ICCV 2023 • Luozhou Wang, Shuai Yang, Shu Liu, Ying-Cong Chen
Conditional diffusion models have demonstrated impressive performance in image manipulation tasks.
no code implementations • 13 Jun 2023 • Shuai Yang, Yifan Zhou, Ziwei Liu, Chen Change Loy
The framework includes two parts: key frame translation and full video translation.
1 code implementation • 7 Jun 2023 • Shuai Yang, Liming Jiang, Ziwei Liu, Chen Change Loy
In this paper, we introduce a novel versatile framework, Generative Prior-guided UNsupervised Image-to-image Translation (GP-UNIT), that improves the quality, applicability and controllability of the existing translation models.
no code implementations • 29 May 2023 • Shuai Yang, Lixin Zhang, Feng Xia, Leyu Lin
Graph-based retrieval strategies are inevitably hijacked by heavy users and popular items, leading to the convergence of candidates for users and the lack of system-level diversity.
1 code implementation • ICCV 2023 • Yuming Jiang, Shuai Yang, Tong Liang Koh, Wayne Wu, Chen Change Loy, Ziwei Liu
In this work, we present Text2Performer to generate vivid human videos with articulated motions from texts.
1 code implementation • ICCV 2023 • Shuai Yang, Liming Jiang, Ziwei Liu, Chen Change Loy
Recent advances in face manipulation using StyleGAN have produced impressive results.
no code implementations • 25 Jan 2023 • Hanyang Liu, Shuai Yang, Feng Qi, Shuaiwen Wang
We also introduce a novel differentiable indexing method for the proposed adaptive curve transformation, which allows gradients with respect to the discrete indices to flow freely through the curve transformation layer, enabling the learned window sizes to be updated flexibly during training.
1 code implementation • 3 Jan 2023 • Shuhao Shi, Kai Qiao, Jian Chen, Shuai Yang, Jie Yang, Baojie Song, Linyuan Wang, Bin Yan
However, in addition to low annotation quality, existing benchmarks generally have incomplete user relationships, suppressing graph-based account detection research.
Ranked #1 on Stance Detection on MGTAB
no code implementations • ICCV 2023 • Junzhe Zhang, Yushi Lan, Shuai Yang, Fangzhou Hong, Quan Wang, Chai Kiat Yeo, Ziwei Liu, Chen Change Loy
In this paper, we address the challenging problem of 3D toonification, which involves transferring the style of an artistic domain onto a target 3D face with stylized geometry and texture.
no code implementations • CVPR 2023 • Yushi Lan, Xuyi Meng, Shuai Yang, Chen Change Loy, Bo Dai
In this paper, we study the challenging problem of 3D GAN inversion where a latent code is predicted given a single face image to faithfully recover its 3D shapes and detailed textures.
1 code implementation • 22 Sep 2022 • Shuai Yang, Liming Jiang, Ziwei Liu, Chen Change Loy
Although a series of successful portrait image toonification models built upon the powerful StyleGAN have been proposed, these image-oriented methods have obvious limitations when applied to videos, such as the fixed frame size, the requirement of face alignment, missing non-facial details and temporal inconsistency.
2 code implementations • 31 May 2022 • Yuming Jiang, Shuai Yang, Haonan Qiu, Wayne Wu, Chen Change Loy, Ziwei Liu
In this work, we present a text-driven controllable framework, Text2Human, for a high-quality and diverse human generation.
no code implementations • 8 May 2022 • Shuhao Shi, Jian Chen, Kai Qiao, Shuai Yang, Linyuan Wang, Bin Yan
The Graph Convolutional Networks (GCNs) have achieved excellent results in node classification tasks, but the model's performance at low label rates is still unsatisfactory.
1 code implementation • CVPR 2022 • Shuai Yang, Liming Jiang, Ziwei Liu, Chen Change Loy
In this work, we present a novel framework, Generative Prior-guided UNsupervised Image-to-image Translation (GP-UNIT), to improve the overall quality and applicability of the translation algorithm.
1 code implementation • CVPR 2022 • Shuai Yang, Liming Jiang, Ziwei Liu, Chen Change Loy
Recent studies on StyleGAN show high performance on artistic portrait generation by transfer learning with limited data.
no code implementations • 26 Jun 2021 • Shuai Yang, Kai Qiao
In this paper, we propose a novel encoder, called ShapeEditor, for high-resolution, realistic and high-fidelity face exchange.
no code implementations • 25 May 2021 • S. Shi, Kai Qiao, Shuai Yang, L. Wang, J. Chen, Bin Yan
Traditional methods such as resampling, reweighting, and synthetic samples that deal with imbalanced datasets are no longer applicable in GNN.
no code implementations • 28 Feb 2021 • Shuai Yang, Hao Wang, Kui Yu, Fuyuan Cao, Xindong Wu
Local causal structure learning aims to discover and distinguish direct causes (parents) and direct effects (children) of a variable of interest from data.
no code implementations • 12 Nov 2020 • Shuai Yang, Kui Yu, Fuyuan Cao, Lin Liu, Hao Wang, Jiuyong Li
In this paper, we study the cases where at the training phase the target domain data is unavailable and only well-labeled source domain data is available, called robust domain adaptation.
1 code implementation • 23 Sep 2020 • Wenjing Wang, Shuai Yang, Jizheng Xu, Jiaying Liu
In this article, we address the problem by jointly considering the intrinsic properties of stylization and temporal consistency.
5 code implementations • 12 Sep 2020 • Jieming Zhu, Jinyang Liu, Shuai Yang, Qi Zhang, Xiuqiang He
We have publicly released the benchmarking code, evaluation protocols, and hyper-parameter settings of our work to promote reproducible research in this field.
no code implementations • 8 Sep 2020 • Jaroslav Adam, Christine Aidala, Aaron Angerami, Benjamin Audurier, Carlos Bertulani, Christian Bierlich, Boris Blok, James Daniel Brandenburg, Stanley Brodsky, Aleksandr Bylinkin, Veronica Canoa Roman, Francesco Giovanni Celiberto, Jan Cepila, Grigorios Chachamis, Brian Cole, Guillermo Contreras, David d'Enterria, Adrian Dumitru, Arturo Fernández Téllez, Leonid Frankfurt, Maria Beatriz Gay Ducati, Frank Geurts, Gustavo Gil da Silveira, Francesco Giuli, Victor P. Goncalves, Iwona Grabowska-Bold, Vadim Guzey, Lucian Harland-Lang, Martin Hentschinski, Timothy J. Hobbs, Jamal Jalilian-Marian, Valery A. Khoze, Yongsun Kim, Spencer R. Klein, Simon Knapen, Mariola Kłusek-Gawenda, Michal Krelina, Evgeny Kryshen, Tuomas Lappi, Constantin Loizides, Agnieszka Luszczak, Magno Machado, Heikki Mäntysaari, Daniel Martins, Ronan McNulty, Michael Murray, Jan Nemchik, Jacquelyn Noronha-Hostler, Joakim Nystrand, Alessandro Papa, Bernard Pire, Mateusz Ploskon, Marius Przybycien, John P. Ralston, Patricia Rebello Teles, Christophe Royon, Björn Schenke, William Schmidke, Janet Seger, Anna Stasto, Peter Steinberg, Mark Strikman, Antoni Szczurek, Lech Szymanowski, Daniel Tapia Takaki, Ralf Ulrich, Orlando Villalobos Baillie, Ramona Vogt, Samuel Wallon, Michael Winn, Keping Xie, Zhangbu Xu, Shuai Yang, Mikhail Zhalov, Jian Zhou
Ultra-peripheral collisions (UPCs) involving heavy ions and protons are the energy frontier for photon-mediated interactions.
High Energy Physics - Phenomenology High Energy Physics - Experiment Nuclear Experiment
no code implementations • 3 Aug 2020 • Yu Han, Shuai Yang, Wenjing Wang, Jiaying Liu
Moreover, built upon the sampling network, we present design draft to real fashion item translation network (D2RNet), where two separate translation streams that focus on texture and shape, respectively, are combined tactfully to get both benefits.
1 code implementation • ECCV 2020 • Shuai Yang, Zhangyang Wang, Jiaying Liu, Zongming Guo
We present a sketch refinement strategy, as inspired by the coarse-to-fine drawing process of the artists, which we show can help our model well adapt to casual and varied sketches without the need for real sketch training data.
no code implementations • 9 Jan 2020 • Yueyu Hu, Shuai Yang, Wenhan Yang, Ling-Yu Duan, Jiaying Liu
In this paper, we come up with a novel image coding framework by leveraging both the compressive and the generative models, to support machine vision and human perception tasks jointly.
no code implementations • 20 Oct 2019 • Shuai Yang, Wenqi Zhu, Yuesheng Zhu
In the first stage, an affinity matrix is generated from data.
no code implementations • 12 Oct 2019 • Shuai Yang, Wenqi Zhu, Yuesheng Zhu
Subspace clustering aims to cluster unlabeled data that lies in a union of low-dimensional linear subspaces.
1 code implementation • 3 Oct 2019 • Shuai Yang, Hao Wang, Kui Yu, Fuyuan Cao, Xindong Wu
To tackle this issue, we propose a novel Efficient Local Causal Structure learning algorithm, named ELCS.
1 code implementation • 4 Aug 2019 • Shuai Yang, Hao Wang, Yuhong Zhang, Pei-Pei Li, Yi Zhu, Xuegang Hu
Domain adaptation aims to exploit the knowledge in source domain to promote the learning tasks in target domain, which plays a critical role in real-world applications.
no code implementations • 8 May 2019 • Shuai Yang, Wenjing Wang, Jiaying Liu
To the best of our knowledge, this is the largest dataset for text effect transfer to date.
1 code implementation • ICCV 2019 • Shuai Yang, Zhangyang Wang, Zhaowen Wang, Ning Xu, Jiaying Liu, Zongming Guo
In this paper, we present the first text style transfer network that allows for real-time control of the crucial stylistic degree of the glyph through an adjustable parameter.
no code implementations • 2 May 2019 • Shuai Yang, Wenqi Zhu, Yuesheng Zhu
The affinity matrix is obtained in the first stage, then it goes through the second stage, where the proposed GBTO is applied to generate a reconstructed affinity matrix with more authentic similarity between data points.
no code implementations • 1 May 2019 • Wenqi Zhu, Yuesheng Zhu, Li Zhong, Shuai Yang
In this paper, we propose a noise-robust algorithm, Restricted Connection Orthogonal Matching Pursuit for Sparse Subspace Clustering (RCOMP-SSC), to improve the clustering accuracy and maintain the low computational time by restricting the number of connections of each data point during the iteration of OMP.
no code implementations • 16 Dec 2018 • Shuai Yang, Jiaying Liu, Wenjing Wang, Zongming Guo
The key idea is to train our network to accomplish both the objective of style transfer and style removal, so that it can learn to disentangle and recombine the content and style features of text effects images.
no code implementations • 9 Oct 2018 • Shuai Yang, Jiaying Liu, Wenhan Yang, Zongming Guo
The stylization is then followed by a context-aware layout design algorithm, where cues for both seamlessness and aesthetics are employed to determine the optimal layout of the shape in the background.
no code implementations • CVPR 2018 • Jiaying Liu, Wenhan Yang, Shuai Yang, Zongming Guo
In this paper, we address the problem of video rain removal by constructing deep recurrent convolutional networks.
1 code implementation • CVPR 2017 • Shuai Yang, Jiaying Liu, Zhouhui Lian, Zongming Guo
It allows our algorithm to produce artistic typography that fits for both local texture patterns and the global spatial distribution in the example.