Search Results for author: Yue Shi

Found 21 papers, 3 papers with code

SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis

1 code implementation29 Nov 2023 Ziqiao Peng, Wentao Hu, Yue Shi, Xiangyu Zhu, Xiaomei Zhang, Hao Zhao, Jun He, Hongyan Liu, Zhaoxin Fan

A lifelike talking head requires synchronized coordination of subject identity, lip movements, facial expressions, and head poses.

Talking Face Generation Talking Head Generation

Deep Equilibrium Diffusion Restoration with Parallel Sampling

1 code implementation20 Nov 2023 JieZhang Cao, Yue Shi, Kai Zhang, Yulun Zhang, Radu Timofte, Luc van Gool

Due to the inherent property of diffusion models, most existing methods need long serial sampling chains to restore HQ images step-by-step, resulting in expensive sampling time and high computation costs.

Image Restoration

The bionic neural network for external simulation of human locomotor system

no code implementations11 Sep 2023 Yue Shi, Shuhao Ma, Yihui Zhao

The results demonstrate that the proposed deep learning method can effectively identify subject-specific MSK physiological parameters and the trained physics-informed forward-dynamics surrogate yields accurate motion and muscle forces predictions.

The online learning architecture with edge computing for high-level control for assisting patients

no code implementations10 Sep 2023 Yue Shi, Yihui Zhao

To address these challenges, this paper introduces a novel online adversarial learning architecture integrated with edge computing for high-level lower-limb exoskeleton control.

Edge-computing

FocalDreamer: Text-driven 3D Editing via Focal-fusion Assembly

no code implementations21 Aug 2023 Yuhan Li, Yishun Dou, Yue Shi, Yu Lei, Xuanhong Chen, Yi Zhang, Peng Zhou, Bingbing Ni

While text-3D editing has made significant strides in leveraging score distillation sampling, emerging approaches still fall short in delivering separable, precise and consistent outcomes that are vital to content creation.

A Physics-Informed Low-Shot Learning For sEMG-Based Estimation of Muscle Force and Joint Kinematics

no code implementations8 Jul 2023 Yue Shi, Shuhao Ma, Yihui Zhao, Zhiqiang Zhang

This method seamlessly integrates Lagrange's equation of motion and inverse dynamic muscle model into the generative adversarial network (GAN) framework for structured feature decoding and extrapolated estimation from the small sample data.

Generative Adversarial Network

A Fast Fourier Convolutional Deep Neural Network For Accurate and Explainable Discrimination Of Wheat Yellow Rust And Nitrogen Deficiency From Sentinel-2 Time-Series Data

no code implementations29 Jun 2023 Yue Shi, Liangxiu Han, Pablo González-Moreno, Darren Dancey, Wenjiang Huang, Zhiqiang Zhang, Yuanyuan Liu, Mengning Huan, Hong Miao, Min Dai

Specifically, unlike the existing CNN models, the main components of the proposed model include: 1) a fast Fourier convolutional block, a newly fast Fourier transformation kernel as the basic perception unit, to substitute the traditional convolutional kernel to capture both local and global responses to plant stress in various time-scale and improve computing efficiency with reduced learning parameters in Fourier domain; 2) Capsule Feature Encoder to encapsulate the extracted features into a series of vector features to represent part-to-whole relationship with the hierarchical structure of the host-stress interactions of the specific stress.

Time Series

SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Faces

1 code implementation19 Jun 2023 Ziqiao Peng, Yihao Luo, Yue Shi, Hao Xu, Xiangyu Zhu, Jun He, Hongyan Liu, Zhaoxin Fan

To enhance the visual accuracy of generated lip movement while reducing the dependence on labeled data, we propose a novel framework SelfTalk, by involving self-supervision in a cross-modals network system to learn 3D talking faces.

3D Face Animation Lip Reading

USR: Unsupervised Separated 3D Garment and Human Reconstruction via Geometry and Semantic Consistency

no code implementations21 Feb 2023 Yue Shi, Yuxuan Xiong, Jingyi Chai, Bingbing Ni, Wenjun Zhang

To address these issues, we propose an unsupervised separated 3D garments and human reconstruction model (USR), which reconstructs the human body and authentic textured clothes in layers without 3D models.

Virtual Try-on

GARF:Geometry-Aware Generalized Neural Radiance Field

no code implementations5 Dec 2022 Yue Shi, Dingyi Rong, Bingbing Ni, Chang Chen, Wenjun Zhang

To address these issues, we propose Geometry-Aware Generalized Neural Radiance Field (GARF) with a geometry-aware dynamic sampling (GADS) strategy to perform real-time novel view rendering and unsupervised depth estimation on unseen scenes without per-scene optimization.

Depth Estimation Novel View Synthesis +1

A Supervisory Volt/VAR Control Scheme for Coordinating Voltage Regulators with Smart Inverters on a Distribution System

no code implementations21 Sep 2022 Valliappan Muthukaruppan, Yue Shi, Mesut Baran

This paper focuses on the effective use of smart inverters for Volt/Var control (VVC) on a distribution system.

A Latent Encoder Coupled Generative Adversarial Network (LE-GAN) for Efficient Hyperspectral Image Super-resolution

no code implementations16 Nov 2021 Yue Shi, Liangxiu Han, Lianghao Han, Sheng Chang, Tongle Hu, Darren Dancey

To alleviate the problem of mode collapse, this work has proposed a novel GAN model coupled with a latent encoder (LE-GAN), which can map the generated spectral-spatial features from the image space to the latent space and produce a coupling component to regularise the generated samples.

Generative Adversarial Network Hyperspectral Image Super-Resolution +1

Geometric Granularity Aware Pixel-To-Mesh

no code implementations ICCV 2021 Yue Shi, Bingbing Ni, Jinxian Liu, Dingyi Rong, Ye Qian, Wenjun Zhang

Pixel-to-mesh has wide applications, especially in virtual or augmented reality, animation and game industry.

Fast Object Detection with Latticed Multi-Scale Feature Fusion

no code implementations5 Nov 2020 Yue Shi, Bo Jiang, Zhengping Che, Jian Tang

In this work, we present a novel module, the Fluff block, to alleviate drawbacks of current multi-scale fusion methods and facilitate multi-scale object detection.

Object object-detection +1

Nematic Fluctuations in an Orbital Selective Superconductor Fe$_{1+y}$Te$_{1-x}$Se$_{x}$

no code implementations29 Jun 2020 Qianni Jiang, Yue Shi, Morten H. Christensen, Joshua Sanchez, Bevin Huang, Zhong Lin, Zhaoyu Liu, Paul Malinowski, Xiaodong Xu, Rafael M. Fernandes, Jiun-Haw Chu

Near $x = 0$, in proximity to the double-stripe magnetic order of Fe$_{1+y}$Te, a diverging $B_{1g}$ nematic susceptibility is observed.

Superconductivity Strongly Correlated Electrons

A Biologically Interpretable Two-stage Deep Neural Network (BIT-DNN) For Vegetation Recognition From Hyperspectral Imagery

no code implementations19 Apr 2020 Yue Shi, Liangxiu Han, Wenjiang Huang, Sheng Chang, Yingying Dong, Darren Dancey, Lianghao Han

Spectral-spatial based deep learning models have recently proven to be effective in hyperspectral image (HSI) classification for various earth monitoring applications such as land cover classification and agricultural monitoring.

Classification General Classification +2

On Sampling Strategies for Neural Network-based Collaborative Filtering

no code implementations23 Jun 2017 Ting Chen, Yizhou Sun, Yue Shi, Liangjie Hong

In this paper, we propose a general neural network-based recommendation framework, which subsumes several existing state-of-the-art recommendation algorithms, and address the efficiency issue by investigating sampling strategies in the stochastic gradient descent training for the framework.

Collaborative Filtering

Joint Text Embedding for Personalized Content-based Recommendation

no code implementations4 Jun 2017 Ting Chen, Liangjie Hong, Yue Shi, Yizhou Sun

While latent factors of items can be learned effectively from user interaction data, in many cases, such data is not available, especially for newly emerged items.

News Recommendation Recommendation Systems

Learning Subclass Representations for Visually-varied Image Classification

no code implementations12 Jan 2016 Xinchao Li, Peng Xu, Yue Shi, Martha Larson, Alan Hanjalic

The novelty of the approach is that subclass representations make use of not only the content of the photos themselves, but also information on the co-occurrence of their tags, which determines membership in both subclasses and top-level classes.

Classification General Classification +2

Exploiting Social Tags for Cross-Domain Collaborative Filtering

no code implementations20 Feb 2013 Yue Shi, Martha Larson, Alan Hanjalic

A key question to be answered in the context of CDCF is what common characteristics can be deployed to link different domains for effective knowledge transfer.

Collaborative Filtering Recommendation Systems +2

Cannot find the paper you are looking for? You can Submit a new open access paper.