Search Results for author:
Found 12 papers, 5 papers with code
General-Purpose Speech Representation Learning through a Self-Supervised Multi-Granularity Framework
This paper presents a self-supervised learning framework, named MGF, for general-purpose speech representation learning.
A Battle of Network Structures: An Empirical Study of CNN, Transformer, and MLP
Convolutional neural networks (CNN) are the dominant deep neural network (DNN) architecture for computer vision.
Sparse MLP for Image Recognition: Is Self-Attention Really Necessary?
Specifically, we replace the MLP module in the token-mixing step with a novel sparse MLP (sMLP) module.
Ranked #391 on
Image Classification
on ImageNet
Zero-Shot Text-to-Speech for Text-Based Insertion in Audio Narration
Given a piece of speech and its transcript text, text-based speech editing aims to generate speech that can be seamlessly inserted into the given speech by editing the transcript.
When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanism
It can be even replaced by a zero-parameter operation.
Ranked #67 on
Object Detection
on COCO minival
(APM metric)
RetrieverTTS: Modeling Decomposed Factors for Text-Based Speech Insertion
In the proposed paradigm, global and local factors in speech are explicitly decomposed and separately manipulated to achieve high speaker similarity and continuous prosody.
An Anchor-Free Detector for Continuous Speech Keyword Spotting
Continuous Speech Keyword Spotting (CSKWS) is a task to detect predefined keywords in a continuous speech.
TridentSE: Guiding Speech Enhancement with 32 Global Tokens
In this paper, we present TridentSE, a novel architecture for speech enhancement, which is capable of efficiently capturing both global information and local details.
Look Before You Match: Instance Understanding Matters in Video Object Segmentation
Towards this goal, we present a two-branch network for VOS, where the query-based instance segmentation (IS) branch delves into the instance details of the current frame and the VOS branch performs spatial-temporal matching with the memory bank.
Ranked #1 on
Semi-Supervised Video Object Segmentation
on Long Video Dataset
(using extra training data)
Streaming Video Model
We believe that the concept of streaming video model and the implementation of S-ViT are solid steps towards a unified deep learning architecture for video understanding.
Filler Word Detection with Hard Category Mining and Inter-Category Focal Loss
Filler words like ``um" or ``uh" are common in spontaneous speech.
MicroCinema: A Divide-and-Conquer Approach for Text-to-Video Generation
We present MicroCinema, a straightforward yet effective framework for high-quality and coherent text-to-video generation.
