Search Results for author: Mutian He

Found 8 papers, 6 papers with code

The Interpreter Understands Your Meaning: End-to-end Spoken Language Understanding Aided by Speech Translation

1 code implementation16 May 2023 Mutian He, Philip N. Garner

Motivated particularly by the task of cross-lingual SLU, we demonstrate that the task of speech translation (ST) is a good means of pretraining speech models for end-to-end SLU on both intra- and cross-lingual scenarios.

Abstractive Text Summarization Continual Learning +7

Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization

1 code implementation3 Jun 2022 Mutian He, Tianqing Fang, Weiqi Wang, Yangqiu Song

Conceptualization, or viewing entities and situations as instances of abstract concepts in mind and making inferences based on that, is a vital component in human intelligence for commonsense reasoning.

Knowledge Graphs

Neural Lexicon Reader: Reduce Pronunciation Errors in End-to-end TTS by Leveraging External Textual Knowledge

no code implementations19 Oct 2021 Mutian He, Jingzhou Yang, Lei He, Frank K. Soong

End-to-end TTS requires a large amount of speech/text paired data to cover all necessary knowledge, particularly how to pronounce different words in diverse contexts, so that a neural model may learn such knowledge accordingly.

Multilingual Byte2Speech Models for Scalable Low-resource Speech Synthesis

2 code implementations5 Mar 2021 Mutian He, Jingzhou Yang, Lei He, Frank K. Soong

To scale neural speech synthesis to various real-world languages, we present a multilingual end-to-end framework that maps byte inputs to spectrograms, thus allowing arbitrary input scripts.

Speech Synthesis

On the Role of Conceptualization in Commonsense Knowledge Graph Construction

1 code implementation6 Mar 2020 Mutian He, Yangqiu Song, Kun Xu, Dong Yu

Commonsense knowledge graphs (CKGs) like Atomic and ASER are substantially different from conventional KGs as they consist of much larger number of nodes formed by loosely-structured text, which, though, enables them to handle highly diverse queries in natural language related to commonsense, leads to unique challenges for automatic KG construction methods.

graph construction Knowledge Graphs +1

Neural Subgraph Isomorphism Counting

1 code implementation25 Dec 2019 Xin Liu, Haojie Pan, Mutian He, Yangqiu Song, Xin Jiang, Lifeng Shang

In this paper, we study a new graph learning problem: learning to count subgraph isomorphisms.

Domain Adaptation Graph Learning +4

Robust Sequence-to-Sequence Acoustic Modeling with Stepwise Monotonic Attention for Neural TTS

1 code implementation3 Jun 2019 Mutian He, Yan Deng, Lei He

In this paper, we propose a novel stepwise monotonic attention method in sequence-to-sequence acoustic modeling to improve the robustness on out-of-domain inputs.

Hard Attention

Cannot find the paper you are looking for? You can Submit a new open access paper.