Search Results for author:
Found 29 papers, 10 papers with code
Word Reordering for Zero-shot Cross-lingual Structured Prediction
Adapting word order from one language to another is a key problem in cross-lingual structured prediction.
A Unified Encoding of Structures in Transition Systems
Transition systems usually contain various dynamic structures (e. g., stacks, buffers).
BLSP-Emo: Towards Empathetic Large Speech-Language Models
In this paper, we present BLSP-Emo (Bootstrapped Language-Speech Pretraining with Emotion support), a novel approach to developing an end-to-end speech-language model capable of understanding both semantics and emotions in speech and generate empathetic responses.
BLSP-KD: Bootstrapping Language-Speech Pre-training via Knowledge Distillation
Recent end-to-end approaches have shown promise in extending large language models (LLMs) to speech inputs, but face limitations in directly assessing and optimizing alignment quality and fail to achieve fine-grained alignment due to speech-text length mismatch.
Adaptive Policy with Wait-$k$ Model for Simultaneous Translation
Simultaneous machine translation (SiMT) requires a robust read/write policy in conjunction with a high-quality translation model.
BLSP: Bootstrapping Language-Speech Pre-training via Behavior Alignment of Continuation Writing
One is a cascaded approach where outputs (tokens or states) of a separately trained speech recognition system are used as inputs for LLMs, which limits their potential in modeling alignment between speech and text.
Improving Text Matching in E-Commerce Search with A Rationalizable, Intervenable and Fast Entity-Based Relevance Model
We also show that pretraining the QE module with auto-generated QE data from user logs can further improve the overall performance.
Translate the Beauty in Songs: Jointly Learning to Align Melody and Translate Lyrics
Song translation requires both translation of lyrics and alignment of music notes so that the resulting verse can be sung to the accompanying melody, which is a challenging problem that has attracted some interests in different aspects of the translation process.
Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inference
A popular approach to streaming speech translation is to employ a single offline model with a wait-k policy to support different latency requirements, which is simpler than training multiple online models with different latency constraints.
Entity-to-Text based Data Augmentation for various Named Entity Recognition Tasks
Data augmentation techniques have been used to alleviate the problem of scarce labeled data in various NER tasks (flat, nested, and discontinuous NER tasks).
Discrete Cross-Modal Alignment Enables Zero-Shot Speech Translation
Existing zero-shot methods fail to align the two modalities of speech and text into a shared semantic space, resulting in much worse performance compared to the supervised ST methods.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+5
ITA: Image-Text Alignments for Multi-Modal Named Entity Recognition
As text representations take the most important role in MNER, in this paper, we propose {\bf I}mage-{\bf t}ext {\bf A}lignments (ITA) to align image features into the textual space, so that the attention mechanism in transformer-based pretrained textual embeddings can be better utilized.
Ranked #1 on
Multi-modal Named Entity Recognition
on Twitter-17
Multi-modal Named Entity Recognition
named-entity-recognition
+1
MuVER: Improving First-Stage Entity Retrieval with Multi-View Entity Representations
Entity retrieval, which aims at disambiguating mentions to canonical entities from massive KBs, is essential for many tasks in natural language processing.
Ranked #1 on
Entity Retrieval
on ZESHEL
Risk Minimization for Zero-shot Sequence Labeling
In this paper, we propose a novel unified framework for zero-shot sequence labeling with minimum risk training and design a new decomposable risk function that models the relations between the predicted labels from the source models and the true labels.
Multi-View Cross-Lingual Structured Prediction with Minimum Supervision
In structured prediction problems, cross-lingual transfer learning is an efficient way to train quality models for low-resource languages, and further improvement can be obtained by learning from multiple source languages.
Bridging the Domain Gap: Improve Informal Language Translation via Counterfactual Domain Adaptation
Despite the near-human performances already achieved on formal texts such as news articles, neural machine transla- tion still has difficulty in dealing with ”user-generated” texts that have diverse linguistic phenomena but lack large-scale high-quality parallel corpora.
Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning
We find empirically that the contextual representations computed on the retrieval-based input view, constructed through the concatenation of a sentence and its external contexts, can achieve significantly improved performance compared to the original input view based only on the sentence.
Ranked #1 on
Named Entity Recognition (NER)
on WNUT 2017
An Investigation of Potential Function Designs for Neural CRF
The neural linear-chain CRF model is one of the most widely-used approach to sequence labeling.
Automated Concatenation of Embeddings for Structured Prediction
Pretrained contextualized embeddings are powerful word representations for structured prediction tasks.
Ranked #1 on
Chunking
on Penn Treebank
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor
The objective function of knowledge distillation is typically the cross-entropy between the teacher and the student's output distributions.
AIN: Fast and Accurate Sequence Labeling with Approximate Inference Network
The linear-chain Conditional Random Field (CRF) model is one of the most widely-used neural sequence labeling approaches.
Ranked #3 on
Chunking
on CoNLL 2003 (German)
More Embeddings, Better Sequence Labelers?
Recent work proposes a family of contextual embeddings that significantly improves the accuracy of sequence labelers over non-contextual embeddings.
Ranked #2 on
Chunking
on CoNLL 2003 (German)
Weakly Supervised Attentional Model for Low Resource Ad-hoc Cross-lingual Information Retrieval
We propose a weakly supervised neural model for Ad-hoc Cross-lingual Information Retrieval (CLIR) from low-resource languages.
Automatic Speech Recognition and Topic Identification for Almost-Zero-Resource Languages
Automatic speech recognition (ASR) systems often need to be developed for extremely low-resource languages to serve end-uses such as audio content categorization and search.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Transfer Learning based Dynamic Multiobjective Optimization Algorithms
This approach takes the transfer learning method as a tool to help reuse the past experience for speeding up the evolutionary process, and at the same time, any population based multiobjective algorithms can benefit from this integration without any extensive modifications.
Statistical Machine Translation Features with Multitask Tensor Networks
We present a three-pronged approach to improving Statistical Machine Translation (SMT), building on recent success in the application of neural networks to SMT.
