Search Results for author: Kyomin Jung

Found 59 papers, 18 papers with code

Local Algorithms for Approximate Inference in Minor-Excluded Graphs

no code implementations NeurIPS 2007 Kyomin Jung, Devavrat Shah

We present a new local approximation algorithm for computing MAP and log-partition function for arbitrary exponential family distribution represented by a finite-valued pair-wise Markov random field (MRF), say G. Our algorithm is based on decomposing G into appropriately chosen small components; computing estimates locally in each of these components and then producing a good global solution.

Local Rules for Global MAP: When Do They Work ?

no code implementations NeurIPS 2009 Kyomin Jung, Pushmeet Kohli, Devavrat Shah

We consider the question of computing Maximum A Posteriori (MAP) assignment in an arbitrary pair-wise Markov Random Field (MRF).

Multi-dimensional Parametric Mincuts for Constrained MAP Inference

no code implementations30 Jul 2013 Yongsub Lim, Kyomin Jung, Pushmeet Kohli

We show how this constrained discrete optimization problem can be formulated as a multi-dimensional parametric mincut problem via its Lagrangian dual, and prove that our algorithm isolates all constraint instances for which the problem can be solved exactly.

Image Segmentation Semantic Segmentation

Efficient Energy Minimization for Enforcing Statistics

no code implementations30 Jul 2013 Yongsub Lim, Kyomin Jung, Pushmeet Kohli

However, for many computer vision problems, the MAP solution under the model is not the ground truth solution.

Image Segmentation Segmentation +1

Partition-Merge: Distributed Inference and Modularity Optimization

no code implementations24 Sep 2013 Vincent Blondel, Kyomin Jung, Pushmeet Kohli, Devavrat Shah

This paper presents a novel meta algorithm, Partition-Merge (PM), which takes existing centralized algorithms for graph computation and makes them distributed and faster.

Community Detection

Efficient Transfer Learning Schemes for Personalized Language Modeling using Recurrent Neural Network

no code implementations13 Jan 2017 Seunghyun Yoon, Hyeongu Yun, Yuna Kim, Gyu-tae Park, Kyomin Jung

In this paper, we propose an efficient transfer leaning methods for training a personalized language model using a recurrent neural network with long short-term memory architecture.

Language Modelling Transfer Learning

Learning to Rank Question-Answer Pairs using Hierarchical Recurrent Encoder with Latent Topic Clustering

3 code implementations NAACL 2018 Seunghyun Yoon, Joongbo Shin, Kyomin Jung

In this paper, we propose a novel end-to-end neural architecture for ranking candidate answers, that adapts a hierarchical recurrent neural network and a latent topic clustering module.

Answer Selection Clustering +1

Number Sequence Prediction Problems for Evaluating Computational Powers of Neural Networks

no code implementations19 May 2018 Hyoungwook Nam, Segwang Kim, Kyomin Jung

We define the complexity and difficulty of a number sequence prediction task with the structure of the smallest automaton that can generate the sequence.

Improving Neural Question Generation using Answer Separation

no code implementations7 Sep 2018 Yanghoon Kim, Hwanhee Lee, Joongbo Shin, Kyomin Jung

Previous NQG models suffer from a problem that a significant proportion of the generated questions include words in the question target, resulting in the generation of unintended questions.

Question Generation Question-Generation

Multimodal Speech Emotion Recognition Using Audio and Text

4 code implementations10 Oct 2018 Seunghyun Yoon, Seokhyun Byun, Kyomin Jung

Speech emotion recognition is a challenging task, and extensive reliance has been placed on models that use audio features in building well-performing classifiers.

Emotion Classification Multimodal Emotion Recognition +2

Detecting Incongruity Between News Headline and Body Text via a Deep Hierarchical Encoder

2 code implementations17 Nov 2018 Seunghyun Yoon, Kunwoo Park, Joongbo Shin, Hongjun Lim, Seungpil Won, Meeyoung Cha, Kyomin Jung

Some news headlines mislead readers with overrated or false information, and identifying them in advance will better assist readers in choosing proper news stories to consume.

Data Augmentation Fake News Detection +2

Effective Sentence Scoring Method using Bidirectional Language Model for Speech Recognition

no code implementations16 May 2019 Joongbo Shin, Yoonhyung Lee, Kyomin Jung

Recent studies have tried to use bidirectional LMs (biLMs) instead of conventional unidirectional LMs (uniLMs) for rescoring the $N$-best list decoded from the acoustic model.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3

A Compare-Aggregate Model with Latent Clustering for Answer Selection

no code implementations30 May 2019 Seunghyun Yoon, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Kyomin Jung

In this paper, we propose a novel method for a sentence-level answer-selection task that is a fundamental problem in natural language processing.

Answer Selection Clustering +3

MILAB at SemEval-2019 Task 3: Multi-View Turn-by-Turn Model for Context-Aware Sentiment Analysis

no code implementations SEMEVAL 2019 Yoonhyung Lee, Yanghoon Kim, Kyomin Jung

This paper describes our system for SemEval-2019 Task 3: EmoContext, which aims to predict the emotion of the third utterance considering two preceding utterances in a dialogue.

Sentiment Analysis

Propagate-Selector: Detecting Supporting Sentences for Question Answering via Graph Neural Networks

1 code implementation LREC 2020 Seunghyun Yoon, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Kyomin Jung

In this study, we propose a novel graph neural network called propagate-selector (PS), which propagates information over sentences to understand information that cannot be inferred when considering sentences in isolation.

Answer Selection Sentence

Attentive Modality Hopping Mechanism for Speech Emotion Recognition

1 code implementation29 Nov 2019 Seunghyun Yoon, Subhadeep Dey, Hwanhee Lee, Kyomin Jung

In this work, we explore the impact of visual modality in addition to speech and text for improving the accuracy of the emotion detection system.

Emotion Classification Multimodal Emotion Recognition +1

BaitWatcher: A lightweight web interface for the detection of incongruent news headlines

no code implementations23 Mar 2020 Kunwoo Park, Taegyun Kim, Seunghyun Yoon, Meeyoung Cha, Kyomin Jung

In digital environments where substantial amounts of information are shared online, news headlines play essential roles in the selection and diffusion of news articles.

Misinformation

DSTC8-AVSD: Multimodal Semantic Transformer Network with Retrieval Style Word Generator

no code implementations1 Apr 2020 Hwanhee Lee, Seunghyun Yoon, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Kyomin Jung

Audio Visual Scene-aware Dialog (AVSD) is the task of generating a response for a question with a given scene, video, audio, and the history of previous turns in the dialog.

Retrieval Word Embeddings

Fast and Accurate Deep Bidirectional Language Representations for Unsupervised Learning

1 code implementation ACL 2020 Joongbo Shin, Yoonhyung Lee, Seunghyun Yoon, Kyomin Jung

Even though BERT achieves successful performance improvements in various supervised learning tasks, applying BERT for unsupervised tasks still holds a limitation that it requires repetitive inference for computing contextual language representations.

Language Modelling Semantic Similarity +1

Collaborative Training of GANs in Continuous and Discrete Spaces for Text Generation

no code implementations16 Oct 2020 Yanghoon Kim, Seungpil Won, Seunghyun Yoon, Kyomin Jung

Applying generative adversarial networks (GANs) to text-related tasks is challenging due to the discrete nature of language.

Reinforcement Learning (RL) Text Generation

Bidirectional Variational Inference for Non-Autoregressive Text-to-Speech

1 code implementation ICLR 2021 Yoonhyung Lee, Joongbo Shin, Kyomin Jung

Although early text-to-speech (TTS) models such as Tacotron 2 have succeeded in generating human-like speech, their autoregressive (AR) architectures have a limitation that they require a lot of time to generate a mel-spectrogram consisting of hundreds of steps.

Variational Inference

Neural Sequence-to-grid Module for Learning Symbolic Rules

1 code implementation13 Jan 2021 Segwang Kim, Hyoungwook Nam, Joonyoung Kim, Kyomin Jung

Logical reasoning tasks over symbols, such as learning arithmetic operations and computer program evaluations, have become challenges to deep learning.

Logical Reasoning

UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning

1 code implementation ACL 2021 Hwanhee Lee, Seunghyun Yoon, Franck Dernoncourt, Trung Bui, Kyomin Jung

Also, we observe critical problems of the previous benchmark dataset (i. e., human annotations) on image captioning metric, and introduce a new collection of human annotations on the generated captions.

Contrastive Learning Image Captioning +1

Self-Adapter at SemEval-2021 Task 10: Entropy-based Pseudo-Labeler for Source-free Domain Adaptation

no code implementations SEMEVAL 2021 Sangwon Yoon, Yanghoon Kim, Kyomin Jung

Source-free domain adaptation is an emerging line of work in deep learning research since it is closely related to the real-world environment.

Sentence Source-Free Domain Adaptation

Task-specific Compression for Multi-task Language Models using Attribution-based Pruning

no code implementations9 May 2022 Nakyeong Yang, Yunah Jang, Hwanhee Lee, Seohyeong Jung, Kyomin Jung

However, these language models utilize an unnecessarily large number of model parameters, even when used only for a specific task.

Natural Language Understanding

Multimodal Speech Emotion Recognition using Cross Attention with Aligned Audio and Text

no code implementations26 Jul 2022 Yoonhyung Lee, Seunghyun Yoon, Kyomin Jung

Then, the attention weights of each modality are applied directly to the other modality in a crossed way, so that the CAN gathers the audio and text information from the same time steps based on each modality.

Speech Emotion Recognition

Critic-Guided Decoding for Controlled Text Generation

no code implementations21 Dec 2022 Minbeom Kim, Hwanhee Lee, Kang Min Yoo, Joonsuk Park, Hwaran Lee, Kyomin Jung

In this work, we propose a novel critic decoding method for controlled language generation (CriticControl) that combines the strengths of reinforcement learning and weighted decoding.

Language Modelling reinforcement-learning +2

Varianceflow: High-Quality and Controllable Text-to-Speech using Variance Information via Normalizing Flow

no code implementations27 Feb 2023 Yoonhyung Lee, Jinhyeok Yang, Kyomin Jung

Also, the objective function of NF makes the model use the variance information and the text in a disentangled manner resulting in more precise variance control.

PR-MCS: Perturbation Robust Metric for MultiLingual Image Captioning

no code implementations15 Mar 2023 Yongil Kim, Yerin Hwang, Hyeongu Yun, Seunghyun Yoon, Trung Bui, Kyomin Jung

Vulnerability to lexical perturbation is a critical weakness of automatic evaluation metrics for image captioning.

Image Captioning

Multi-View Zero-Shot Open Intent Induction from Dialogues: Multi Domain Batch and Proxy Gradient Transfer

no code implementations23 Mar 2023 Hyukhun Koh, Haesung Pyun, Nakyeong Yang, Kyomin Jung

In Task Oriented Dialogue (TOD) system, detecting and inducing new intents are two main challenges to apply the system in the real world.

Target-Agnostic Gender-Aware Contrastive Learning for Mitigating Bias in Multilingual Machine Translation

no code implementations23 May 2023 Minwoo Lee, Hyukhun Koh, Kang-il Lee, Dongdong Zhang, Minsung Kim, Kyomin Jung

In this paper, we specifically target the gender bias issue of multilingual machine translation models for unambiguous cases where there is a single correct translation, and propose a bias mitigation method based on a novel approach.

Contrastive Learning Machine Translation +1

Asking Clarification Questions to Handle Ambiguity in Open-Domain QA

1 code implementation23 May 2023 Dongryeol Lee, Segwang Kim, Minwoo Lee, Hwanhee Lee, Joonsuk Park, Sang-Woo Lee, Kyomin Jung

We first present CAMBIGNQ, a dataset consisting of 5, 654 ambiguous questions, each with relevant passages, possible answers, and a clarification question.

Open-Domain Question Answering

Is it Really Negative? Evaluating Natural Language Video Localization Performance on Multiple Reliable Videos Pool

no code implementations15 Aug 2023 Nakyeong Yang, Minsung Kim, Seunghyun Yoon, Joongbo Shin, Kyomin Jung

With the explosion of multimedia content in recent years, Video Corpus Moment Retrieval (VCMR), which aims to detect a video moment that matches a given natural language query from multiple videos, has become a critical problem.

Contrastive Learning Moment Retrieval +3

DPP-TTS: Diversifying prosodic features of speech via determinantal point processes

no code implementations23 Oct 2023 Seongho Joo, Hyukhun Koh, Kyomin Jung

Second, the diversity among samples is neglected since the sampling procedure often focuses on a single speech sample rather than multiple ones.

Point Processes

Weakly Supervised Semantic Parsing with Execution-based Spurious Program Filtering

1 code implementation2 Nov 2023 Kang-il Lee, Segwang Kim, Kyomin Jung

The problem of spurious programs is a longstanding challenge when training a semantic parser from weak supervision.

Semantic Parsing Visual Reasoning

Dialogizer: Context-aware Conversational-QA Dataset Generation from Textual Sources

no code implementations9 Nov 2023 Yerin Hwang, Yongil Kim, Hyunkyung Bae, Jeesoo Bang, Hwanhee Lee, Kyomin Jung

To address the data scarcity issue in Conversational question answering (ConvQA), a dialog inpainting method, which utilizes documents to generate ConvQA datasets, has been proposed.

Conversational Question Answering Re-Ranking

CRISPR: Eliminating Bias Neurons from an Instruction-following Language Model

no code implementations16 Nov 2023 Nakyeong Yang, Taegwan Kang, Kyomin Jung

Large language models (LLMs) executing tasks through instruction-based prompts often face challenges stemming from distribution differences between user instructions and training instructions.

Instruction Following Language Modelling

IterCQR: Iterative Conversational Query Reformulation without Human Supervision

no code implementations16 Nov 2023 Yunah Jang, Kang-il Lee, Hyunkyung Bae, Seungpil Won, Hwanhee Lee, Kyomin Jung

In conversational search, which aims to retrieve passages containing essential information, queries suffer from high dependency on the preceding dialogue context.

Conversational Search Information Retrieval +1

LifeTox: Unveiling Implicit Toxicity in Life Advice

no code implementations16 Nov 2023 Minbeom Kim, Jahyun Koo, Hwanhee Lee, Joonsuk Park, Hwaran Lee, Kyomin Jung

As large language models become increasingly integrated into daily life, detecting implicit toxicity across diverse contexts is crucial.

Can LLMs Recognize Toxicity? Structured Toxicity Investigation Framework and Semantic-Based Metric

no code implementations10 Feb 2024 Hyukhun Koh, Dohyung Kim, Minwoo Lee, Kyomin Jung

In the pursuit of developing Large Language Models (LLMs) that adhere to societal standards, it is imperative to discern the existence of toxicity in the generated text.

Contrastive Learning for Context-aware Neural Machine Translation Using Coreference Information

no code implementations WMT (EMNLP) 2021 Yongkeun Hwang, Hyeongu Yun, Kyomin Jung

Context-aware neural machine translation (NMT) incorporates contextual information of surrounding texts, that can improve the translation quality of document-level machine translation.

Contrastive Learning coreference-resolution +6

Learning to Select Question-Relevant Relations for Visual Question Answering

no code implementations NAACL (maiworkshop) 2021 Jaewoong Lee, Heejoon Lee, Hwanhee Lee, Kyomin Jung

Previous existing visual question answering (VQA) systems commonly use graph neural networks(GNNs) to extract visual relationships such as semantic relations or spatial relations.

Graph Attention Question Answering +2

Modality Alignment between Deep Representations for Effective Video-and-Language Learning

no code implementations LREC 2022 Hyeongu Yun, Yongil Kim, Kyomin Jung

Our method directly optimizes CKA to make an alignment between video and text embedding representations, hence it aids the cross-modality attention module to combine information over different modalities.

Question Answering Video Captioning +1

Cannot find the paper you are looking for? You can Submit a new open access paper.