Search Results for author: Jihie Kim

Found 16 papers, 3 papers with code

CIC: A framework for Culturally-aware Image Captioning

no code implementations8 Feb 2024 Youngsik Yun, Jihie Kim

Image Captioning generates descriptive sentences from images using Vision-Language Pre-trained models (VLPs) such as BLIP, which has improved greatly.

Descriptive Image Captioning +2

Representation Learning with Graph Neural Networks for Speech Emotion Recognition

no code implementations21 Aug 2022 Junghun Kim, Jihie Kim

In particular, we propose a cosine similarity-based graph as an ideal graph structure for representation learning in SER.

Representation Learning Speech Emotion Recognition

Improving Speech Emotion Recognition Through Focus and Calibration Attention Mechanisms

no code implementations21 Aug 2022 Junghun Kim, Yoojin An, Jihie Kim

To improve the attention area, we propose to use a Focus-Attention (FA) mechanism and a novel Calibration-Attention (CA) mechanism in combination with the multi-head self-attention.

Speech Emotion Recognition

CMSBERT-CLR: Context-driven Modality Shifting BERT with Contrastive Learning for linguistic, visual, acoustic Representations

no code implementations21 Aug 2022 Junghun Kim, Jihie Kim

In this paper, we present a Context-driven Modality Shifting BERT with Contrastive Learning for linguistic, visual, acoustic Representations (CMSBERT-CLR), which incorporates the whole context's non-verbal and verbal information and aligns modalities more effectively through contrastive learning.

Contrastive Learning Multimodal Sentiment Analysis +1

Uncertainty-based Visual Question Answering: Estimating Semantic Inconsistency between Image and Knowledge Base

no code implementations27 Jul 2022 Jinyeong Chae, Jihie Kim

Knowledge-based visual question answering (KVQA) task aims to answer questions that require additional external knowledge as well as an understanding of images and questions.

Question Answering Semantic Similarity +2

A Pressure Ulcer Care System For Remote Medical Assistance: Residual U-Net with an Attention Model Based for Wound Area Segmentation

no code implementations23 Jan 2021 Jinyeong Chae, Ki Yong Hong, Jihie Kim

As there are not enough data to train the deep learning model, we make use of a pretrained model from a relevant domain and data augmentation that is appropriate for this task.

Data Augmentation Management

Ensemble-Based Deep Reinforcement Learning for Chatbots

no code implementations27 Aug 2019 Heriberto Cuayáhuitl, Donghyeon Lee, Seonghan Ryu, Yongjin Cho, Sungja Choi, Satish Indurthi, Seunghak Yu, Hyungtak Choi, Inchul Hwang, Jihie Kim

Experimental results using chitchat data reveal that (1) near human-like dialogue policies can be induced, (2) generalisation to unseen data is a difficult problem, and (3) training an ensemble of chatbot agents is essential for improved performance over using a single agent.

Chatbot Clustering +4

Deep Reinforcement Learning for Chatbots Using Clustered Actions and Human-Likeness Rewards

no code implementations27 Aug 2019 Heriberto Cuayáhuitl, Donghyeon Lee, Seonghan Ryu, Sungja Choi, Inchul Hwang, Jihie Kim

Training chatbots using the reinforcement learning paradigm is challenging due to high-dimensional states, infinite action spaces and the difficulty in specifying the reward function.

reinforcement-learning Reinforcement Learning (RL) +3

A Study on Dialogue Reward Prediction for Open-Ended Conversational Agents

no code implementations2 Dec 2018 Heriberto Cuayáhuitl, Seonghan Ryu, Donghyeon Lee, Jihie Kim

The amount of dialogue history to include in a conversational agent is often underestimated and/or set in an empirical and thus possibly naive way.

Self-Learning Architecture for Natural Language Generation

no code implementations WS 2018 Hyungtak Choi, Siddarth K.M., Haehun Yang, Heesik Jeon, Inchul Hwang, Jihie Kim

In this paper, we propose a self-learning architecture for generating natural language templates for conversational assistants.

Self-Learning Text Generation

On-Device Neural Language Model Based Word Prediction

1 code implementation COLING 2018 Seunghak Yu, Nilesh Kulkarni, Haejun Lee, Jihie Kim

Recent developments in deep learning with application to language modeling have led to success in tasks of text processing, summarizing and machine translation.

Automatic Speech Recognition (ASR) Language Modelling +4

Syllable-level Neural Language Model for Agglutinative Language

no code implementations WS 2017 Seunghak Yu, Nilesh Kulkarni, Haejun Lee, Jihie Kim

Language models for agglutinative languages have always been hindered in past due to myriad of agglutinations possible to any given word through various affixes.

Language Modelling

An Embedded Deep Learning based Word Prediction

1 code implementation6 Jul 2017 Seunghak Yu, Nilesh Kulkarni, Haejun Lee, Jihie Kim

Recent developments in deep learning with application to language modeling have led to success in tasks of text processing, summarizing and machine translation.

Language Modelling Machine Translation +1

Cannot find the paper you are looking for? You can Submit a new open access paper.