Search Results for author: Khanh Nguyen

Found 28 papers, 9 papers with code

Successfully Guiding Humans with Imperfect Instructions by Highlighting Potential Errors and Suggesting Corrections

no code implementations26 Feb 2024 Lingjun Zhao, Khanh Nguyen, Hal Daumé III

This paper addresses the challenge of leveraging imperfect language models to guide human decision-making in the context of a grounded navigation task.

Decision Making

Language-Guided World Models: A Model-Based Approach to AI Control

no code implementations24 Jan 2024 Alex Zhang, Khanh Nguyen, Jens Tuyls, Albert Lin, Karthik Narasimhan

Installing probabilistic world models into artificial agents opens an efficient channel for humans to communicate with and control these agents.

Privacy-Aware Document Visual Question Answering

no code implementations15 Dec 2023 Rubèn Tito, Khanh Nguyen, Marlon Tobaben, Raouf Kerkouche, Mohamed Ali Souibgui, Kangsoo Jung, Lei Kang, Ernest Valveny, Antti Honkela, Mario Fritz, Dimosthenis Karatzas

We employ a federated learning scheme, that reflects the real-life distribution of documents in different businesses, and we explore the use case where the ID of the invoice issuer is the sensitive information to be protected.

document understanding Federated Learning +3

Hallucination Detection for Grounded Instruction Generation

no code implementations23 Oct 2023 Lingjun Zhao, Khanh Nguyen, Hal Daumé III

We investigate the problem of generating instructions to guide humans to navigate in simulated residential environments.

Hallucination Navigate

Progressively Efficient Learning

no code implementations13 Oct 2023 Ruijie Zheng, Khanh Nguyen, Hal Daumé III, Furong Huang, Karthik Narasimhan

By equipping a learning agent with an abstract, dynamic language and an intrinsic motivation to learn with minimal communication effort, CEIL leads to emergence of a human-like pattern where the learner and the teacher communicate progressively efficiently by exchanging increasingly more abstract intentions.

Imitation Learning

Multi-Contact Force-Sensing Guitar for Training and Therapy

no code implementations25 Feb 2023 Zhiyi Ren, Chun-Cheng Hsu, Can Kocabalkanli, Khanh Nguyen, Iulian I. Iordachita, Serap Bastepe-Gray, Nathan Scott

Hand injuries from repetitive high-strain and physical overload can hamper or even end a musician's career.

Define, Evaluate, and Improve Task-Oriented Cognitive Capabilities for Instruction Generation Models

no code implementations21 Dec 2022 Lingjun Zhao, Khanh Nguyen, Hal Daumé III

Recent work studies the cognitive capabilities of language models through psychological tests designed for humans.

Language Modelling

Uncertainty-aware Label Distribution Learning for Facial Expression Recognition

1 code implementation21 Sep 2022 Nhat Le, Khanh Nguyen, Quang Tran, Erman Tjiputra, Bac Le, Anh Nguyen

In this paper, we propose a new uncertainty-aware label distribution learning method to improve the robustness of deep models against uncertainty and ambiguity.

Facial Expression Recognition Facial Expression Recognition (FER)

Show, Interpret and Tell: Entity-aware Contextualised Image Captioning in Wikipedia

no code implementations21 Sep 2022 Khanh Nguyen, Ali Furkan Biten, Andres Mafla, Lluis Gomez, Dimosthenis Karatzas

Particularly, a similar Wikimedia image can be used to illustrate different articles, and the produced caption needs to be adapted to a specific context, therefore allowing us to explore the limits of a model to adjust captions to different contextual information.

Image Captioning

AdaTriplet: Adaptive Gradient Triplet Loss with Automatic Margin Learning for Forensic Medical Image Matching

1 code implementation5 May 2022 Khanh Nguyen, Huy Hoang Nguyen, Aleksei Tiulpin

CBIR with DNNs is generally solved by minimizing a ranking loss, such as Triplet loss (TL), computed on image representations extracted by a DNN from the original data.

Content-Based Image Retrieval Retrieval

Pressure and temperature dependence of fluorescence anisotropy of Green Fluorescent Protein

no code implementations15 Feb 2022 Harpreet Kaur, Khanh Nguyen, Pradeep Kumar

At atmospheric pressure, anisotropy decreases with increasing temperature but exhibits a maximum with temperature for pressure larger than 20 MPa.

Global-Local Attention for Emotion Recognition

1 code implementation7 Nov 2021 Nhat Le, Khanh Nguyen, Anh Nguyen, Bac Le

Our network is designed to extract features from both facial and context regions independently, then learn them together using the attention module.

Emotion Recognition

A Framework for Learning to Request Rich and Contextually Useful Information from Humans

no code implementations14 Oct 2021 Khanh Nguyen, Yonatan Bisk, Hal Daumé III

We show that the agent can take advantage of different types of information depending on the context, and analyze the benefits and challenges of learning the assistance-requesting policy when the assistant can recursively decompose tasks into subtasks.

Decision Making Hierarchical Reinforcement Learning

Interactive Learning from Activity Description

1 code implementation13 Feb 2021 Khanh Nguyen, Dipendra Misra, Robert Schapire, Miro Dudík, Patrick Shafto

We present a novel interactive learning protocol that enables training request-fulfilling agents by verbally describing their activities.

General Reinforcement Learning Grounded language learning +2

Pre-processing Image using Brightening, CLAHE and RETINEX

1 code implementation22 Mar 2020 Thi Phuoc Hanh Nguyen, Zinan Cai, Khanh Nguyen, Sokuntheariddh Keth, Ningyuan Shen, Mira Park

This paper focuses on finding the most optimal pre-processing methods considering three common algorithms for image enhancement: Brightening, CLAHE and Retinex.

Edge Detection Image Enhancement

Help, Anna! Visual Navigation with Natural Multimodal Assistance via Retrospective Curiosity-Encouraging Imitation Learning

1 code implementation IJCNLP 2019 Khanh Nguyen, Hal Daumé III

An agent solving tasks in a HANNA environment can leverage simulated human assistants, called ANNA (Automatic Natural Navigation Assistants), which, upon request, provide natural language and visual instructions to direct the agent towards the goals.

Imitation Learning Visual Navigation

Vision-based Navigation with Language-based Assistance via Imitation Learning with Indirect Intervention

1 code implementation CVPR 2019 Khanh Nguyen, Debadeepta Dey, Chris Brockett, Bill Dolan

We present Vision-based Navigation with Language-based Assistance (VNLA), a grounded vision-language task where an agent with visual perception is guided via language to find objects in photorealistic indoor environments.

Imitation Learning Navigate +2

On Deep Domain Adaptation: Some Theoretical Understandings

no code implementations15 Nov 2018 Trung Le, Khanh Nguyen, Nhat Ho, Hung Bui, Dinh Phung

The underlying idea of deep domain adaptation is to bridge the gap between source and target domains in a joint space so that a supervised classifier trained on labeled source data can be nicely transferred to the target domain.

Domain Adaptation Transfer Learning

Analogical-based Bayesian Optimization

no code implementations19 Sep 2017 Trung Le, Khanh Nguyen, Tu Dinh Nguyen, Dinh Phung

With this spirit, in this paper, we propose Analogical-based Bayesian Optimization that can maximize black-box function over a domain where only a similarity score can be defined.

Bayesian Optimization Gaussian Processes

Reinforcement Learning for Bandit Neural Machine Translation with Simulated Human Feedback

1 code implementation EMNLP 2017 Khanh Nguyen, Hal Daumé III, Jordan Boyd-Graber

Machine translation is a natural candidate problem for reinforcement learning from human feedback: users provide quick, dirty ratings on candidate translations to guide a system to improve.

Machine Translation reinforcement-learning +2

Imitation Learning with Recurrent Neural Networks

no code implementations18 Jul 2016 Khanh Nguyen

We present a novel view that unifies two frameworks that aim to solve sequential prediction problems: learning to search (L2S) and recurrent neural networks (RNN).

Imitation Learning

Scalable Semi-supervised Learning with Graph-based Kernel Machine

no code implementations22 Jun 2016 Trung Le, Khanh Nguyen, Van Nguyen, Vu Nguyen, Dinh Phung

Acquiring labels are often costly, whereas unlabeled data are usually easy to obtain in modern machine learning applications.

BIG-bench Machine Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.