Search Results for author: Cynthia Breazeal

Found 28 papers, 6 papers with code

MRF-Chat: Improving Dialogue with Markov Random Fields

no code implementations EMNLP 2021 Ishaan Grover, Matthew Huggins, Cynthia Breazeal, Hae Won Park

Recent state-of-the-art approaches in open-domain dialogue include training end-to-end deep-learning models to learn various conversational features like emotional content of response, symbolic transitions of dialogue contexts in a knowledge graph and persona of the agent and the user, among others.

Retrieval

A Demonstration of Adaptive Collaboration of Large Language Models for Medical Decision-Making

1 code implementation31 Oct 2024 Yubin Kim, Chanwoo Park, Hyewon Jeong, Cristina Grau-Vilchez, Yik Siu Chan, Xuhai Xu, Daniel McDuff, Hyeonhoon Lee, Cynthia Breazeal, Hae Won Park

Medical Decision-Making (MDM) is a multi-faceted process that requires clinicians to assess complex multi-modal patient data patient, often collaboratively.

Decision Making

HEART-felt Narratives: Tracing Empathy and Narrative Style in Personal Stories with LLMs

1 code implementation27 May 2024 Jocelyn Shen, Joel Mire, Hae Won Park, Cynthia Breazeal, Maarten Sap

We introduce a novel, theory-based taxonomy, HEART (Human Empathy and Narrative Taxonomy) that delineates elements of narrative style that can lead to empathy with the narrator of a story.

EmpathicStories++: A Multimodal Dataset for Empathy towards Personal Experiences

no code implementations24 May 2024 Jocelyn Shen, Yubin Kim, Mohit Hulse, Wazeer Zulfikar, Sharifa Alghowinem, Cynthia Breazeal, Hae Won Park

Modeling empathy is a complex endeavor that is rooted in interpersonal and experiential dimensions of human interaction, and remains an open problem within AI.

AI Agent

MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Making

1 code implementation22 Apr 2024 Yubin Kim, Chanwoo Park, Hyewon Jeong, Yik Siu Chan, Xuhai Xu, Daniel McDuff, Hyeonhoon Lee, Marzyeh Ghassemi, Cynthia Breazeal, Hae Won Park

MDAgents achieved the best performance in seven out of ten benchmarks on tasks requiring an understanding of medical knowledge and multi-modal reasoning, showing a significant improvement of up to 4. 2% (p < 0. 05) compared to previous methods' best performances.

Decision Making Medical Diagnosis +1

Improving Dialogue Agents by Decomposing One Global Explicit Annotation with Local Implicit Multimodal Feedback

no code implementations17 Mar 2024 Dong Won Lee, Hae Won Park, Yoon Kim, Cynthia Breazeal, Louis-Philippe Morency

We describe an approach for aligning an LLM-based dialogue agent based on global (i. e., dialogue-level) rewards, while also taking into account naturally-occurring multimodal signals.

Health-LLM: Large Language Models for Health Prediction via Wearable Sensor Data

1 code implementation12 Jan 2024 Yubin Kim, Xuhai Xu, Daniel McDuff, Cynthia Breazeal, Hae Won Park

Notably, we observe that our context enhancement can yield up to 23. 8% improvement in performance.

Understanding Teacher Perspectives and Experiences after Deployment of AI Literacy Curriculum in Middle-school Classrooms

no code implementations8 Dec 2023 Prerna Ravi, Annalisa Broski, Glenda Stump, Hal Abelson, Eric Klopfer, Cynthia Breazeal

Artificial Intelligence (AI) and its associated applications are ubiquitous in today's world, making it imperative that students and their teachers understand how it works and the ramifications arising from its usage.

Studying Artist Sentiments around AI-generated Artwork

no code implementations22 Nov 2023 Safinah Ali, Cynthia Breazeal

Concerns about plagiarizing their artworks and styles for datasets and uncertainty around the future of digital art sparked movements in artist communities shunning the use of AI for generating art and protecting artists' rights.

AI Audit: A Card Game to Reflect on Everyday AI Systems

no code implementations29 May 2023 Safinah Ali, Vishesh Kumar, Cynthia Breazeal

The game mechanics reward systems that are ethically developed or that take steps to mitigate potential harms.

Ethics Game Design

Modeling Empathic Similarity in Personal Narratives

no code implementations23 May 2023 Jocelyn Shen, Maarten Sap, Pedro Colon-Hernandez, Hae Won Park, Cynthia Breazeal

The most meaningful connections between people are often fostered through expression of shared vulnerability and emotional experiences in personal narratives.

Retrieval Semantic Similarity +1

HIINT: Historical, Intra- and Inter- personal Dynamics Modeling with Cross-person Memory Transformer

no code implementations21 May 2023 Yubin Kim, Dong Won Lee, Paul Pu Liang, Sharifa Algohwinem, Cynthia Breazeal, Hae Won Park

Accurately modeling affect dynamics, which refers to the changes and fluctuations in emotions and affective displays during human conversations, is crucial for understanding human interactions.

Language Modelling Large Language Model

PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traits

1 code implementation4 May 2023 Hang Jiang, Xiajie Zhang, Xubo Cao, Cynthia Breazeal, Deb Roy, Jad Kabbara

Despite the many use cases for large language models (LLMs) in creating personalized chatbots, there has been limited research on evaluating the extent to which the behaviors of personalized LLMs accurately and consistently reflect specific personality traits.

Multipar-T: Multiparty-Transformer for Capturing Contingent Behaviors in Group Conversations

no code implementations19 Apr 2023 Dong Won Lee, Yubin Kim, Rosalind Picard, Cynthia Breazeal, Hae Won Park

As we move closer to real-world AI systems, AI agents must be able to deal with multiparty (group) conversations.

Adversarial Transformer Language Models for Contextual Commonsense Inference

no code implementations10 Feb 2023 Pedro Colon-Hernandez, Henry Lieberman, Yida Xin, Claire Yin, Cynthia Breazeal, Peter Chin

Contextualized or discourse aware commonsense inference is the task of generating coherent commonsense assertions (i. e., facts) from a given story, and a particular sentence from that story.

Knowledge Graphs Language Modelling +1

Joint Engagement Classification using Video Augmentation Techniques for Multi-person Human-robot Interaction

no code implementations28 Dec 2022 Yubin Kim, Huili Chen, Sharifa Alghowinem, Cynthia Breazeal, Hae Won Park

This work serves as the first step toward fully unlocking the potential of end-to-end video understanding models pre-trained on large public datasets and augmented with data augmentation and visualization techniques for affect recognition in the multi-person human-robot interaction in the wild.

Data Augmentation Face Swapping +1

Build-a-Bot: Teaching Conversational AI Using a Transformer-Based Intent Recognition and Question Answering Architecture

no code implementations14 Dec 2022 Kate Pearce, Sharifa Alghowinem, Cynthia Breazeal

As such, we propose the development of an open-source tool (Build-a-Bot) for students and teachers to not only create their own transformer-based chatbots based on their own course material, but also learn the fundamentals of AI through the model creation process.

AI Agent Chatbot +4

B$^3$RTDP: A Belief Branch and Bound Real-Time Dynamic Programming Approach to Solving POMDPs

no code implementations22 Oct 2022 Sigurdur Orn Adalgeirsson, Cynthia Breazeal

Partially Observable Markov Decision Processes (POMDPs) offer a promising world representation for autonomous agents, as they can model both transitional and perceptual uncertainties.

Explainable AI for Suicide Risk Assessment Using Eye Activities and Head Gestures

no code implementations10 Jun 2022 Siyu Liu, Catherine Lu, Sharifa Alghowinem, Lea Gotoh, Cynthia Breazeal, Hae Won Park

The prevalence of suicide has been on the rise since the 20th century, causing severe emotional damage to individuals, families, and communities alike.

feature selection

Introducing Variational Autoencoders to High School Students

no code implementations13 Nov 2021 Zhuoyue Lyu, Safinah Ali, Cynthia Breazeal

Generative Artificial Intelligence (AI) models are a compelling way to introduce K-12 students to AI education using an artistic medium, and hence have drawn attention from K-12 AI educators.

Philosophy Vocal Bursts Intensity Prediction

Combining pre-trained language models and structured knowledge

no code implementations28 Jan 2021 Pedro Colon-Hernandez, Catherine Havasi, Jason Alonso, Matthew Huggins, Cynthia Breazeal

In recent years, transformer-based language models have achieved state of the art performance in various NLP benchmarks.

Knowledge Graphs

Migratable AI: Personalizing Dialog Conversations with migration context

no code implementations22 Oct 2020 Ravi Tejwani, Boris Katz, Cynthia Breazeal

The migration of conversational AI agents across different embodiments in order to maintain the continuity of the task has been recently explored to further improve user experience.

Information Retrieval Retrieval

Migratable AI : Investigating users' affect on identity and information migration of a conversational AI agent

no code implementations22 Oct 2020 Ravi Tejwani, Boris Katz, Cynthia Breazeal

Conversational AI agents are becoming ubiquitous and provide assistance to us in our everyday activities.

AI Agent

Dyadic Speech-based Affect Recognition using DAMI-P2C Parent-child Multimodal Interaction Dataset

no code implementations20 Aug 2020 Huili Chen, Yue Zhang, Felix Weninger, Rosalind Picard, Cynthia Breazeal, Hae Won Park

Automatic speech-based affect recognition of individuals in dyadic conversation is a challenging task, in part because of its heavy reliance on manual pre-processing.

Cannot find the paper you are looking for? You can Submit a new open access paper.