Search Results for author: Sangwu Lee

Found 8 papers, 1 papers with code

VISREAS: Complex Visual Reasoning with Unanswerable Questions

no code implementations23 Feb 2024 Syeda Nahida Akter, Sangwu Lee, Yingshan Chang, Yonatan Bisk, Eric Nyberg

The unique feature of this task, validating question answerability with respect to an image before answering, and the poor performance of state-of-the-art models inspired the design of a new modular baseline, LOGIC2VISION that reasons by producing and executing pseudocode without any external modules to generate the answer.

Question Answering Visual Question Answering +1

Self-Imagine: Effective Unimodal Reasoning with Multimodal Models using Self-Imagination

no code implementations16 Jan 2024 Syeda Nahida Akter, Aman Madaan, Sangwu Lee, Yiming Yang, Eric Nyberg

The potential of Vision-Language Models (VLMs) often remains underutilized in handling complex text-based problems, particularly when these problems could benefit from visual representation.

GSM8K Language Modelling +1

PARK: Parkinson's Analysis with Remote Kinetic-tasks

no code implementations21 Nov 2023 Md Saiful Islam, Sangwu Lee, Abdelrahman Abdelkader, Sooyong Park, Ehsan Hoque

We present a web-based framework to screen for Parkinson's disease (PD) by allowing users to perform neurological tests in their homes.

Unmasking Parkinson's Disease with Smile: An AI-enabled Screening Framework

no code implementations3 Aug 2023 Tariq Adnan, Md Saiful Islam, Wasifur Rahman, Sangwu Lee, Sutapa Dey Tithi, Kazi Noshin, Imran Sarker, M Saifur Rahman, Ehsan Hoque

Parkinson's disease (PD) diagnosis remains challenging due to lacking a reliable biomarker and limited access to clinical care.

Using AI to Measure Parkinson's Disease Severity at Home

no code implementations30 Mar 2023 Md Saiful Islam, Wasifur Rahman, Abdelrahman Abdelkader, Phillip T. Yang, Sangwu Lee, Jamie L. Adams, Ruth B. Schneider, E. Ray Dorsey, Ehsan Hoque

We present an artificial intelligence system to remotely assess the motor performance of individuals with Parkinson's disease (PD).

TextMI: Textualize Multimodal Information for Integrating Non-verbal Cues in Pre-trained Language Models

no code implementations27 Mar 2023 Md Kamrul Hasan, Md Saiful Islam, Sangwu Lee, Wasifur Rahman, Iftekhar Naim, Mohammed Ibrahim Khan, Ehsan Hoque

Our approach, TextMI, significantly reduces model complexity, adds interpretability to the model's decision, and can be applied for a diverse set of tasks while achieving superior (multimodal sarcasm detection) or near SOTA (multimodal sentiment analysis and multimodal humor detection) performance.

Humor Detection Multimodal Sentiment Analysis +1

Detecting Parkinson's Disease From an Online Speech-task

no code implementations2 Sep 2020 Wasifur Rahman, Sangwu Lee, Md. Saiful Islam, Victor Nikhil Antony, Harshil Ratnu, Mohammad Rafayet Ali, Abdullah Al Mamun, Ellen Wagner, Stella Jensen-Roberts, Max A. Little, Ray Dorsey, Ehsan Hoque

In this paper, we envision a web-based framework that can help anyone, anywhere around the world record a short speech task, and analyze the recorded data to screen for Parkinson's disease (PD).

Cannot find the paper you are looking for? You can Submit a new open access paper.