Search Results for author: Shwetak Patel

Found 33 papers, 12 papers with code

Passive Heart Rate Monitoring During Smartphone Use in Everyday Life

no code implementations4 Mar 2025 Shun Liao, Paolo Di Achille, Jiang Wu, Silviu Borac, Jonathan Wang, Xin Liu, Eric Teasley, Lawrence Cai, Yun Liu, Daniel McDuff, Hao-Wei Su, Brent Winslow, Anupam Pathak, Shwetak Patel, James A. Taylor, Jameson K. Rogers, Ming-Zher Poh

Resting heart rate (RHR) is an important biomarker of cardiovascular health and mortality, but tracking it longitudinally generally requires a wearable device, limiting its availability.

IRIS: Wireless Ring for Vision-based Smart Home Interaction

no code implementations25 Jul 2024 Maruchi Kim, Antonio Glenn, Bandhav Veluri, Yunseo Lee, Eyoel Gebre, Aditya Bagaria, Shwetak Patel, Shyamnath Gollakota

Integrating cameras into wireless smart rings has been challenging due to size and power constraints.

Soli-enabled Noncontact Heart Rate Detection for Sleep and Meditation Tracking

no code implementations8 Jul 2024 Luzhou Xu, Jaime Lien, Haiguang Li, Nicholas Gillian, Rajeev Nongpiur, Jihan Li, Qian Zhang, Jian Cui, David Jorgensen, Adam Bernstein, Lauren Bedal, Eiji Hayashi, Jin Yamanaka, Alex Lee, Jian Wang, D Shin, Ivan Poupyrev, Trausti Thormundsson, Anupam Pathak, Shwetak Patel

This study represents the first application of the noncontact HR detection technology to sleep and meditation tracking, offering a promising alternative to wearable devices for HR monitoring during sleep and meditation.

Transforming Wearable Data into Health Insights using Large Language Model Agents

no code implementations10 Jun 2024 Mike A. Merrill, Akshay Paruchuri, Naghmeh Rezaei, Geza Kovacs, Javier Perez, Yun Liu, Erik Schenck, Nova Hammerquist, Jake Sunshine, Shyam Tailor, Kumar Ayush, Hao-Wei Su, Qian He, Cory Y. McLean, Mark Malhotra, Shwetak Patel, Jiening Zhan, Tim Althoff, Daniel McDuff, Xin Liu

Despite the proliferation of wearable health trackers and the importance of sleep and exercise to health, deriving actionable personalized insights from wearable data remains a challenge because doing so requires non-trivial open-ended analysis of these data.

Code Generation Information Retrieval +4

HeAR -- Health Acoustic Representations

no code implementations4 Mar 2024 Sebastien Baur, Zaid Nabulsi, Wei-Hung Weng, Jake Garrison, Louis Blankemeier, Sam Fishman, Christina Chen, Sujay Kakarmath, Minyoi Maimbolwa, Nsala Sanjase, Brian Shuma, Yossi Matias, Greg S. Corrado, Shwetak Patel, Shravya Shetty, Shruthi Prabhakara, Monde Muyoyeta, Diego Ardila

Health acoustic sounds such as coughs and breaths are known to contain useful health signals with significant potential for monitoring health and disease, yet are underexplored in the medical machine learning community.

Deep Learning Self-Supervised Learning

Towards Accurate Differential Diagnosis with Large Language Models

no code implementations30 Nov 2023 Daniel McDuff, Mike Schaekermann, Tao Tu, Anil Palepu, Amy Wang, Jake Garrison, Karan Singhal, Yash Sharma, Shekoofeh Azizi, Kavita Kulkarni, Le Hou, Yong Cheng, Yun Liu, S Sara Mahdavi, Sushant Prakash, Anupam Pathak, Christopher Semturs, Shwetak Patel, Dale R Webster, Ewa Dominowska, Juraj Gottweis, Joelle Barral, Katherine Chou, Greg S Corrado, Yossi Matias, Jake Sunshine, Alan Karthikesalingam, Vivek Natarajan

Comparing the two assisted study arms, the DDx quality score was higher for clinicians assisted by our LLM (top-10 accuracy 51. 7%) compared to clinicians without its assistance (36. 1%) (McNemar's Test: 45. 7, p < 0. 01) and clinicians with search (44. 4%) (4. 75, p = 0. 03).

Diagnostic

From Classification to Clinical Insights: Towards Analyzing and Reasoning About Mobile and Behavioral Health Data With Large Language Models

1 code implementation21 Nov 2023 Zachary Englhardt, Chengqian Ma, Margaret E. Morris, Xuhai "Orson" Xu, Chun-Cheng Chang, Lianhui Qin, Daniel McDuff, Xin Liu, Shwetak Patel, Vikram Iyer

Passively collected behavioral health data from ubiquitous sensors holds significant promise to provide mental health professionals insights from patient's daily lives; however, developing analysis tools to use this data in clinical practice requires addressing challenges of generalization across devices and weak or ambiguous correlations between the measured signals and an individual's mental health.

Decision Making

Training Robust Deep Physiological Measurement Models with Synthetic Video-based Data

no code implementations9 Nov 2023 Yuxuan Ou, Yuzhe Zhang, Yuntang Wang, Shwetak Patel, Daniel McDuf, Yuzhe Yang, Xin Liu

However, there exists a significant gap between synthetic and real-world data, which hinders the generalization of neural models trained on these synthetic datasets.

Diversity

Exploring and Characterizing Large Language Models For Embedded System Development and Debugging

no code implementations7 Jul 2023 Zachary Englhardt, Richard Li, Dilini Nissanka, Zhihan Zhang, Girish Narayanswamy, Joseph Breda, Xin Liu, Shwetak Patel, Vikram Iyer

We leverage this finding to study how human programmers interact with these tools, and develop an human-AI based software engineering workflow for building embedded systems.

BigSmall: Efficient Multi-Task Learning for Disparate Spatial and Temporal Physiological Measurements

2 code implementations21 Mar 2023 Girish Narayanswamy, Yujia Liu, Yuzhe Yang, Chengqian Ma, Xin Liu, Daniel McDuff, Shwetak Patel

As an example, perception occurs at different scales both spatially and temporally, suggesting that the extraction of salient visual information may be made more effective by paying attention to specific features at varying scales.

Multi-Task Learning

Motion Matters: Neural Motion Transfer for Better Camera Physiological Measurement

1 code implementation21 Mar 2023 Akshay Paruchuri, Xin Liu, Yulu Pan, Shwetak Patel, Daniel McDuff, Soumyadip Sengupta

Our findings illustrate the usefulness of motion transfer as a data augmentation technique for improving the generalization of models for camera-based physiological sensing.

Data Augmentation Photoplethysmography (PPG)

Modeling the Trade-off of Privacy Preservation and Activity Recognition on Low-Resolution Images

no code implementations18 Mar 2023 Yuntao Wang, Zirui Cheng, Xin Yi, Yan Kong, Xueyang Wang, Xuhai Xu, Yukang Yan, Chun Yu, Shwetak Patel, Yuanchun Shi

Modeling the trade-off of privacy preservation and machine recognition performance can guide future privacy-preserving computer vision systems using low-resolution image sensors.

Activity Recognition Image Super-Resolution +1

MMPD: Multi-Domain Mobile Video Physiology Dataset

2 code implementations8 Feb 2023 Jiankai Tang, Kequan Chen, Yuntao Wang, Yuanchun Shi, Shwetak Patel, Daniel McDuff, Xin Liu

Second, most datasets are relatively small and therefore are limited in diversity, both in appearance (e. g., skin tone), behaviors (e. g., motion) and environment (e. g., lighting conditions).

Descriptive Diversity

MMTSA: Multimodal Temporal Segment Attention Network for Efficient Human Activity Recognition

1 code implementation14 Oct 2022 Ziqi Gao, Yuntao Wang, Jianguo Chen, Junliang Xing, Shwetak Patel, Xin Liu, Yuanchun Shi

The efficiency evaluation on an edge device showed that MMTSA achieved significantly better accuracy, lower computational load, and lower inference latency than SOTA methods.

Human Activity Recognition

Federated Remote Physiological Measurement with Imperfect Data

no code implementations11 Mar 2022 Xin Liu, Mingchuan Zhang, Ziheng Jiang, Shwetak Patel, Daniel McDuff

The growing need for technology that supports remote healthcare is being acutely highlighted by an aging population and the COVID-19 pandemic.

Federated Learning Privacy Preserving

SpiroMask: Measuring Lung Function Using Consumer-Grade Masks

1 code implementation23 Jan 2022 Rishiraj Adhikary, Dhruvi Lodhavia, Chris Francis, Rohit Patil, Tanmay Srivastava, Prerna Khanna, Nipun Batra, Joe Breda, Jacob Peplinski, Shwetak Patel

According to the World Health Organisation (WHO), 235 million people suffer from respiratory illnesses and four million people die annually due to air pollution.

MobilePhys: Personalized Mobile Camera-Based Contactless Physiological Sensing

no code implementations11 Jan 2022 Xin Liu, Yuntao Wang, Sinan Xie, XiaoYu Zhang, Zixian Ma, Daniel McDuff, Shwetak Patel

Camera-based contactless photoplethysmography refers to a set of popular techniques for contactless physiological measurement.

Reliable and Trustworthy Machine Learning for Health Using Dataset Shift Detection

no code implementations NeurIPS 2021 Chunjong Park, Anas Awadalla, Tadayoshi Kohno, Shwetak Patel

We then translate the out-of-distribution score into a human interpretable CONFIDENCE SCORE to investigate its effect on the users' interaction with health ML applications.

BIG-bench Machine Learning Diagnostic +2

RGB Camera-based Physiological Sensing: Challenges and Future Directions

no code implementations26 Oct 2021 Xin Liu, Shwetak Patel, Daniel McDuff

Numerous real-world applications have been driven by the recent algorithmic advancement of artificial intelligence (AI).

EfficientPhys: Enabling Simple, Fast, and Accurate Camera-Based Vitals Measurement

no code implementations29 Sep 2021 Xin Liu, Brian L. Hill, Ziheng Jiang, Shwetak Patel, Daniel McDuff

Camera-based physiological measurement is a growing field with neural models providing state-the-art-performance.

Face Detection

SplitSR: An End-to-End Approach to Super-Resolution on Mobile Devices

no code implementations20 Jan 2021 Xin Liu, Yuang Li, Josh Fromm, Yuntao Wang, Ziheng Jiang, Alex Mariakakis, Shwetak Patel

In this work, we demonstrate state-of-the-art latency and accuracy for on-device super-resolution using a novel hybrid architecture called SplitSR and a novel lightweight residual block called SplitSRBlock.

Super-Resolution

MetaPhys: Few-Shot Adaptation for Non-Contact Physiological Measurement

1 code implementation5 Oct 2020 Xin Liu, Ziheng Jiang, Josh Fromm, Xuhai Xu, Shwetak Patel, Daniel McDuff

There are large individual differences in physiological processes, making designing personalized health sensing algorithms challenging.

Meta-Learning

Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement

3 code implementations NeurIPS 2020 Xin Liu, Josh Fromm, Shwetak Patel, Daniel McDuff

Telehealth and remote health monitoring have become increasingly important during the SARS-CoV-2 pandemic and it is widely expected that this will have a lasting impact on healthcare practices.

Photoplethysmography (PPG) heart rate estimation

Cannot find the paper you are looking for? You can Submit a new open access paper.