Search Results for author: Frank P. -W. Lo

Found 8 papers, 4 papers with code

Dietary Assessment with Multimodal ChatGPT: A Systematic Analysis

no code implementations14 Dec 2023 Frank P. -W. Lo, Jianing Qiu, Zeyu Wang, Junhong Chen, Bo Xiao, Wu Yuan, Stamatia Giannarou, Gary Frost, Benny Lo

Although artificial intelligence (AI)-based solutions have been devised to automate the dietary assessment process, these prior AI methodologies encounter challenges in their ability to generalize across a diverse range of food types, dietary behaviors, and cultural contexts.

Image Captioning Scene Understanding

Generalist Vision Foundation Models for Medical Imaging: A Case Study of Segment Anything Model on Zero-Shot Medical Segmentation

1 code implementation25 Apr 2023 Peilun Shi, Jianing Qiu, Sai Mu Dalike Abaxi, Hao Wei, Frank P. -W. Lo, Wu Yuan

In this paper, we examine the recent Segment Anything Model (SAM) on medical images, and report both quantitative and qualitative zero-shot segmentation results on nine medical image segmentation benchmarks, covering various imaging modalities, such as optical coherence tomography (OCT), magnetic resonance imaging (MRI), and computed tomography (CT), as well as different applications including dermatology, ophthalmology, and radiology.

Computed Tomography (CT) Image Segmentation +4

Large AI Models in Health Informatics: Applications, Challenges, and the Future

1 code implementation21 Mar 2023 Jianing Qiu, Lin Li, Jiankai Sun, Jiachuan Peng, Peilun Shi, Ruiyang Zhang, Yinzhao Dong, Kyle Lam, Frank P. -W. Lo, Bo Xiao, Wu Yuan, Ningli Wang, Dong Xu, Benny Lo

Large AI models, or foundation models, are models recently emerging with massive scales both parameter-wise and data-wise, the magnitudes of which can reach beyond billions.

Decision Making Drug Discovery +1

Mining Discriminative Food Regions for Accurate Food Recognition

1 code implementation8 Jul 2022 Jianing Qiu, Frank P. -W. Lo, Yingnan Sun, Siyao Wang, Benny Lo

Taking inspiration from Adversarial Erasing, a strategy that progressively discovers discriminative object regions for weakly supervised semantic segmentation, we propose a novel network architecture in which a primary network maintains the base accuracy of classifying an input image, an auxiliary network adversarially mines discriminative food regions, and a region network classifies the resulting mined regions.

Food Recognition Weakly supervised Semantic Segmentation +1

Egocentric Human Trajectory Forecasting with a Wearable Camera and Multi-Modal Fusion

1 code implementation1 Nov 2021 Jianing Qiu, Lipeng Chen, Xiao Gu, Frank P. -W. Lo, Ya-Yen Tsai, Jiankai Sun, Jiaqi Liu, Benny Lo

To this end, a novel egocentric human trajectory forecasting dataset was constructed, containing real trajectories of people navigating in crowded spaces wearing a camera, as well as extracted rich contextual data.

Decoder Trajectory Forecasting

Egocentric Image Captioning for Privacy-Preserved Passive Dietary Intake Monitoring

no code implementations1 Jul 2021 Jianing Qiu, Frank P. -W. Lo, Xiao Gu, Modou L. Jobarteh, Wenyan Jia, Tom Baranowski, Matilda Steiner-Asiedu, Alex K. Anderson, Megan A McCrory, Edward Sazonov, Mingui Sun, Gary Frost, Benny Lo

In this paper, we propose a privacy-preserved secure solution (i. e., egocentric image captioning) for dietary assessment with passive monitoring, which unifies food recognition, volume estimation, and scene understanding.

Food Recognition Image Captioning +1

Indoor Future Person Localization from an Egocentric Wearable Camera

no code implementations6 Mar 2021 Jianing Qiu, Frank P. -W. Lo, Xiao Gu, Yingnan Sun, Shuo Jiang, Benny Lo

Accurate prediction of future person location and movement trajectory from an egocentric wearable camera can benefit a wide range of applications, such as assisting visually impaired people in navigation, and the development of mobility assistance for people with disability.

Decoder

Cannot find the paper you are looking for? You can Submit a new open access paper.