Search Results for author: Vijeta Deshpande

Found 5 papers, 2 papers with code

LocalTweets to LocalHealth: A Mental Health Surveillance Framework Based on Twitter Data

no code implementations21 Feb 2024 Vijeta Deshpande, Minhwa Lee, Zonghai Yao, Zihao Zhang, Jason Brian Gibbons, Hong Yu

Prior research on Twitter (now X) data has provided positive evidence of its utility in developing supplementary health surveillance systems.

Honey, I Shrunk the Language: Language Model Behavior at Reduced Scale

1 code implementation26 May 2023 Vijeta Deshpande, Dan Pechi, Shree Thatte, Vladislav Lialin, Anna Rumshisky

The majority of recent scaling laws studies focused on high-compute high-parameter count settings, leaving the question of when these abilities begin to emerge largely unanswered.

Language Modelling Masked Language Modeling

Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuning

no code implementations28 Mar 2023 Vladislav Lialin, Vijeta Deshpande, Anna Rumshisky

This paper presents a systematic overview and comparison of parameter-efficient fine-tuning methods covering over 40 papers published between February 2019 and February 2023.

Extracting Biomedical Factual Knowledge Using Pretrained Language Model and Electronic Health Record Context

no code implementations26 Aug 2022 Zonghai Yao, Yi Cao, Zhichao Yang, Vijeta Deshpande, Hong Yu

In order to make LMs as KBs more in line with the actual application scenarios of the biomedical domain, we specifically add EHR notes as context to the prompt to improve the low bound in the biomedical domain.

Language Modelling

Cannot find the paper you are looking for? You can Submit a new open access paper.