Search Results for author: Nikita Soni

Found 6 papers, 2 papers with code

Comparing Pre-trained Human Language Models: Is it Better with Human Context as Groups, Individual Traits, or Both?

no code implementations23 Jan 2024 Nikita Soni, Niranjan Balasubramanian, H. Andrew Schwartz, Dirk Hovy

We compare pre-training models with human context via 1) group attributes, 2) individual users, and 3) a combined approach on 5 user- and document-level tasks.

Age Estimation Language Modelling

Large Human Language Models: A Need and the Challenges

no code implementations9 Nov 2023 Nikita Soni, H. Andrew Schwartz, João Sedoc, Niranjan Balasubramanian

As research in human-centered NLP advances, there is a growing recognition of the importance of incorporating human and social factors into NLP models.

Human Language Modeling

1 code implementation Findings (ACL) 2022 Nikita Soni, Matthew Matero, Niranjan Balasubramanian, H. Andrew Schwartz

Natural language is generated by people, yet traditional language modeling views words or documents as if generated independently.

Age Estimation Language Modelling +3

MeLT: Message-Level Transformer with Masked Document Representations as Pre-Training for Stance Detection

1 code implementation Findings (EMNLP) 2021 Matthew Matero, Nikita Soni, Niranjan Balasubramanian, H. Andrew Schwartz

Much of natural language processing is focused on leveraging large capacity language models, typically trained over single messages with a task of predicting one or more tokens.

Attribute Language Modelling +2

Cannot find the paper you are looking for? You can Submit a new open access paper.