no code implementations • INLG (ACL) 2020 • Emily Saldanha, Aparna Garimella, Svitlana Volkova
We perform multi-dimensional evaluation of model performance on mimicking both the style and linguistic differences that distinguish news of different credibility using machine translation metrics and classification models.
no code implementations • EMNLP 2021 • Sharmila Reddy Nangi, Atharv Tyagi, Jay Mundra, Sagnik Mukherjee, Raj Snehal, Niyati Chhaya, Aparna Garimella
Recent efforts to develop deep learning models for text generation tasks such as extractive and abstractive summarization have resulted in state-of-the-art performances on various datasets.
3 code implementations • 1 Apr 2024 • Yekyung Kim, Yapei Chang, Marzena Karpinska, Aparna Garimella, Varun Manjunatha, Kyle Lo, Tanya Goyal, Mohit Iyyer
While LLM-based auto-raters have proven reliable for factuality and coherence in other settings, we implement several LLM raters of faithfulness and find that none correlates strongly with human annotations, especially with regard to detecting unfaithful claims.
1 code implementation • 29 Mar 2024 • Nihar Ranjan Sahoo, Pranamya Prashant Kulkarni, Narjis Asad, Arif Ahmad, Tanu Goyal, Aparna Garimella, Pushpak Bhattacharyya
We filter and translate the existing CrowS-Pairs dataset to create a benchmark dataset suited to the Indian context in Hindi language.
1 code implementation • 13 Oct 2023 • Yixin Wan, George Pu, Jiao Sun, Aparna Garimella, Kai-Wei Chang, Nanyun Peng
Through benchmarking evaluation on 2 popular LLMs- ChatGPT and Alpaca, we reveal significant gender biases in LLM-generated recommendation letters.
no code implementations • 24 May 2023 • Shufan Wang, Yixiao Song, Andrew Drozdov, Aparna Garimella, Varun Manjunatha, Mohit Iyyer
Digging deeper, we find that interpolating with a retrieval distribution actually increases perplexity compared to a baseline Transformer LM for the majority of tokens in the WikiText-103 test set, even though the overall perplexity is lower due to a smaller number of tokens for which perplexity dramatically decreases after interpolation.
no code implementations • 24 May 2023 • Ishani Mondal, Michelle Yuan, Anandhavelu N, Aparna Garimella, Francis Ferraro, Andrew Blair-Stanek, Benjamin Van Durme, Jordan Boyd-Graber
Learning template based information extraction from documents is a crucial yet difficult task.
1 code implementation • 21 Jan 2023 • Sagar Joshi, Sumanth Balaji, Jerrin Thomas, Aparna Garimella, Vasudeva Varma
Clause recommendation is the problem of recommending a clause to a legal contract, given the context of the contract in question and the clause type to which the clause should belong.
1 code implementation • 7 Jan 2023 • Sagar Joshi, Sumanth Balaji, Aparna Garimella, Vasudeva Varma
Generating domain-specific content such as legal clauses based on minimal user-provided information can be of significant benefit in automating legal contract generation.
no code implementations • 19 Dec 2022 • Abhilasha Sancheti, Aparna Garimella, Balaji Vasan Srinivasan, Rachel Rudinger
In this work, we propose a new task of party-specific extractive summarization for legal contracts to facilitate faster reviewing and improved comprehension of rights and duties.
no code implementations • 23 Nov 2022 • Abhilasha Sancheti, Aparna Garimella, Balaji Vasan Srinivasan, Rachel Rudinger
Legal documents are typically long and written in legalese, which makes it particularly difficult for laypeople to understand their rights and duties.
no code implementations • EMNLP 2021 • Vinay Aggarwal, Aparna Garimella, Balaji Vasan Srinivasan, Anandhavelu N, Rajiv Jain
We propose a two-staged pipeline to first predict if a specific clause type is relevant to be added in a contract, and then recommend the top clauses for the given type based on the contract context.
no code implementations • EACL 2021 • Bhanu Prakash Reddy Guda, Aparna Garimella, Niyati Chhaya
Affect preferences vary with user demographics, and tapping into demographic information provides important cues about the users' language preferences.
no code implementations • EACL 2021 • Hrituraj Singh, Gaurav Verma, Aparna Garimella, Balaji Vasan Srinivasan
In this paper, we propose a Director-Generator framework to rewrite content in the target author's style, specifically focusing on certain target attributes.
no code implementations • COLING 2020 • Aparna Garimella, Carmen Banea, Nabil Hossain, Rada Mihalcea
The subjective nature of humor makes computerized humor generation a challenging task.
no code implementations • 31 May 2020 • Aparna Garimella, Carmen Banea, Nabil Hossain, Rada Mihalcea
The subjective nature of humor makes computerized humor generation a challenging task.
no code implementations • ACL 2019 • Aparna Garimella, Carmen Banea, Dirk Hovy, Rada Mihalcea
Several linguistic studies have shown the prevalence of various lexical and grammatical patterns in texts authored by a person of a particular gender, but models for part-of-speech tagging and dependency parsing have still not adapted to account for these differences.
no code implementations • EMNLP 2017 • Aparna Garimella, Carmen Banea, Rada Mihalcea
Variations of word associations across different groups of people can provide insights into people{'}s psychologies and their world views.
no code implementations • WS 2016 • Aparna Garimella, Rada Mihalcea
Men are from Mars and women are from Venus - or so the genre of relationship literature would have us believe.
no code implementations • COLING 2016 • Aparna Garimella, Rada Mihalcea, James Pennebaker
Personal writings have inspired researchers in the fields of linguistics and psychology to study the relationship between language and culture to better understand the psychology of people across different cultures.