Search Results for author: Saif M. Mohammad

Found 43 papers, 13 papers with code

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

1 code implementation9 Jun 2022 Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang, Alicia Parrish, Allen Nie, Aman Hussain, Amanda Askell, Amanda Dsouza, Ambrose Slone, Ameet Rahane, Anantharaman S. Iyer, Anders Andreassen, Andrea Madotto, Andrea Santilli, Andreas Stuhlmüller, Andrew Dai, Andrew La, Andrew Lampinen, Andy Zou, Angela Jiang, Angelica Chen, Anh Vuong, Animesh Gupta, Anna Gottardi, Antonio Norelli, Anu Venkatesh, Arash Gholamidavoodi, Arfa Tabassum, Arul Menezes, Arun Kirubarajan, Asher Mullokandov, Ashish Sabharwal, Austin Herrick, Avia Efrat, Aykut Erdem, Ayla Karakaş, B. Ryan Roberts, Bao Sheng Loe, Barret Zoph, Bartłomiej Bojanowski, Batuhan Özyurt, Behnam Hedayatnia, Behnam Neyshabur, Benjamin Inden, Benno Stein, Berk Ekmekci, Bill Yuchen Lin, Blake Howald, Cameron Diao, Cameron Dour, Catherine Stinson, Cedrick Argueta, César Ferri Ramírez, Chandan Singh, Charles Rathkopf, Chenlin Meng, Chitta Baral, Chiyu Wu, Chris Callison-Burch, Chris Waites, Christian Voigt, Christopher D. Manning, Christopher Potts, Cindy Ramirez, Clara E. Rivera, Clemencia Siro, Colin Raffel, Courtney Ashcraft, Cristina Garbacea, Damien Sileo, Dan Garrette, Dan Hendrycks, Dan Kilman, Dan Roth, Daniel Freeman, Daniel Khashabi, Daniel Levy, Daniel Moseguí González, Danielle Perszyk, Danny Hernandez, Danqi Chen, Daphne Ippolito, Dar Gilboa, David Dohan, David Drakard, David Jurgens, Debajyoti Datta, Deep Ganguli, Denis Emelin, Denis Kleyko, Deniz Yuret, Derek Chen, Derek Tam, Dieuwke Hupkes, Diganta Misra, Dilyar Buzan, Dimitri Coelho Mollo, Diyi Yang, Dong-Ho Lee, Ekaterina Shutova, Ekin Dogus Cubuk, Elad Segal, Eleanor Hagerman, Elizabeth Barnes, Elizabeth Donoway, Ellie Pavlick, Emanuele Rodola, Emma Lam, Eric Chu, Eric Tang, Erkut Erdem, Ernie Chang, Ethan A. Chi, Ethan Dyer, Ethan Jerzak, Ethan Kim, Eunice Engefu Manyasi, Evgenii Zheltonozhskii, Fanyue Xia, Fatemeh Siar, Fernando Martínez-Plumed, Francesca Happé, Francois Chollet, Frieda Rong, Gaurav Mishra, Genta Indra Winata, Gerard de Melo, Germán Kruszewski, Giambattista Parascandolo, Giorgio Mariani, Gloria Wang, Gonzalo Jaimovitch-López, Gregor Betz, Guy Gur-Ari, Hana Galijasevic, Hannah Kim, Hannah Rashkin, Hannaneh Hajishirzi, Harsh Mehta, Hayden Bogar, Henry Shevlin, Hinrich Schütze, Hiromu Yakura, Hongming Zhang, Hugh Mee Wong, Ian Ng, Isaac Noble, Jaap Jumelet, Jack Geissinger, Jackson Kernion, Jacob Hilton, Jaehoon Lee, Jaime Fernández Fisac, James B. Simon, James Koppel, James Zheng, James Zou, Jan Kocoń, Jana Thompson, Jared Kaplan, Jarema Radom, Jascha Sohl-Dickstein, Jason Phang, Jason Wei, Jason Yosinski, Jekaterina Novikova, Jelle Bosscher, Jennifer Marsh, Jeremy Kim, Jeroen Taal, Jesse Engel, Jesujoba Alabi, Jiacheng Xu, Jiaming Song, Jillian Tang, Joan Waweru, John Burden, John Miller, John U. Balis, Jonathan Berant, Jörg Frohberg, Jos Rozen, Jose Hernandez-Orallo, Joseph Boudeman, Joseph Jones, Joshua B. Tenenbaum, Joshua S. Rule, Joyce Chua, Kamil Kanclerz, Karen Livescu, Karl Krauth, Karthik Gopalakrishnan, Katerina Ignatyeva, Katja Markert, Kaustubh D. Dhole, Kevin Gimpel, Kevin Omondi, Kory Mathewson, Kristen Chiafullo, Ksenia Shkaruta, Kumar Shridhar, Kyle McDonell, Kyle Richardson, Laria Reynolds, Leo Gao, Li Zhang, Liam Dugan, Lianhui Qin, Lidia Contreras-Ochando, Louis-Philippe Morency, Luca Moschella, Lucas Lam, Lucy Noble, Ludwig Schmidt, Luheng He, Luis Oliveros Colón, Luke Metz, Lütfi Kerem Şenel, Maarten Bosma, Maarten Sap, Maartje ter Hoeve, Maheen Farooqi, Manaal Faruqui, Mantas Mazeika, Marco Baturan, Marco Marelli, Marco Maru, Maria Jose Ramírez Quintana, Marie Tolkiehn, Mario Giulianelli, Martha Lewis, Martin Potthast, Matthew L. Leavitt, Matthias Hagen, Mátyás Schubert, Medina Orduna Baitemirova, Melody Arnaud, Melvin McElrath, Michael A. Yee, Michael Cohen, Michael Gu, Michael Ivanitskiy, Michael Starritt, Michael Strube, Michał Swędrowski, Michele Bevilacqua, Michihiro Yasunaga, Mihir Kale, Mike Cain, Mimee Xu, Mirac Suzgun, Mo Tiwari, Mohit Bansal, Moin Aminnaseri, Mor Geva, Mozhdeh Gheini, Mukund Varma T, Nanyun Peng, Nathan Chi, Nayeon Lee, Neta Gur-Ari Krakover, Nicholas Cameron, Nicholas Roberts, Nick Doiron, Nikita Nangia, Niklas Deckers, Niklas Muennighoff, Nitish Shirish Keskar, Niveditha S. Iyer, Noah Constant, Noah Fiedel, Nuan Wen, Oliver Zhang, Omar Agha, Omar Elbaghdadi, Omer Levy, Owain Evans, Pablo Antonio Moreno Casares, Parth Doshi, Pascale Fung, Paul Pu Liang, Paul Vicol, Pegah Alipoormolabashi, Peiyuan Liao, Percy Liang, Peter Chang, Peter Eckersley, Phu Mon Htut, Pinyu Hwang, Piotr Miłkowski, Piyush Patil, Pouya Pezeshkpour, Priti Oli, Qiaozhu Mei, Qing Lyu, Qinlang Chen, Rabin Banjade, Rachel Etta Rudolph, Raefer Gabriel, Rahel Habacker, Ramón Risco Delgado, Raphaël Millière, Rhythm Garg, Richard Barnes, Rif A. Saurous, Riku Arakawa, Robbe Raymaekers, Robert Frank, Rohan Sikand, Roman Novak, Roman Sitelew, Ronan LeBras, Rosanne Liu, Rowan Jacobs, Rui Zhang, Ruslan Salakhutdinov, Ryan Chi, Ryan Lee, Ryan Stovall, Ryan Teehan, Rylan Yang, Sahib Singh, Saif M. Mohammad, Sajant Anand, Sam Dillavou, Sam Shleifer, Sam Wiseman, Samuel Gruetter, Samuel R. Bowman, Samuel S. Schoenholz, Sanghyun Han, Sanjeev Kwatra, Sarah A. Rous, Sarik Ghazarian, Sayan Ghosh, Sean Casey, Sebastian Bischoff, Sebastian Gehrmann, Sebastian Schuster, Sepideh Sadeghi, Shadi Hamdan, Sharon Zhou, Shashank Srivastava, Sherry Shi, Shikhar Singh, Shima Asaadi, Shixiang Shane Gu, Shubh Pachchigar, Shubham Toshniwal, Shyam Upadhyay, Shyamolima, Debnath, Siamak Shakeri, Simon Thormeyer, Simone Melzi, Siva Reddy, Sneha Priscilla Makini, Soo-Hwan Lee, Spencer Torene, Sriharsha Hatwar, Stanislas Dehaene, Stefan Divic, Stefano Ermon, Stella Biderman, Stephanie Lin, Stephen Prasad, Steven T. Piantadosi, Stuart M. Shieber, Summer Misherghi, Svetlana Kiritchenko, Swaroop Mishra, Tal Linzen, Tal Schuster, Tao Li, Tao Yu, Tariq Ali, Tatsu Hashimoto, Te-Lin Wu, Théo Desbordes, Theodore Rothschild, Thomas Phan, Tianle Wang, Tiberius Nkinyili, Timo Schick, Timofei Kornev, Timothy Telleen-Lawton, Titus Tunduny, Tobias Gerstenberg, Trenton Chang, Trishala Neeraj, Tushar Khot, Tyler Shultz, Uri Shaham, Vedant Misra, Vera Demberg, Victoria Nyamai, Vikas Raunak, Vinay Ramasesh, Vinay Uday Prabhu, Vishakh Padmakumar, Vivek Srikumar, William Fedus, William Saunders, William Zhang, Wout Vossen, Xiang Ren, Xiaoyu Tong, Xinran Zhao, Xinyi Wu, Xudong Shen, Yadollah Yaghoobzadeh, Yair Lakretz, Yangqiu Song, Yasaman Bahri, Yejin Choi, Yichi Yang, Yiding Hao, Yifu Chen, Yonatan Belinkov, Yu Hou, Yufang Hou, Yuntao Bai, Zachary Seid, Zhuoye Zhao, Zijian Wang, Zijie J. Wang, ZiRui Wang, Ziyi Wu

BIG-bench focuses on tasks that are believed to be beyond the capabilities of current language models.

Common Sense Reasoning

D3: A Massive Dataset of Scholarly Metadata for Analyzing the State of Computer Science Research

no code implementations28 Apr 2022 Jan Philip Wahle, Terry Ruas, Saif M. Mohammad, Bela Gipp

We present an initial analysis focused on the volume of computer science research (e. g., number of papers, authors, research activity), trends in topics of interest, and citation patterns.

Tweet Emotion Dynamics: Emotion Word Usage in Tweets from US and Canada

1 code implementation11 Apr 2022 Krishnapriya Vishnubhotla, Saif M. Mohammad

Over the last decade, Twitter has emerged as one of the most influential forums for social, political, and health discourse.

What Makes Sentences Semantically Related: A Textual Relatedness Dataset and Empirical Study

1 code implementation10 Oct 2021 Mohamed Abdalla, Krishnapriya Vishnubhotla, Saif M. Mohammad

The degree of semantic relatedness (or, closeness in meaning) of two units of language has long been considered fundamental to understanding meaning.

Question Answering Semantic Similarity +1

Ethics Sheet for Automatic Emotion Recognition and Sentiment Analysis

1 code implementation CL (ACL) 2022 Saif M. Mohammad

The objective of the sheet is to facilitate and encourage more thoughtfulness on why to automate, how to automate, and how to judge success well before the building of AER systems.

Emotion Recognition Ethics +1

Ethics Sheets for AI Tasks

1 code implementation2 Jul 2021 Saif M. Mohammad

I will also present a template for ethics sheets with 50 ethical considerations, using the task of emotion recognition as a running example.

Emotion Recognition Ethics +1

Ruddit: Norms of Offensiveness for English Reddit Comments

1 code implementation ACL 2021 Rishav Hada, Sohi Sudhir, Pushkar Mishra, Helen Yannakoudakis, Saif M. Mohammad, Ekaterina Shutova

On social media platforms, hateful and offensive language negatively impact the mental well-being of users and the participation of people from diverse backgrounds.

Emotion Dynamics in Movie Dialogues

1 code implementation1 Mar 2021 Will E. Hipson, Saif M. Mohammad

In this paper, we introduce a framework to track emotion dynamics through one's utterances.

Practical and Ethical Considerations in the Effective use of Emotion and Sentiment Lexicons

1 code implementation6 Nov 2020 Saif M. Mohammad

Lexicons of word-emotion associations are widely used in research and real-world applications.

NLP Scholar: An Interactive Visual Explorer for Natural Language Processing Literature

no code implementations ACL 2020 Saif M. Mohammad

As part of the NLP Scholar project, we created a single unified dataset of NLP papers and their meta-information (including citation numbers), by extracting and aligning information from the ACL Anthology and Google Scholar.

Natural Language Processing

Gender Gap in Natural Language Processing Research: Disparities in Authorship and Citations

no code implementations ACL 2020 Saif M. Mohammad

Disparities in authorship and citations across gender can have substantial adverse consequences not just on the disadvantaged genders, but also on the field of study as a whole.

Natural Language Processing

Examining Citations of Natural Language Processing Literature

no code implementations ACL 2020 Saif M. Mohammad

We extracted information from the ACL Anthology (AA) and Google Scholar (GS) to examine trends in citations of NLP papers.

Natural Language Processing Sentiment Analysis

NLP Scholar: A Dataset for Examining the State of NLP Research

no code implementations LREC 2020 Saif M. Mohammad

We aligned the information in the AA and Google Scholar datasets to create the NLP Scholar Dataset {--} a single unified source of information (from both AA and Google Scholar) for tens of thousands of NLP papers.

Natural Language Processing

WordWars: A Dataset to Examine the Natural Selection of Words

no code implementations LREC 2020 Saif M. Mohammad

We explore three broad questions with the dataset: (1) what is the degree to which predominant words in these synsets have changed, (2) how do prominent word features such as frequency, length, and concreteness impact natural selection, and (3) what are the differences between the predominant words of the 2000s and the predominant words of early 1800s.

PoKi: A Large Dataset of Poems by Children

2 code implementations LREC 2020 Will E. Hipson, Saif M. Mohammad

We use non-parametric regressions to model developmental differences from early childhood to late-adolescence.

The Natural Selection of Words: Finding the Features of Fitness

1 code implementation19 Aug 2019 Peter D. Turney, Saif M. Mohammad

We introduce a dataset for studying the evolution of words, constructed from WordNet and the Google Books Ngram Corpus.

IEST: WASSA-2018 Implicit Emotions Shared Task

no code implementations WS 2018 Roman Klinger, Orphée De Clercq, Saif M. Mohammad, Alexandra Balahur

Here, for the first time, we propose a shared task where systems have to predict the emotions in a large automatically labeled dataset of tweets without access to words denoting emotions.

Sentiment Composition of Words with Opposing Polarities

no code implementations NAACL 2016 Svetlana Kiritchenko, Saif M. Mohammad

In this paper, we explore sentiment composition in phrases that have at least one positive and at least one negative word---phrases like 'happy accident' and 'best winter break'.

NRC-Canada at SMM4H Shared Task: Classifying Tweets Mentioning Adverse Drug Reactions and Medication Intake

no code implementations11 May 2018 Svetlana Kiritchenko, Saif M. Mohammad, Jason Morin, Berry de Bruijn

Our team, NRC-Canada, participated in two shared tasks at the AMIA-2017 Workshop on Social Media Mining for Health Applications (SMM4H): Task 1 - classification of tweets mentioning adverse drug reactions, and Task 2 - classification of tweets describing personal medication intake.

General Classification Word Embeddings

The Effect of Negators, Modals, and Degree Adverbs on Sentiment Composition

no code implementations WS 2016 Svetlana Kiritchenko, Saif M. Mohammad

Using phrasal terms in the created dataset, we analyze the impact of individual modifiers and the average effect of the groups of modifiers on overall sentiment.

Capturing Reliable Fine-Grained Sentiment Associations by Crowdsourcing and Best-Worst Scaling

no code implementations5 Dec 2017 Svetlana Kiritchenko, Saif M. Mohammad

Access to word-sentiment associations is useful for many applications, including sentiment analysis, stance detection, and linguistic analysis.

Sentiment Analysis Stance Detection

Best-Worst Scaling More Reliable than Rating Scales: A Case Study on Sentiment Intensity Annotation

no code implementations ACL 2017 Svetlana Kiritchenko, Saif M. Mohammad

Rating scales are a widely used method for data annotation; however, they present several challenges, such as difficulty in maintaining inter- and intra-annotator consistency.

Emotion Intensities in Tweets

1 code implementation SEMEVAL 2017 Saif M. Mohammad, Felipe Bravo-Marquez

This paper examines the task of detecting intensity of emotion from text.

WASSA-2017 Shared Task on Emotion Intensity

no code implementations WS 2017 Saif M. Mohammad, Felipe Bravo-Marquez

We present the first shared task on detecting the intensity of emotion felt by the speaker of a tweet.

Word Affect Intensities

no code implementations28 Apr 2017 Saif M. Mohammad

Words often convey affect -- emotions, feelings, and attitudes.

Emotion Recognition Text Generation

Stance and Sentiment in Tweets

no code implementations5 May 2016 Saif M. Mohammad, Parinaz Sobhani, Svetlana Kiritchenko

However, a person may express the same stance towards a target by using negative or positive language.

General Classification Stance Classification +2

Generating Music from Literature

no code implementations WS 2014 Hannah Davis, Saif M. Mohammad

We present a system, TransProse, that automatically generates musical pieces from text.

Generating Extractive Summaries of Scientific Paradigms

no code implementations4 Feb 2014 Vahed Qazvinian, Dragomir R. Radev, Saif M. Mohammad, Bonnie Dorr, David Zajic, Michael Whidby, Taesun Moon

Researchers and scientists increasingly find themselves in the position of having to quickly understand large amounts of technical material.

Community Detection Dependency Parsing +1

Experiments with Three Approaches to Recognizing Lexical Entailment

1 code implementation31 Jan 2014 Peter D. Turney, Saif M. Mohammad

Two general strategies for RLE have been proposed: One strategy is to manually construct an asymmetric similarity measure for context vectors (directional similarity) and another is to treat RLE as a problem of learning to recognize semantic relations using supervised machine learning techniques (relation classification).

General Classification Lexical Entailment +1

Identifying Purpose Behind Electoral Tweets

no code implementations5 Nov 2013 Saif M. Mohammad, Svetlana Kiritchenko, Joel Martin

Finally, we show that resources developed for emotion detection are also helpful for detecting purpose.

Question Answering

Using Nuances of Emotion to Identify Personality

no code implementations24 Sep 2013 Saif M. Mohammad, Svetlana Kiritchenko

Past work on personality detection has shown that frequency of lexical categories such as first person pronouns, past tense verbs, and sentiment words have significant correlations with personality traits.

Tracking Sentiment in Mail: How Genders Differ on Emotional Axes

no code implementations24 Sep 2013 Saif M. Mohammad, Tony, Yang

With the widespread use of email, we now have access to unprecedented amounts of text that we ourselves have written.

Sentiment Analysis

Even the Abstract have Colour: Consensus in Word-Colour Associations

no code implementations20 Sep 2013 Saif M. Mohammad

Colour is a key component in the successful dissemination of information.

Marketing

Crowdsourcing a Word-Emotion Association Lexicon

no code implementations28 Aug 2013 Saif M. Mohammad, Peter D. Turney

Even though considerable attention has been given to the polarity of words (positive and negative) and the creation of large polarity lexicons, research in emotion analysis has had to rely on limited and small emotion lexicons.

Emotion Recognition

NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweets

1 code implementation SEMEVAL 2013 Saif M. Mohammad, Svetlana Kiritchenko, Xiaodan Zhu

In this paper, we describe how we created two state-of-the-art SVM classifiers, one to detect the sentiment of messages such as tweets and SMS (message-level task) and one to detect the sentiment of a term within a submissions stood first in both tasks on tweets, obtaining an F-score of 69. 02 in the message-level task and 88. 93 in the term-level task.

Sentiment Analysis

Computing Lexical Contrast

no code implementations CL 2013 Saif M. Mohammad, Bonnie J. Dorr, Graeme Hirst, Peter D. Turney

We then present an automatic and empirical measure of lexical contrast that relies on the contrast hypothesis, corpus statistics, and the structure of a {\it Roget}-like thesaurus.

Information Retrieval Machine Translation +1

Cannot find the paper you are looking for? You can Submit a new open access paper.