Search Results for author: Jana Diesner

Found 20 papers, 8 papers with code

StereoMap: Quantifying the Awareness of Human-like Stereotypes in Large Language Models

1 code implementation20 Oct 2023 Sullam Jeoung, Yubin Ge, Jana Diesner

Based on the SCM theory, StereoMap maps LLMs' perceptions of social groups (defined by socio-demographic features) using the dimensions of Warmth and Competence.

Examining the Causal Effect of First Names on Language Models: The Case of Social Commonsense Reasoning

1 code implementation1 Jun 2023 Sullam Jeoung, Jana Diesner, Halil Kilicoglu

As language models continue to be integrated into applications of personal and societal relevance, ensuring these models' trustworthiness is crucial, particularly with respect to producing consistent outputs regardless of sensitive attributes.

PyTAIL: Interactive and Incremental Learning of NLP Models with Human in the Loop for Online Data

1 code implementation24 Nov 2022 Shubhanshu Mishra, Jana Diesner

For natural language processing (NLP) tasks that utilize a collection of features based on lexicons and rules, it is important to adapt these features to the changing data.

Active Learning Incremental Learning +2

What Changed? Investigating Debiasing Methods using Causal Mediation Analysis

no code implementations NAACL (GeBNLP) 2022 Sullam Jeoung, Jana Diesner

Previous work has examined how debiasing language models affect downstream tasks, specifically, how debiasing techniques influence task performance and whether debiased models also make impartial predictions in downstream tasks or not.

What should I Ask: A Knowledge-driven Approach for Follow-up Questions Generation in Conversational Surveys

no code implementations23 May 2022 Yubin Ge, Ziang Xiao, Jana Diesner, Heng Ji, Karrie Karahalios, Hari Sundaram

We constructed a new human-annotated dataset of human-written follow-up questions with dialogue history and labeled knowledge in the context of conversational surveys.

Question Generation Question-Generation

BACO: A Background Knowledge- and Content-Based Framework for Citing Sentence Generation

no code implementations ACL 2021 Yubin Ge, Ly Dinh, Xiaofeng Liu, Jinsong Su, Ziyao Lu, Ante Wang, Jana Diesner

In this paper, we focus on the problem of citing sentence generation, which entails generating a short text to capture the salient information in a cited paper and the connection between the citing and cited paper.

Sentence Text Generation

An Empirical Methodology for Detecting and Prioritizing Needs during Crisis Events

1 code implementation Findings of the Association for Computational Linguistics 2020 M. Janina Sarol, Ly Dinh, Rezvaneh Rezapour, Chieh-Li Chin, Pingjing Yang, Jana Diesner

However, the sparsity of the information as well as the amount of noisy content present a challenge to practitioners to effectively identify shared information on these platforms.

Task 2

Multilevel Structural Evaluation of Signed Directed Social Networks based on Balance Theory

1 code implementation20 May 2020 Samin Aref, Ly Dinh, Rezvaneh Rezapour, Jana Diesner

We expand this modeling approach to incorporate directionality of edges, and consider three levels of analysis: triads, subgroups, and the whole network.

Social and Information Networks Optimization and Control Physics and Society 05C22, 90C90, 90C09, 90C10, 90C35, 05C15, 65K05

Beyond Citations: Corpus-based Methods for Detecting the Impact of Research Outcomes on Society

no code implementations LREC 2020 Rezvaneh Rezapour, Jutta Bopp, Norman Fiedler, Diana Steffen, Andreas Witt, Jana Diesner

This paper proposes, implements and evaluates a novel, corpus-based approach for identifying categories indicative of the impact of research via a deductive (top-down, from theory to data) and an inductive (bottom-up, from data to theory) approach.

REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning

1 code implementation IJCNLP 2019 Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao

In this study, we present a fine-grained evaluation method REO for automatically measuring the performance of image captioning systems.

Image Captioning

Enhancing the Measurement of Social Effects by Capturing Morality

no code implementations WS 2019 Rezvaneh Rezapour, Saumil H. Shah, Jana Diesner

We investigate the relationship between basic principles of human morality and the expression of opinions in user-generated text data.

Cultural Vocal Bursts Intensity Prediction

Telling Apart Tweets Associated with Controversial versus Non-Controversial Topics

no code implementations WS 2017 Aseel Addawood, Rezvaneh Rezapour, Omid Abdar, Jana Diesner

Using a combination of emphatic, language-specific, and Twitter-specific features for supervised learning resulted in 87{\%} accuracy (F1) for cross-validation of the training set and 63. 4{\%} accuracy when using the test set.

Says Who\ldots? Identification of Expert versus Layman Critics' Reviews of Documentary Films

no code implementations COLING 2016 Ming Jiang, Jana Diesner

We extend classic review mining work by building a binary classifier that predicts whether a review of a documentary film was written by an expert or a layman with 90. 70{\%} accuracy (F1 score), and compare the characteristics of the predicted classes.

Decision Making Recommendation Systems

Cannot find the paper you are looking for? You can Submit a new open access paper.