Search Results for author:
Found 77 papers, 50 papers with code
Robust Cross-lingual Embeddings from Parallel Sentences
Recent advances in cross-lingual word embeddings have primarily relied on mapping-based methods, which project pretrained word embeddings from different languages into a shared space through a linear transformation.
Cross-Lingual Document Classification
Cross-Lingual Word Embeddings
+7
Flows: Building Blocks of Reasoning and Collaborating AI
To support rapid and rigorous research, we introduce the aiFlows library embodying Flows.
Auditing Radicalization Pathways on YouTube
Non-profits, as well as the media, have hypothesized the existence of a radicalization pipeline on YouTube, claiming that users systematically progress towards more extreme content on the platform.
Computers and Society Social and Information Networks
GenIE: Generative Information Extraction
Structured and grounded representation of text is typically formalized by closed information extraction, the problem of extracting an exhaustive set of (subject, relation, object) triplets that are consistent with a predefined set of entities and relations from a knowledge base schema.
Calibration of Google Trends Time Series
In the offline preprocessing phase, an "anchor bank" is constructed, a set of queries spanning the full spectrum of popularity, all calibrated against a common reference query by carefully chaining together multiple Google Trends requests.
Grammar-Constrained Decoding for Structured NLP Tasks without Finetuning
In this work, we demonstrate that formal grammars can describe the output space for a much wider range of tasks and argue that GCD can serve as a unified framework for structured NLP tasks in general.
REFINER: Reasoning Feedback on Intermediate Representations
Language models (LMs) have recently shown remarkable performance on reasoning tasks by explicitly generating intermediate inferences, e. g., chain-of-thought prompting.
Exploiting Asymmetry for Synthetic Training Data Generation: SynthIE and the Case of Information Extraction
This work shows that useful data can be synthetically generated even for tasks that cannot be solved directly by LLMs: for problems with structured outputs, it is possible to prompt an LLM to perform the task in the reverse direction, by generating plausible input text for a target output structure.
Homepage2Vec: Language-Agnostic Website Embedding and Classification
We make publicly available the curated Curlie dataset aligned across languages, the pre-trained Homepage2Vec model, and libraries
Crosslingual Document Embedding as Reduced-Rank Ridge Regression
Finally, although not trained for embedding sentences and words, it also achieves competitive performance on crosslingual sentence and word retrieval tasks.
Artificial Artificial Artificial Intelligence: Crowd Workers Widely Use Large Language Models for Text Production Tasks
With the widespread adoption of LLMs, human gold--standard annotations are key to understanding the capabilities of LLMs and the validity of their results.
Quootstrap: Scalable Unsupervised Extraction of Quotation-Speaker Pairs from Large News Corpora via Bootstrapping
We propose Quootstrap, a method for extracting quotations, as well as the names of the speakers who uttered them, from large news corpora.
Do Llamas Work in English? On the Latent Language of Multilingual Transformers
Tracking intermediate embeddings through their high-dimensional space reveals three distinct phases, whereby intermediate embeddings (1) start far away from output token embeddings; (2) already allow for decoding a semantically correct next token in the middle layers, but give higher probability to its version in English than in the input language; (3) finally move into an input-language-specific region of the embedding space.
YouNiverse: Large-Scale Channel and Video Metadata from English-Speaking YouTube
YouTube plays a key role in entertaining and informing people around the globe.
Time Series Analysis
Social and Information Networks
Computers and Society
On the Limitations of Cross-lingual Encoders as Exposed by Reference-Free Machine Translation Evaluation
We systematically investigate a range of metrics based on state-of-the-art cross-lingual semantic representations obtained with pretrained M-BERT and LASER.
WikiHist.html: English Wikipedia's Full Revision History in HTML Format
Wikipedia is written in the wikitext markup language.
Computers and Society
Language Model Decoding as Likelihood-Utility Alignment
Specifically, by analyzing the correlation between the likelihood and the utility of predictions across a diverse set of tasks, we provide empirical evidence supporting the proposed taxonomy and a set of principles to structure reasoning when choosing a decoding algorithm.
Reverse-Engineering Satire, or "Paper on Computational Humor Accepted Despite Making Serious Advances"
Starting from the observation that satirical news headlines tend to resemble serious news headlines, we build and analyze a corpus of satirical headlines paired with nearly identical but serious headlines.
Distribution inference risks: Identifying and mitigating sources of leakage
We identify three sources of leakage: (1) memorizing specific information about the $\mathbb{E}[Y|X]$ (expected label given the feature values) of interest to the adversary, (2) wrong inductive bias of the model, and (3) finiteness of the training data.
A Critical Re-evaluation of Neural Methods for Entity Alignment
Our findings shed light on the potential problems resulting from an impulsive application of neural methods as a panacea for all data analytics tasks.
A Ladder of Causal Distances
Causal discovery, the task of automatically constructing a causal model from data, is of major significance across the sciences.
Crosslingual Topic Modeling with WikiPDA
We present Wikipedia-based Polyglot Dirichlet Allocation (WikiPDA), a crosslingual topic model that learns to represent Wikipedia articles written in any language as distributions over a common set of language-independent topics.
Invariant Language Modeling
In particular, we adapt a game-theoretic formulation of IRM (IRM-games) to language models, where the invariance emerges from a specific training schedule in which all the environments compete to optimize their own environment-specific loss by updating subsets of the model in a round-robin fashion.
Fly-Swat or Cannon? Cost-Effective Language Model Choice via Meta-Modeling
For a wide variety of tasks, inputs can be phrased as natural language prompts for an LM, from whose output the solution can then be extracted.
Hot Streaks on Social Media
We show that user impact tends to have certain characteristics: First, impact is clustered in time, such that the most impactful tweets of a user appear close to each other.
Social and Information Networks
Low-Rank Subspaces for Unsupervised Entity Linking
We propose a light-weight and scalable entity linking method, Eigenthemes, that relies solely on the availability of entity names and a referent knowledge base.
Node Attribute Completion in Knowledge Graphs with Multi-Relational Propagation
The existing literature on knowledge graph completion mostly focuses on the link prediction task.
Classifying Dyads for Militarized Conflict Analysis
We do this by devising a set of textual and graph-based features which represent each of the causes.
Evaluating Language Model Agency through Negotiations
We introduce an approach to evaluate language model (LM) agency using negotiation games.
Privacy-Preserving Classification with Secret Vector Machines
Second, we implement SecVM's distributed framework for the Cliqz web browser and deploy it for predicting user gender in a large-scale online evaluation with thousands of clients, outperforming baselines by a large margin and thus showcasing that SecVM is suitable for production environments.
Experts and authorities receive disproportionate attention on Twitter during the COVID-19 crisis
Timely access to accurate information is crucial during the COVID-19 pandemic.
Social and Information Networks
KLearn: Background Knowledge Inference from Summarization Data
The goal of text summarization is to compress documents to the relevant information while excluding background information already known to the receiver.
Better than Average: Paired Evaluation of NLP Systems
Evaluation in NLP is usually done by comparing the scores of competing systems independently averaged over a common set of test instances.
Descartes: Generating Short Descriptions of Wikipedia Articles
Wikipedia is one of the richest knowledge sources on the Web today.
United States Politicians' Tone Became More Negative with 2016 Primary Campaigns
There is a widespread belief that the tone of US political language has become more negative recently, in particular when Donald Trump entered politics.
Churn Intent Detection in Multilingual Chatbot Conversations and Social Media
To this end, we crowdsource and publish a dataset of churn intent expressions in chatbot interactions in German and English.
Volunteer contributions to Wikipedia increased during COVID-19 mobility restrictions
Wikipedia, the largest encyclopedia ever created, is a global initiative driven by volunteer contributions.
Computers and Society
Laughing Heads: Can Transformers Detect What Makes a Sentence Funny?
We make progress in both respects by training and analyzing transformer-based humor recognition models on a recently introduced dataset consisting of minimal pairs of aligned sentences, one serious, the other humorous.
Strong Heuristics for Named Entity Linking
Named entity linking (NEL) in news is a challenging endeavour due to the frequency of unseen and emerging entities, which necessitates the use of unsupervised or zero-shot methods.
An Ordinal Latent Variable Model of Conflict Intensity
It is based only on the action category ("what") and disregards the subject ("who") and object ("to whom") of an event, as well as contextual information, like associated casualty count, that should contribute to the perception of an event's "intensity".
A Glitch in the Matrix? Locating and Detecting Language Model Grounding with Fakepedia
Yet the mechanisms underlying this contextual grounding remain unknown, especially in situations where contextual information contradicts factual knowledge stored in the parameters, which LLMs also excel at recalling.
Growing Wikipedia Across Languages via Recommendation
The system involves identifying missing articles, ranking the missing articles according to their importance, and recommending important missing articles to editors based on their interests.
Social and Information Networks Digital Libraries
Quantifying Engagement with Citations on Wikipedia
Wikipedia, the free online encyclopedia that anyone can edit, is one of the most visited sites on the Web and a common source of information for many users.
Computers and Society
ESC-Rules: Explainable, Semantically Constrained Rule Sets
We describe a novel approach to explainable prediction of a continuous variable based on learning fuzzy weighted rules.
Exploiting Social Network Structure for Person-to-Person Sentiment Analysis
Person-to-person evaluations are prevalent in all kinds of discourse and important for establishing reputations, building social bonds, and shaping public opinion.
Compressive Feature Learning
This paper addresses the problem of unsupervised feature learning for text data.
Measuring Societal Biases from Text Corpora with Smoothed First-Order Co-occurrence
The common approach to measuring such biases using a corpus is by calculating the similarities between the embedding vector of a word (like nurse) and the vectors of the representative words of the concepts of interest (such as genders).
Expanding the Text Classification Toolbox with Cross-Lingual Embeddings
In particular, we test the hypothesis that embeddings with context are more effective, by multi-tasking the learning of multilingual word embeddings and text classification; we explore neural architectures for CLTC; and we move from bi- to multi-lingual word embeddings.
Eliciting New Wikipedia Users' Interests via Automatically Mined Questionnaires: For a Warm Welcome, Not a Cold Start
As such, these systems cannot make high-quality recommendations to newcomers without any previous interactions -- the so-called cold-start problem.
Secure Summation via Subset Sums: A New Primitive for Privacy-Preserving Distributed Machine Learning
For population studies or for the training of complex machine learning models, it is often required to gather data from different actors.
Deep Learning for Prostate Pathology
For case usage, these models were applied for the annotation tasks in clinician-oriented pathology reports for prostatectomy specimens.
Learning High Order Feature Interactions with Fine Control Kernels
We provide a methodology for learning sparse statistical models that use as features all possible multiplicative interactions among an underlying atomic set of features.
Behavior Cloning in OpenAI using Case Based Reasoning
Learning from Observation (LfO), also known as Behavioral Cloning, is an approach for building software agents by recording the behavior of an expert (human or artificial) and using the recorded data to generate the required behavior.
Adoption of Twitter's New Length Limit: Is 280 the New 140?
The prevalence of tweets around 140 characters before the switch in a given language is strongly correlated with the prevalence of tweets around 280 characters after the switch in the same language, and very long tweets are vastly more popular on Web clients than on mobile clients.
Formation of Social Ties Influences Food Choice: A Campus-Wide Longitudinal Study
To estimate causal effects from the passively observed log data, we control confounds in a matched quasi-experimental design: we identify focal users who at first do not have any regular eating partners but then start eating with a fixed partner regularly, and we match focal users into comparison pairs such that paired users are nearly identical with respect to covariates measured before acquiring the partner, where the two focal users' new eating partners diverge in the healthiness of their respective food choice.
Are Anti-Feminist Communities Gateways to the Far Right? Evidence from Reddit and YouTube
Our results suggest that there is a large overlap between the user bases of the Alt-right and of the Manosphere and that members of the Manosphere have a bigger chance to engage with far right content than carefully chosen counterparts.
Computers and Society
Broccoli: Sprinkling Lightweight Vocabulary Learning into Everyday Information Diets
Thus, by seeing words in context, the user can assimilate new vocabulary without much conscious effort.
Recursive input and state estimation: A general framework for learning from time series with missing data
Time series with missing data are signals encountered in important settings for machine learning.
RISE and DISE: Two Frameworks for Learning from Time Series with Missing Data
The most successful prior approaches for modeling such time series are based on recurrent neural networks that learn to impute unobserved values and then treat the imputed values as observed.
On the Context-Free Ambiguity of Emoji
We find that with 30 annotations per emoji, 16 emojis (1. 2%) are completely unambiguous, whereas 55 emojis (4. 3%) are so ambiguous that their descriptions are indistinguishable from randomly chosen descriptions.
Efficient Entity Candidate Generation for Low-Resource Languages
We also propose a light-weight and simple solution based on the construction of indexes whose design is motivated by more complex transfer learning based neural approaches.
Quote Erat Demonstrandum: A Web Interface for Exploring the Quotebank Corpus
The use of attributed quotes is the most direct and least filtered pathway of information propagation in news.
The Glass Ceiling of Automatic Evaluation in Natural Language Generation
Automatic evaluation metrics capable of replacing human judgments are critical to allowing fast development of new methods.
Evolutionary Dynamics in a Varying Environment: Continuous versus Discrete Noise
Here, we study population dynamics subject to a fluctuating environment modeled by a varying carrying capacity changing continuously in time according to either binary random switches, or by being driven by a noise of continuous range.
Generating Faithful Synthetic Data with Large Language Models: A Case Study in Computational Social Science
Large Language Models (LLMs) have democratized synthetic data generation, which in turn has the potential to simplify and broaden a wide gamut of NLP tasks.
Critical Evaluation of Artificial Intelligence as Digital Twin of Pathologist for Prostate Cancer Pathology
Adjusting the decision threshold for the secondary Gleason pattern from 5% to 10% improved the concordance level between pathologists and vPatho for tumor grading on prostatectomy specimens (kappa from 0. 44 to 0. 64).
In-class Data Analysis Replications: Teaching Students while Testing Science
Overall, we demonstrate that incorporating replication tasks into a large data science class can increase the reproducibility of scientific work as a by-product of data science instruction, thus benefiting both science and students.
Stranger Danger! Cross-Community Interactions with Fringe Users Increase the Growth of Fringe Communities on Reddit
Overall, our findings suggest that curtailing fringe-interactions may reduce the growth of fringe communities on mainstream platforms.
Prevalence and prevention of large language model use in crowd work
We show that the use of large language models (LLMs) is prevalent among crowd workers, and that targeted mitigation strategies can significantly reduce, but not eliminate, LLM use.
SoK: Memorization in General-Purpose Large Language Models
A major part of this success is due to their huge training datasets and the unprecedented number of model parameters, which allow them to memorize large amounts of information contained in the training data.
Sketch-Guided Constrained Decoding for Boosting Blackbox Large Language Models without Logit Access
This paper introduces sketch-guided constrained decoding (SGCD), a novel approach to constrained decoding for blackbox LLMs, which operates without access to the logits of the blackbox LLM.
Symbolic Autoencoding for Self-Supervised Sequence Learning
Traditional language models, adept at next-token prediction in text sequences, often struggle with transduction tasks between distinct symbolic systems, particularly when parallel data is scarce.
Making Reasoning Matter: Measuring and Improving Faithfulness of Chain-of-Thought Reasoning
In this paper, we perform a causal mediation analysis on twelve LLMs to examine how intermediate reasoning steps generated by the LLM influence the final outcome and find that LLMs do not reliably use their intermediate reasoning steps when generating an answer.
Emojinize: Enriching Any Text with Emoji Translations
Emoji have become ubiquitous in written communication, on the Web and beyond.
The Era of Semantic Decoding
We refer to these orchestrated interactions among semantic processors, optimizing and searching in semantic space, as semantic decoding algorithms.
Can Language Models Recognize Convincing Arguments?
The remarkable and ever-increasing capabilities of Large Language Models (LLMs) have raised concerns about their potential misuse for creating personalized, convincing misinformation and propaganda.
Edisum: Summarizing and Explaining Wikipedia Edits at Scale
To overcome this problem and help editors write useful edit summaries, we propose a model for recommending edit summaries generated by a language model trained to produce good edit summaries given the representation of an edit diff.
