Text-to-Graph extraction aims to automatically extract information graphs consisting of mentions and types from natural language texts.
Ranked #3 on Relation Extraction on ACE 2005
The Minecraft Collaborative Building Task is a two-player game in which an Architect (A) instructs a Builder (B) to construct a target structure in a simulated Blocks World Environment.
The objective of this shared task is to produce an inflected form of a word, given its lemma and a set of tags describing the attributes of the desired form.
The ability to match pieces of code to their corresponding natural language descriptions and vice versa is fundamental for natural language search interfaces to software repositories.
In this paper, we formulate phrase grounding as a sequence labeling task where we treat candidate regions as potential labels, and use neural chain Conditional Random Fields (CRFs) to model dependencies among regions for adjacent mentions.
Agents that communicate back and forth with humans to help them execute non-linguistic tasks are a long sought goal of AI.
We propose a framework that captures the denotational probabilities of words and phrases by embedding them in a vector space, and present a method to induce such an embedding from a dataset of denotational probabilities.
This paper presents a framework for localization or grounding of phrases in images using a large collection of linguistic and visual cues.
We compare the effectiveness of four different syntactic CCG parsers for a semantic slot-filling task to explore how much syntactic supervision is required for downstream semantic analysis.
The Flickr30k dataset has become a standard benchmark for sentence-based image description.
Ranked #14 on Image Retrieval on Flickr30K 1K test
We propose to use the visual denotations of linguistic expressions (i. e. the set of images they describe) to define novel denotational similarity metrics, which we show to be at least as beneficial as distributional similarities for two tasks that require semantic inference.