AstroLLaMA: Towards Specialized Foundation Models in Astronomy

no code implementations • 12 Sep 2023 • Tuan Dung Nguyen, Yuan-Sen Ting, Ioana Ciucă, Charlie O'Neill, Ze-Chang Sun, Maja Jabłońska, Sandor Kruk, Ernest Perkowski, Jack Miller, Jason Li, Josh Peek, Kartheik Iyer, Tomasz Różański, Pranav Khetarpal, Sharaf Zaman, David Brodrick, Sergio J. Rodríguez Méndez, Thang Bui, Alyssa Goodman, Alberto Accomazzi, Jill Naiman, Jesse Cranney, Kevin Schawinski, UniverseTBD

Large language models excel in many human-language tasks but often falter in highly specialized domains like scholarly astronomy.

Astronomy Causal Language Modeling +2

Syntactic Complexity Identification, Measurement, and Reduction Through Controlled Syntactic Simplification

1 code implementation • 16 Apr 2023 • Muhammad Salman, Armin Haller, Sergio J. Rodríguez Méndez

However, it is always hard to understand and retrieve knowledge from unstructured text, which is usually in the form of compound and complex sentences.

Knowledge Graphs Sentence +2

A Pipeline for Analysing Grant Applications

no code implementations • 30 Oct 2022 • Shuaiqun Pan, Sergio J. Rodríguez Méndez, Kerry Taylor

In addition to predicting the IC score for each research proposal, we are particularly interested in understanding the vocabulary of innovative proposals.

TNNT: The Named Entity Recognition Toolkit

1 code implementation • 31 Aug 2021 • Sandaru Seneviratne, Sergio J. Rodríguez Méndez, Xuecheng Zhang, Pouya G. Omran, Kerry Taylor, Armin Haller

Extraction of categorised named entities from text is a complex task given the availability of a variety of Named Entity Recognition (NER) models and the unstructured information encoded in different source document formats.

graph construction named-entity-recognition +2