no code implementations • 1 Aug 2024 • Charles O'Neill, Christine Ye, Kartheik Iyer, John F. Wu
Sparse autoencoders (SAEs) have shown promise in extracting interpretable features from complex neural networks.
1 code implementation • 30 May 2024 • John F. Wu, Alina Hyk, Kiera McCormick, Christine Ye, Simone Astarita, Elina Baral, Jo Ciuca, Jesse Cranney, Anjalie Field, Kartheik Iyer, Philipp Koehn, Jenn Kotler, Sandor Kruk, Michelle Ntampaka, Charles O'Neill, Joshua E. G. Peek, Sanjib Sharma, Mikaeel Yunus
It is imperative to understand how researchers interact with these models and how scientific sub-communities like astronomy might benefit from them.
no code implementations • 3 Jan 2024 • Ernest Perkowski, Rui Pan, Tuan Dung Nguyen, Yuan-Sen Ting, Sandor Kruk, Tong Zhang, Charlie O'Neill, Maja Jablonska, Zechang Sun, Michael J. Smith, Huiling Liu, Kevin Schawinski, Kartheik Iyer, Ioana Ciucă for UniverseTBD
We explore the potential of enhancing LLM performance in astronomy-focused question-answering through targeted, continual pre-training.
no code implementations • 12 Sep 2023 • Tuan Dung Nguyen, Yuan-Sen Ting, Ioana Ciucă, Charlie O'Neill, Ze-Chang Sun, Maja Jabłońska, Sandor Kruk, Ernest Perkowski, Jack Miller, Jason Li, Josh Peek, Kartheik Iyer, Tomasz Różański, Pranav Khetarpal, Sharaf Zaman, David Brodrick, Sergio J. Rodríguez Méndez, Thang Bui, Alyssa Goodman, Alberto Accomazzi, Jill Naiman, Jesse Cranney, Kevin Schawinski, UniverseTBD
Large language models excel in many human-language tasks but often falter in highly specialized domains like scholarly astronomy.
no code implementations • 20 Jun 2023 • Ioana Ciucă, Yuan-Sen Ting, Sandor Kruk, Kartheik Iyer
This study investigates the application of Large Language Models (LLMs), specifically GPT-4, within Astronomy.