no code implementations • EMNLP (newsum) 2021 • Nicole Beckage, Shachi H Kumar, Saurav Sahay, Ramesh Manuvinakurike
By compressing the previous contexts by ~70%, we achieve better ROUGE scores over our baseline models.
no code implementations • ACL 2021 • Richard Antonello, Nicole Beckage, Javier Turek, Alexander Huth
Here we present a general fine-tuning method that we call information gain filtration for improving the overall training efficiency and final performance of language model fine-tuning.
no code implementations • 12 May 2021 • Hsiang-Yun Sherry Chien, Javier S. Turek, Nicole Beckage, Vy A. Vo, Christopher J. Honey, Ted L. Willke
Altogether, we found that LSTM with the proposed forget gate can learn long-term dependencies, outperforming other recurrent networks in multiple domains; such gating mechanism can be integrated into other architectures for improving the learning of long timescale information in recurrent neural networks.
no code implementations • International Conference on Unmanned Aircraft Systems (ICUAS) 2020 • Daksh Shukla, Shawn Keshmiri, Nicole Beckage
The ANN autopilot aims to mimic a unified guidance, navigation & control (GNC) system to fly a fixed-wing UAS.
1 code implementation • 1 May 2020 • Richard Antonello, Nicole Beckage, Javier Turek, Alexander Huth
Here we present a general fine-tuning method that we call information gain filtration for improving the overall training efficiency and final performance of language model fine-tuning.