no code implementations • 3 Mar 2025 • Anh Tong, Thanh Nguyen-Tang, Dongeun Lee, Duc Nguyen, Toan Tran, David Hall, Cheongwoong Kang, Jaesik Choi
Recent advancements in large language models (LLMs) based on transformer architectures have sparked significant interest in understanding their inner workings.
no code implementations • 7 Oct 2024 • Kaiyue Wen, Zhiyuan Li, Jason Wang, David Hall, Percy Liang, Tengyu Ma
In contrast, the Warmup-Stable-Decay (WSD) schedule uses a constant learning rate to produce a main branch of iterates that can in principle continue indefinitely without a pre-specified compute budget.
no code implementations • 29 Apr 2024 • David Hall, Stephen Hausler, Sutharsan Mahendren, Peyman Moghadam
Neural fields provide a continuous scene representation of 3D geometry and appearance in a way which has great promise for robotics applications.
1 code implementation • 27 Mar 2024 • Elliot Bolton, Abhinav Venigalla, Michihiro Yasunaga, David Hall, Betty Xiong, Tony Lee, Roxana Daneshjou, Jonathan Frankle, Percy Liang, Michael Carbin, Christopher D. Manning
Models such as GPT-4 and Med-PaLM 2 have demonstrated impressive performance on a wide variety of biomedical NLP tasks.
no code implementations • 15 Feb 2024 • Stephen Hausler, David Hall, Sutharsan Mahendren, Peyman Moghadam
Neural fields, coordinate-based neural networks, have recently gained popularity for implicitly representing a scene.
1 code implementation • 14 Jun 2023 • John Thickstun, David Hall, Chris Donahue, Percy Liang
We achieve this by interleaving sequences of events and controls, such that controls appear following stopping times in the event sequence.
7 code implementations • 23 May 2023 • Hong Liu, Zhiyuan Li, David Hall, Percy Liang, Tengyu Ma
Given the massive cost of language model pre-training, a non-trivial improvement of the optimization algorithm would lead to a material reduction on the time and cost of training.
2 code implementations • 28 Dec 2022 • Omar Khattab, Keshav Santhanam, Xiang Lisa Li, David Hall, Percy Liang, Christopher Potts, Matei Zaharia
Retrieval-augmented in-context learning has emerged as a powerful approach for addressing knowledge-intensive tasks using frozen language models (LM) and retrieval models (RM).
no code implementations • 13 Oct 2022 • Matt Deitke, Dhruv Batra, Yonatan Bisk, Tommaso Campari, Angel X. Chang, Devendra Singh Chaplot, Changan Chen, Claudia Pérez D'Arpino, Kiana Ehsani, Ali Farhadi, Li Fei-Fei, Anthony Francis, Chuang Gan, Kristen Grauman, David Hall, Winson Han, Unnat Jain, Aniruddha Kembhavi, Jacob Krantz, Stefan Lee, Chengshu Li, Sagnik Majumder, Oleksandr Maksymets, Roberto Martín-Martín, Roozbeh Mottaghi, Sonia Raychaudhuri, Mike Roberts, Silvio Savarese, Manolis Savva, Mohit Shridhar, Niko Sünderhauf, Andrew Szot, Ben Talbot, Joshua B. Tenenbaum, Jesse Thomason, Alexander Toshev, Joanne Truong, Luca Weihs, Jiajun Wu
We present a retrospective on the state of Embodied AI research.
no code implementations • 8 Aug 2022 • Thorsten Kurth, Shashank Subramanian, Peter Harrington, Jaideep Pathak, Morteza Mardani, David Hall, Andrea Miele, Karthik Kashinath, Animashree Anandkumar
Extreme weather amplified by climate change is causing increasingly devastating impacts across the globe.
5 code implementations • 22 Feb 2022 • Jaideep Pathak, Shashank Subramanian, Peter Harrington, Sanjeev Raja, Ashesh Chattopadhyay, Morteza Mardani, Thorsten Kurth, David Hall, Zongyi Li, Kamyar Azizzadenesheli, Pedram Hassanzadeh, Karthik Kashinath, Animashree Anandkumar
FourCastNet accurately forecasts high-resolution, fast-timescale variables such as the surface wind speed, precipitation, and atmospheric water vapor.
no code implementations • 2 Dec 2020 • Catherine E. Grant, Eric D. Miller, Marshall W. Bautz, Tanja Eraerds, Silvano Molendi, Jonathan Keelan, David Hall, Andrew D. Holland, Ralph P. Kraft, Esra Bulbul, Paul Nulsen, Steven Allen
One of the science goals of the Wide Field Imager (WFI) on ESA's Athena X-ray observatory is to map hot gas structures in the universe, such as clusters and groups of galaxies and the intergalactic medium.
Instrumentation and Methods for Astrophysics
no code implementations • 3 Oct 2020 • Fan Zhang, David Hall, Tao Xu, Stephen Boyle, David Bull
Methods for environmental image capture, 3D reconstruction (photogrammetry) and the creation of foreground assets are presented along with a flexible and user-friendly simulation interface.
1 code implementation • 24 Sep 2020 • Semantic Machines, Jacob Andreas, John Bufe, David Burkett, Charles Chen, Josh Clausman, Jean Crawford, Kate Crim, Jordan DeLoach, Leah Dorner, Jason Eisner, Hao Fang, Alan Guo, David Hall, Kristin Hayes, Kellie Hill, Diana Ho, Wendy Iwaszuk, Smriti Jha, Dan Klein, Jayant Krishnamurthy, Theo Lanman, Percy Liang, Christopher H Lin, Ilya Lintsbakh, Andy McGovern, Aleksandr Nisnevich, Adam Pauls, Dmitrij Petters, Brent Read, Dan Roth, Subhro Roy, Jesse Rusak, Beth Short, Div Slomin, Ben Snyder, Stephon Striplin, Yu Su, Zachary Tellman, Sam Thomson, Andrei Vorobev, Izabela Witoszko, Jason Wolfe, Abby Wray, Yuchen Zhang, Alexander Zotov
We describe an approach to task-oriented dialogue in which dialogue state is represented as a dataflow graph.
no code implementations • 3 Aug 2020 • Ben Talbot, David Hall, Haoyang Zhang, Suman Raj Bista, Rohan Smith, Feras Dayoub, Niko Sünderhauf
We introduce BenchBot, a novel software suite for benchmarking the performance of robotics research across both photorealistic 3D simulations and real robot platforms.
Robotics
no code implementations • 18 May 2020 • Christina Kumler-Bonfanti, Jebb Stewart, David Hall, Mark Govett
All four U-Nets are fast information extraction tools and perform with a ROI detection accuracy ranging from 80% to 99%.
no code implementations • 8 Jan 2020 • Peter Corke, Feras Dayoub, David Hall, John Skinner, Niko Sünderhauf
The computer vision and robotics research communities are each strong.
no code implementations • 7 Oct 2019 • Steve Branson, Jan Dirk Wegner, David Hall, Nico Lang, Konrad Schindler, Pietro Perona
We believe this is the first work to exploit publicly available image data for fine-grained tree mapping at city-scale, respectively over many thousands of trees.
no code implementations • 19 Mar 2019 • John Skinner, David Hall, Haoyang Zhang, Feras Dayoub, Niko Sünderhauf
We introduce a new challenge for computer and robotic vision, the first ACRV Robotic Vision Challenge, Probabilistic Object Detection.
1 code implementation • 27 Nov 2018 • David Hall, Feras Dayoub, John Skinner, Haoyang Zhang, Dimity Miller, Peter Corke, Gustavo Carneiro, Anelia Angelova, Niko Sünderhauf
We introduce Probabilistic Object Detection, the task of detecting objects in images and accurately quantifying the spatial and semantic uncertainties of the detections.
no code implementations • 25 Jan 2018 • David Hall, Feras Dayoub, Tristan Perez, Chris McCool
In this work, we obviate this assumption and introduce a rapidly deployable approach able to operate on any field without any weed species assumptions prior to deployment.
no code implementations • 4 Feb 2017 • David Hall, Feras Dayoub, Jason Kulk, Chris McCool
This greatly limits deployability as classification systems must be retrained for any field with a different set of weed species present within them.
no code implementations • CVPR 2016 • Jan D. Wegner, Steven Branson, David Hall, Konrad Schindler, Pietro Perona
The main technical challenge is combining test time information from multiple views of each geographic location (e. g., aerial and street views).
no code implementations • CVPR 2015 • David Hall, Pietro Perona
This dataset is designed to train and test algorithms for fine-grained categorisation of people, it is also useful for benchmarking tracking, detection and pose estimation of pedestrians.
no code implementations • CVPR 2014 • David Hall, Pietro Perona
A method for online, real-time learning of individual-object detectors is presented.
1 code implementation • 6 Jan 2014 • Richard Massey, Tim Schrabback, Oliver Cordes, Ole Marggraf, Holger Israel, Lance Miller, David Hall, Mark Cropper, Thibaut Prod'homme, Sami-Matias Niemi
Read noise is added after charge transfer so does not get trailed - but it is incorrectly untrailed during post-processing.
Instrumentation and Methods for Astrophysics Cosmology and Nongalactic Astrophysics