Search Results for author: Daniel Nichols

Found 4 papers, 0 papers with code

Modeling Parallel Programs using Large Language Models

no code implementations29 Jun 2023 Daniel Nichols, Aniruddha Marathe, Harshitha Menon, Todd Gamblin, Abhinav Bhatele

In this paper, we show how large language models (LLMs) can be applied to tasks specific to high performance and scientific codes.

Language Modelling

A Survey and Empirical Evaluation of Parallel Deep Learning Frameworks

no code implementations9 Nov 2021 Daniel Nichols, Siddharth Singh, Shu-Huai Lin, Abhinav Bhatele

This phenomenon has spurred the development of algorithms for distributed training of neural networks over a larger number of hardware accelerators.

Integrating Deep Learning in Domain Sciences at Exascale

no code implementations23 Nov 2020 Rick Archibald, Edmond Chow, Eduardo D'Azevedo, Jack Dongarra, Markus Eisenbach, Rocco Febbo, Florent Lopez, Daniel Nichols, Stanimire Tomov, Kwai Wong, Junqi Yin

This paper discusses the necessities of an HPC deep learning framework and how those needs can be provided (e. g., as in MagmaDNN) through a deep integration with existing HPC libraries, such as MAGMA and its modular memory management, MPI, CuBLAS, CuDNN, MKL, and HIP.

Management

Cannot find the paper you are looking for? You can Submit a new open access paper.