Merlin: Enabling Machine Learning-Ready HPC Ensembles

5 Dec 2019J. Luc PetersonRushil AnirudhKevin AtheyBenjamin BayPeer-Timo BremerVic CastilloFrancesco Di NataleDavid FoxJim A. GaffneyDavid HysomSam Ade JacobsBhavya KailkhuraJoe KoningBogdan KustowskiSteven LangerPeter RobinsonJessica SemlerBrian SpearsJayaraman ThiagarajanBrian Van EssenJae-Seung Yeom

With the growing complexity of computational and experimental facilities, many scientific researchers are turning to machine learning (ML) techniques to analyze large scale ensemble data. With complexities such as multi-component workflows, heterogeneous machine architectures, parallel file systems, and batch scheduling, care must be taken to facilitate this analysis in a high performance computing (HPC) environment... (read more)

PDF Abstract

Code


No code implementations yet. Submit your code now

Tasks


Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.