1 code implementation • 21 Nov 2022 • Michael Kuchnik, Virginia Smith, George Amvrosiadis
Although large language models (LLMs) have been touted for their ability to generate natural-sounding text, there are growing concerns around possible negative effects of LLMs such as data memorization, bias, and inappropriate language.
2 code implementations • 7 Nov 2021 • Michael Kuchnik, Ana Klimovic, Jiri Simsa, Virginia Smith, George Amvrosiadis
Our analysis of over two million ML jobs in Google datacenters reveals that a significant fraction of model training jobs could benefit from faster input data pipelines.
1 code implementation • 1 Nov 2019 • Michael Kuchnik, George Amvrosiadis, Virginia Smith
Deep learning accelerators efficiently train over vast and growing amounts of data, placing a newfound burden on commodity networks and storage devices.