Search Results for author:
Found 5 papers, 2 papers with code
Is the GPU Half-Empty or Half-Full? Practical Scheduling Techniques for LLMs
In this work, we survey scheduling techniques from the literature and from practical serving systems.
MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining
Here, we introduce MosaicBERT, a BERT-style encoder architecture and training recipe that is empirically optimized for fast pretraining.
Low-Precision Hardware Architectures Meet Recommendation Model Inference at Scale
We share in this paper our search strategies to adapt reference recommendation models to low-precision hardware, our optimization of low-precision compute kernels, and the design and development of tool chain so as to maintain our models' accuracy throughout their lifespan during which topic trends and users' interests inevitably evolve.
FBGEMM: Enabling High-Performance Low-Precision Deep Learning Inference
Deep learning models typically use single-precision (FP32) floating point data types for representing activations and weights, but a slew of recent research work has shown that computations with reduced-precision data types (FP16, 16-bit integers, 8-bit integers or even 4- or 2-bit integers) are enough to achieve same accuracy as FP32 and are much more efficient.
Deep Learning Inference in Facebook Data Centers: Characterization, Performance Optimizations and Hardware Implications
The application of deep learning techniques resulted in remarkable improvement of machine learning models.
