Search Results for author:
Found 3 papers, 2 papers with code
Jetfire: Efficient and Accurate Transformer Pretraining with INT8 Data Flow and Per-Block Quantization
Moreover, for a standard transformer block, our method offers an end-to-end training speedup of 1. 42x and a 1. 49x memory reduction compared to the FP16 baseline.
T-Rex: Text-assisted Retrosynthesis Prediction
As a fundamental task in computational chemistry, retrosynthesis prediction aims to identify a set of reactants to synthesize a target molecule.
Training Transformers with 4-bit Integers
To achieve this, we carefully analyze the specific structures of activation and gradients in transformers to propose dedicated quantizers for them.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
