EFloat: Entropy-coded Floating Point Format for Compressing Vector Embedding Models

no code implementations • NeurIPS 2021 • Rajesh Bordawekar, Bulent Abali, Ming-Hung Chen

EFloat uses entropy coding on exponent values and signs to minimize the average width of the exponent and sign fields, while preserving the original FP32 exponent range unchanged.

Data Compression