Search Results for author: ZeZheng Li

Found 1 papers, 1 papers with code

BERT-LSH: Reducing Absolute Compute For Attention

1 code implementation12 Apr 2024 ZeZheng Li, Kingston Yip

This study introduces a novel BERT-LSH model that incorporates Locality Sensitive Hashing (LSH) to approximate the attention mechanism in the BERT architecture.

Computational Efficiency

Cannot find the paper you are looking for? You can Submit a new open access paper.