squeezebert

SqueezeBERT is a transformer-based model designed for mobile devices. It optimizes the standard transformer architecture for speed and memory efficiency while maintaining competitive performance on NLP tasks.