list of efficient attention modules
My take on a practical implementation of Linformer for Pytorch.
Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)
Vision Xformers
iStructTab: Structured Feature Sequencing for Multimodal Image-Tabular Learning with GEDS and OEMT.
iSyncTab learns synchronized cross-modal feature sequences for image-tabular and audio-video multimodal learning using neural synchrony, NS-PFS, and an order-aware Transformer.
linformer implementation and comparison with vanilla transformers
Lumenspark is a lightweight Linformer-based Language Model Trained from Scratch
To associate your repository with the linformer topic, visit your repo's landing page and select "manage topics."