#

transformer-decoder-model

Here are 4 public repositories matching this topic...

huawei-csl / top-theta-attention

[Accepted to ICANN'26] Top-θ Attention replaces Top-k for sparse attention, requiring x3 less V-cache reads, faster generative decoding for LLMs.

sparsity ai attention kv-cache transformer-decoder-model

Updated Jun 4, 2026
Jupyter Notebook

Aditya-1276 / Transformer-Decoder-for-Language-Translation

python language-translation keras-tensorflow transformer-decoder-model

Updated Aug 9, 2024
Jupyter Notebook

Djasingh / Tranformer_Model

Neural Network, Backpropagation, and Transformer Decoder

neural-networks derivatives gardient-descent masked-attention positional-encoding- transformer-decoder-model

Updated Mar 19, 2024
Jupyter Notebook

Pavansomisetty21 / Attention-is-All-You-Need-The-Transformer-architecture

In this we explore detailed architecture of Transformer

transformer gpt attention-mechanism attention-is-all-you-need transformer-encoder transformer-architecture transformer-decoder transformer-decoder-model transformer-encoders

Updated Jan 3, 2025
Jupyter Notebook

Add this topic to your repo

To associate your repository with the transformer-decoder-model topic, visit your repo's landing page and select "manage topics."