self-attention 4
- From Sequential RNNs to Transformers: Mathematics of Self-Attention and Scaled Encoders
- From Word Embeddings to Attention: The Foundations of Transformer NLP Architectures
- Dual-Engine Mechanics of Transformers: Attention and Feedforward Layers
- Self-Attention by Hand: Mathematical Mechanics of Scaled Dot-Product Attention