transformers 10
- MicroGPT Architecture: Pure Python Autograd and Transformer Foundations
- Prompt Repetition: Approximating Bidirectional Attention in Causal LLMs
- Depth Anything 3: Recovering 3D Visual Space via Unified Depth-Ray Transformers
- Mixture-of-Experts Architecture: From Sparse Routing to Fine-Grained LLaMA 4 Scaling
- VGGT: Visual Geometry Grounded Transformer for Feed-Forward 3D Reconstruction
- State Space Duality and Mamba-2: Unifying Transformers and Semiseparable Matrices
- From Word Embeddings to Attention: The Foundations of Transformer NLP Architectures
- Foundational AI Architectures: Mapping the Canonical Papers of Modern Deep Learning
- Self-Attention by Hand: Mathematical Mechanics of Scaled Dot-Product Attention
- Generative AI Architecture: Latent Representations, Diffusion, and Flow Matching