transformer 6
- DoLa Architecture: Decoding by Contrasting Layers for Factuality
- Building an End-to-End LLM from Scratch: Analyzing Karpathy's LLM101n Curriculum
- From Sequential RNNs to Transformers: Mathematics of Self-Attention and Scaled Encoders
- Meta CoPE Architecture: Contextual Position Encoding for Transformers
- Dual-Engine Mechanics of Transformers: Attention and Feedforward Layers
- Foundation Model Lexicon: Architectural, Alignment, and Serving Terminology