LLM/Model & Papers
All about transformer background knowledge including RNN
Explaining about Transformer by talker programming without cod...
Step to explain Transformer
Dataset : https://github.com/NoCodeProgram/deepLearning/tree/main/rnn
RNN Studying Repository
Repository : https://github.com/akillness/SPTTC/tree/main/practice/myRNN
Contents of table
- RNN Intro
- RNN Implementation
- RNN Classification
- RNN Generation
- Word Embedding
Transformer Studying Repository
Repository : https://github.com/akillness/SPTTC/tree/main/practice/myTransformer
Contents of table
- Self-Attention
- Multi-Head Attention
- Layer Norm & Encoder
- Embedding Layer
Test Tokenizer according to Model : https://tiktokenizer.vercel.app/?model=gpt2
- Positional Encoding Layer
- Transformer Encoder
Explaining about Transformer by talker programming without code
This post is licensed under CC BY 4.0 by the author.