All about transformer background knowledge including RNN

Step to explain Transformer

Dataset : https://github.com/NoCodeProgram/deepLearning/tree/main/rnn

RNN Studying Repository

Repository : https://github.com/akillness/SPTTC/tree/main/practice/myRNN

Contents of table

• RNN Intro
• RNN Implementation
• RNN Classification
• RNN Generation
• Word Embedding

Transformer Studying Repository

Repository : https://github.com/akillness/SPTTC/tree/main/practice/myTransformer

Contents of table

• Self-Attention
• Multi-Head Attention
• Layer Norm & Encoder
• Embedding Layer

Test Tokenizer according to Model : https://tiktokenizer.vercel.app/?model=gpt2

• Positional Encoding Layer
• Transformer Encoder

Explaining about Transformer by talker programming without code