Fodev Jeong

GPT4๋ณด๋‹ค LoRA๋ฅผ ์ ์šฉํ•œ ๊ฒฐ๊ณผ๊ฐ€ ์ „๋ฐ˜์ ์œผ๋กœ ๋‚ซ๋”๋ผ?

GPT4๋ณด๋‹ค Gemma, llama2, mistral ๋“ฑ 10๊ฐœ์˜ ์ฃผ์š” ๋ชจ๋ธ์— LoRA๋ฅผ ์ ์šฉํ•œ ๊ฒฐ๊ณผ๊ฐ€ ์ „๋ฐ˜์ ์œผ๋กœ ๋‚ซ๋”๋ผ๋Š” ํ…Œํฌ๋‹ˆ์ปฌ๋ฆฌํฌํŠธ๊ฐ€ ๋ฐœํ‘œ๋˜์—ˆ์Šต๋‹ˆ๋‹ค. Predibase๋ผ๋Š” ํšŒ์‚ฌ์—์„œ 10๊ฐœ์˜ ๊ธฐ๋ณธ๋ชจ๋ธ์„ traditional NLP๋ถ€ํ„ฐ code generation, reasoning๊นŒ์ง€ 31๊ฐœ์˜ ์ž‘์—…์— ๋งž์ถ”์–ด LoRA๋ฅผ ์ ์šฉ์‹œํ‚จ ์ด 310๊ฐœ์˜ ๋ชจ๋ธ...

2024 Google I/O ๊ฐ์ƒํ‰

๐Ÿ“ ๊ตฌ๊ธ€ I/O 2024 ์š”์•ฝ ๋ฐ ๊ฐ์ƒ ๋‚ด์šฉ ์ •๋ฆฌ ๋ชจ๋ธ ์—…๋ฐ์ดํŠธ ๋‚ด์šฉ Gemini 1.5 Pro์˜ ์ปจํ…์ŠคํŠธ ์œˆ๋„์šฐ๊ฐ€ 2M๋กœ ํ™•์žฅ ๋น ๋ฅธ ๋ฒ„์ „์ธ Gemini 1.5 Flash ๋ฐœํ‘œ ์ œํ’ˆ ์—…๋ฐ์ดํŠธ ๋‚ด์šฉ Gemini๋ฅผ ๊ตฌ๊ธ€ ํฌํ† , ์ด๋ฏธ์ง€ ๊ฒ€์ƒ‰, ์›Œํฌ ์ŠคํŽ˜์ด์Šค, ๊ตฌ๊ธ€ ๋ฐ‹, ์ด๋ฉ”์ผ, ๊ฒ€์ƒ‰...

Deep Dive into Transformers by Hand

Original Article : ๐Ÿ‘‰ https://towardsdatascience.com/deep-dive-into-transformers-by-hand-%EF%B8%8E-68b8be4bd813 ChatGPT4o ํŠธ๋žœ์Šคํฌ๋จธ ๋ชจ๋ธ์— ๋Œ€ํ•œ ์„ค๋ช…์„ ์š”์•ฝํ•˜๋ฉด ๋‹ค์Œ๊ณผ ๊ฐ™์Šต๋‹ˆ๋‹ค: ํŠธ๋žœ์Šคํฌ๋จธ์˜ ์ฃผ์š” ๊ฐœ๋… ํŠธ๋žœ์Šคํฌ๋จธ ๋ชจ๋ธ์€ ๋‘ ๊ฐ€์ง€ ์ฃผ์š” ๊ฐœ๋…์ธ ์–ดํ…์…˜ ๊ฐ€์ค‘...

Deep Dive into Self-Attention by Hand

Original Article : ๐Ÿ‘‰ https://towardsdatascience.com/deep-dive-into-self-attention-by-hand-%EF%B8%8E-f02876e49857 ChatGPT4o ์…€ํ”„ ์–ดํ…์…˜ ๋ฉ”์ปค๋‹ˆ์ฆ˜ ์š”์•ฝ ์…€ํ”„ ์–ดํ…์…˜(Self-Attention)์€ ์ž…๋ ฅ ์‹œํ€€์Šค์˜ ๊ฐ ๋‹จ์–ด๊ฐ€ ๋‹ค๋ฅธ ๋ชจ๋“  ๋‹จ์–ด๋“ค๊ณผ์˜ ๊ด€๊ณ„๋ฅผ ํ‰...