LLM/Model & Papers
Little know gem the Open-source Cookbook
Curiosity: Where can we find practical examples for building AI applications with open-source tools? What makes the Hugging Face Cookbook valuable?
Hugging Face Cookbook: Little-Known Gem for Practical AI
Curiosity: Where can we find practical examples for building AI applications with open-source tools? What makes the Hugging Face Cookbook valuable?
Hugging Face Cookbook is a collection of notebooks for building practical AI applications using open-source tools and models.
Repository: https://github.com/huggingface/cookbook Documentation: https://huggingface.co/learn/cookbook/index
Cookbook Overview
Retrieve: Understanding the cookbook structure.
Content: Currently contains 16 notebooks in English and Chinese.
Complete Notebook List
Retrieve: All 16 notebooks.
- Using LLM-as-a-judge ๐งโโ๏ธ for an automated and versatile evaluation
- Create a legal preference dataset
- Suggestions for Data Annotation with SetFit in Zero-shot Text Classification
- Implementing semantic cache to improve a RAG system
- Building A RAG Ebook โLibrarianโ Using LlamaIndex
- Stable Diffusion Interpolation
- Building A RAG System with Gemma, MongoDB and Open Source Models
- Prompt Tuning with PEFT Library
- Migrating from OpenAI to Open LLMs Using TGIโs Messages API
- Automatic Embeddings with TEI through Inference Endpoints
- Simple RAG for GitHub issues using Hugging Face Zephyr and LangChain
- Embedding multimodal data for similarity search using ๐ค transformers, ๐ค datasets and FAISS
- Fine-tuning a Code LLM on Custom Code on a single GPU
- RAG Evaluation Using Synthetic data and LLM-As-A-Judge
- Advanced RAG on HuggingFace documentation using LangChain
- Detecting Issues in a Text Dataset with Cleanlab
Translate to Korean
๊ฑฐ์ ์๋ ค์ง์ง ์์ ๋ณด์ : ์คํ ์์ค ์๋ฆฌ ์ฑ
์คํ ์์ค ๋๊ตฌ ๋ฐ ๋ชจ๋ธ์ ์ฌ์ฉํ์ฌ ์ค์ฉ์ ์ธ AI ์ ํ๋ฆฌ์ผ์ด์ ์ ๊ตฌ์ถํ๊ธฐ ์ํ ๋ ธํธ๋ถ ๋ชจ์: https://github.com/huggingface/cookbook
๋ฌธ์: https://huggingface.co/learn/cookbook/index
ํ์ฌ ์์ด์ ์ค๊ตญ์ด๋ก ๋ 16๊ฐ์ ๋ ธํธ๋ถ์ด ํฌํจ๋์ด ์์ต๋๋ค.
- ์๋ํ๋ ๋ค๋ชฉ์ ํ๊ฐ๋ฅผ ์ํด LLM-as-a-judge ๐ง โ๏ธ ์ฌ์ฉ
- ๋ฒ์ ์ ํธ๋ ๋ฐ์ดํฐ ์ธํธ ๋ง๋ค๊ธฐ
- Zero-shot ํ ์คํธ ๋ถ๋ฅ์์ SetFit์ ์ฌ์ฉํ ๋ฐ์ดํฐ ์ฃผ์์ ๋ํ ์ ์
- RAG ์์คํ ๊ฐ์ ์ ์ํ ์๋งจํฑ ์บ์ ๊ตฌํ
- LlamaIndex๋ฅผ ์ฌ์ฉํ์ฌ RAG ์ ์์ฑ โLibrarianโ ๊ตฌ์ถ
- ์์ ๋์ด ์๋ ์ ํฌ ๋ณด์ฝ๋ฒ
- Gemma, MongoDB ๋ฐ ์คํ ์์ค ๋ชจ๋ธ์ ์ฌ์ฉํ RAG ์์คํ ๊ตฌ์ถ
- PEFT ๋ผ์ด๋ธ๋ฌ๋ฆฌ๋ฅผ ์ฌ์ฉํ ํ๋กฌํํธ ํ๋
- TGI์ Messages API๋ฅผ ์ฌ์ฉํ์ฌ OpenAI์์ ๊ฐ๋ฐฉํ LLM์ผ๋ก ๋ง์ด๊ทธ๋ ์ด์
- ์ถ๋ก ์๋ํฌ์ธํธ๋ฅผ ํตํ TEI๋ฅผ ์ฌ์ฉํ ์๋ ์๋ฒ ๋ฉ
- Hugging Face Zephyr ๋ฐ LangChain์ ์ฌ์ฉํ GitHub ๋ฌธ์ ์ ๋ํ ๊ฐ๋จํ RAG
- ํธ๋์คํฌ๋จธ, ๐ค ๋ฐ์ดํฐ ์ธํธ ๋ฐ FAISS๋ฅผ ์ฌ์ฉํ ๐ค ์ ์ฌ์ฑ ๊ฒ์์ ์ํ ๋ค์ค ๋ชจ๋ ๋ฐ์ดํฐ ํฌํจ
- ๋จ์ผ GPU์ ์ฌ์ฉ์ ์ง์ ์ฝ๋์์ ์ฝ๋ LLM ๋ฏธ์ธ ์กฐ์
- ํฉ์ฑ ๋ฐ์ดํฐ ๋ฐ LLM-As-A-Judge๋ฅผ ์ฌ์ฉํ RAG ํ๊ฐ
- LangChain์ ์ฌ์ฉํ HuggingFace ๋ฌธ์์ ๊ณ ๊ธ RAG
- Cleanlab์ ์ฌ์ฉํ์ฌ ํ ์คํธ ๋ฐ์ดํฐ ์ธํธ์์ ๋ฌธ์ ๊ฐ์ง