This repository contains a curated list of awesome open-source libraries for production large language models. 59 projects are selected with high standards. 📚LLM Data Preprocessing (6) 🤖LLM ...

Not sure if you chunked your data right to enable optimal context retrieval? Not sure which embedding model will work best for your data? Don’t worry, you’re not alone.. A RAG has several movi...

🌟 Reinforcement Learning with Human Feedback (RLHF) Link 👉 https://www.linkedin.com/pulse/reinforcement-learning-human-feedback-rlhf-shubham-prajapati-xsjsc/?trackingId=eAJHZpWFS8S0xZa%2B4Yz9%2...

Link 👉 https://www.llmwatch.com/p/a-historic-week-for-open-source-ai Researchers have found a way to make speculative decoding up to 2x faster by generating multiple hypotheses and merging t...

An interesting benchmark paper evaluated the long-context capabilities of standard LLMs in an English-Chinese setting. Link 👉 https://arxiv.org/pdf/2407.11963 💡 NeedleBench is a framework d...

It is extremely important to ensure Data Quality upstream of ML Training and Inference Pipelines, trying to do that in the pipelines will cause unavoidable failure when working at scale. Data Co...

If you want to 𝗹𝗲𝗮𝗿𝗻 in a 𝘀𝘁𝗿𝘂𝗰𝘁𝘂𝗿𝗲𝗱 𝘄𝗮𝘆 to 𝗯𝘂𝗶𝗹𝗱 𝗟𝗟𝗠 𝘀𝘆𝘀𝘁𝗲𝗺𝘀 using good 𝗟𝗟𝗠𝗢𝗽𝘀 principles… We want to announce that we just 𝗿𝗲𝗹𝗲𝗮𝘀𝗲𝗱 𝟴 𝗠𝗲𝗱𝗶𝘂𝗺 𝗹𝗲𝘀𝘀𝗼𝗻𝘀 for the 𝗛𝗮𝗻𝗱𝘀-𝗼𝗻 𝗟𝗟𝗠𝘀 𝗰𝗼𝘂𝗿𝘀𝗲 that will put ...

LLM2Vec paper 👉 https://mcgill-nlp.github.io/llm2vec/ Intruction LLM2Vec, a simple unsupervised approach that can transform any decoder-only LLM into a strong text encoder. LLM2Vec consists ...

Introducing Llama 3.1 Yesterday’s Llama 3.1 release marked a big milestone for LLM researchers and practitioners. Llama 3.1 405B is the biggest and most capable LLM with openly available LLMs. A...

Data analyst agent: get your data’s insights in the blink of an eye ✨ In this notebook we will make a data analyst agent: a Code agent armed with data analysis libraries, that can load and transfo...