The Ultra-Scale Playbook
🌌
3.87k
The ultimate guide to training LLM on large GPU Clusters
📝 Research & Long-Form Blog Posts
In-depth technical articles and research pieces published by Hugging Face
-
-
The Smol Training Playbook
📚3.2kThe secrets to building world-class LLMs
-
Evaluation Guidebook
📝325Explore LLM benchmark scores over time
-
FineVision: Open Data is All You Need
📝225A new open-source dataset for training VLMs
-
Maintain the unmaintainable
📚81Explore the complex relationships between 400+ machine learning models
-
FineWeb: decanting the web for the finest text data at scale
🍷1.35kExplore and download the FineWeb web‑scale text dataset
-
The Eiffel Tower Llama
📝117Explore the Eiffel Tower Llama experiment with open-source models
-
Porting nanochat to Transformers: an AI modeling history lesson
📝49Learn about ML and Transformers through nanochat
-
FinePDFs: Liberating 3T of the finest tokens from PDFs
📄74 -
Can LLMs Play the Game of Science?
📝28Explore LLM science benchmark scores
-
QED-Nano: Teaching a Tiny Model to Prove Hard Theorems
📝74Who needs 1T parameters? Olympiad proofs with a 4B model
-
Distilling 100B+ Models 40x Faster with TRL
📝85TRL distillation for 100B+ teachers, 40x faster
-
Extracting Signal from the Noise
📝12Explore PR categories with an interactive particle visualization
-
The ultimate guide to RL environments: building and scaling them in the LLM era
📝177Building and scaling RL environments for LLM training
-
physics-intern: an Autonomous Agent for Physics Research
📝49Explore an autonomous AI workflow for physics research
-
The Synthetic Data Playbook: Generating Trillions of the Finest Tokens
📝244Explore synthetic data experiments on an interactive bookshelf
-
Token-In, Token-Out Done Right
🧩4Interact with a live reaction‑diffusion visual simulation
-
Defeating the trainer-generator precision mismatch in TRL
🎯18Download research PDF (Pro access required)