Machine Learning Important Materials

ML Training/Inference

How to Scale Your Model: A Systems View of LLMs on TPUs

The Ultra-Scale Playbook: Training LLMs on GPU Clusters

Machine Learning Engineering Open Book

An open collection of methodologies, tools and step-by-step instructions to help with successful training and fine-tuning of large language models and multi-modal models and their inference.

TPU

tiny-tpu

A minimal tensor processing unit (TPU), inspired by Google's TPU V2 and V1.

LLM

The Illustrated Transformer

The Illustrated Stable Diffusion

nanochat

A full-stack implementation of an LLM like ChatGPT in a single, clean, minimal, hackable, dependency-lite codebase

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs.