Skip to content
TeichAI

Open distillation lab

Frontier reasoning, distilled into models you can run at home.

We capture reasoning and agent traces from 37 frontier models across 12 labs, fine-tune open bases like Qwen and Gemma on them, and publish everything: the weights, the GGUF quants, and the datasets themselves.

  • Apache-2.0 weights
  • GGUF for llama.cpp & Ollama
  • Trained with Unsloth
  • Traces generated with teich
Org telemetry · live from Hugging Facesynced 22:42 UTC

All-time downloads

2.2M

85,178 in the last 30 days

Model releases

66

121 repositories

Datasets

54

reasoning, agent & chat traces

Frontier teachers

37

from 12 labs

GGUF quants shipped

457

59 releases

Followers on HF

1.5K

Likes

3.7K

Distilled from

37 frontier teachers

DeepSeek V3.2 Speciale6 models · 3 datasetsClaude Opus7 models · 1 datasetClaude Opus 4.56 models · 1 datasetGemini 3 Pro5 models · 2 datasetsClaude Fable 54 models · 1 datasetClaude Sonnet 4.54 models · 1 datasetGemini 3 Flash1 model · 4 datasetsGPT-5 Codex3 models · 2 datasetsGPT-5.24 models · 1 datasetKimi K2 Thinking3 models · 2 datasetsMiniMax M2.12 models · 3 datasetsClaude Haiku 4.52 models · 2 datasetsGemini 2.5 Flash3 models · 1 datasetClaude Opus 4.62 models · 1 datasetGemini 2.5 Flash Lite2 models · 1 datasetGLM 4.62 models · 1 datasetHunter Alpha3 datasetsPolaris Alpha2 models · 1 datasetSherlock Alpha3 datasetsGLM 4.72 datasetsGPT-5.11 model · 1 datasetGPT-5.1 Codex Max1 model · 1 datasetGrok 4 Fast1 model · 1 datasetMiMo V2 Flash1 model · 1 datasetMistral Small1 model · 1 datasetOx Alpha2 datasetsPony Alpha1 model · 1 datasetAurora Alpha1 dataset

The distillation matrix

Every base we have trained, against every lab we have learned from.

Rows are open-weight base families, columns are the labs whose frontier models taught them. Hover a cell to see the releases, click to open them in the catalog.

Number of model releases per open-weight base family (rows) and teacher lab (columns)
Base ↓ · Teacher lab →AnthropicGoogleOpenAIDeepSeekMoonshotStealthMiniMaxZ.aiCohereMistralxAIXiaomiTotal
Qwen391184322111143
Gemma 455
gpt-oss1113
Qwen3.533
Qwen3.633
Nemotron Cascade22
Devstral Small11
GLM 4.7 Flash11
LFM2.511
MiniMax M2.711
Mistral 7B11
Nemotron Orchestrator11
Qwen3.811
Total2611963322111166

How a distill is made

From frontier trace to local GGUF in four steps.

The whole pipeline is open. The datasets are on Hugging Face, the tooling is on PyPI, and the recipes are in the model cards.

  1. 01

    Curate prompts

    Coding, math, science and open-ended tasks. For agent traces we point real repositories at the teacher and let it work.

    prompts.jsonl

  2. 02

    Generate traces

    Frontier models answer with maximum reasoning effort. Thinking, tool calls and results are captured with teich and published as a dataset.

    teich generate

  3. 03

    Fine-tune an open base

    Qwen, Gemma, GLM, gpt-oss and friends are trained with Unsloth. Response-only masking keeps the loss on what the teacher actually said.

    mask_data()

  4. 04

    Quantize and ship

    Safetensors plus imatrix GGUF from Q2 to Q8, vision projectors when the base sees images, and an Ollama Modelfile. Apache-2.0.

    llama-server -hf

Open-source tooling

teich — the toolkit behind every dataset here.

Generate agent and chat traces, extract sessions from Claude Code, Codex, Cursor, Pi and Hermes, normalize them into training-ready rows, and mask the loss so you only train on what the teacher actually said. Same pipeline we use, one pip install away.

PyPI
v0.3.6
GitHub stars
148
Datasets made
4+
bash
$ pip install teich$ teich init my-project && cd my-project$ teich generate -c config.yaml✓ 4,006 traces → output/   tools.json · dataset card · sandbox snapshots$ teich extract claude --model fable-5✓ anonymized 244 sessions → data/   upload to Hugging Face? (y/N)$ 

Built in public

Come hang out, request a distill, or keep the lights on.

Support the lab

Every coffee turns into API credits and GPU hours.

We are a small team paying for frontier-model generation and training runs out of pocket. A single high-reasoning dataset can cost more than a month of rent in tokens. If our models save you time, consider chipping in, or drop a distill request in the Discord and tell us what to build next.