AI repos for Fine-tuning

Open-source AI projects built around Fine-tuning or genuinely useful if you work with it, each with what it does for you. 12 repos, most relevant first.

  1. minimind Runs pretraining, SFT and reinforcement learning stages you can read and rerun on one GPU. Models & local AI64.3k1.2k
  2. dive-into-llms Chinese notebooks and slides walk through fine-tuning LLMs with hands-on practice. Learning & resource lists57.2k1.7k
  3. transformers Fine-tune pretrained models using its consistent model and training APIs. Models & local AI168k
  4. LLMs-from-scratch Chapters and notebooks on finetuning a small GPT for classification and instruction following. Learning & resource lists107.1k
  5. Kronos Follow a fine-tuning pipeline to adapt small downloadable models to your own market data. Models & local AI43.2k3.4k
  6. reasoning-from-scratch Walks through GRPO reinforcement learning and distillation to add reasoning to a small model. Learning & resource lists5.4k
  7. GLiNER Includes training code to fine-tune the entity extraction model on your own labels. Models & local AI4.1k
  8. airllm Train large open models with small VRAM by keeping one layer on the GPU at a time. Models & local AI40.4k5.1k
  9. needle Includes fine-tuning and deployment support to adapt the small model to your own tools. Models & local AI14.2k1.3k
  10. ACE-Step-1.5 Train LoRAs to adapt the music model to a particular style. Image, video & audio13.9k
  11. GLM-5 Lists fine-tuning support so you can adapt the open-weights model yourself. Models & local AI7.4k106
  12. HyperQwen Includes a requantization pipeline that prepares the model for a single consumer GPU. Models & local AI2.2k

    ↑↓ to move, Enter to open, Esc to close