litgpt vs torchtune

LLM training and fine-tuning toolkits compared

litgpt and torchtune are Python projects for training and adapting large language models with inspectable workflows and configurations. litgpt spans pretraining, fine-tuning, evaluation, and deployment, while torchtune focuses on post-training workflows and is no longer actively maintained.

litgpttorchtune
LanguagePythonPython
LicenseApache-2.0BSD-3-Clause
Stars13.7k5.8k
Forks1.5k756
Last analyzedNov 11, 2026Oct 3, 2026

Key differences

  • litgpt includes from-scratch implementations and recipes for 20+ model families, while torchtune provides PyTorch implementations and configurations for models including Llama, Gemma, Mistral, Phi, and Qwen.
  • litgpt covers pretraining, continued pretraining, fine-tuning, evaluation, and serving; torchtune focuses on post-training methods such as supervised fine-tuning, preference optimization, and knowledge distillation.
  • litgpt documents HTTP inference serving and support for GPUs and TPUs; torchtune documents single-device, multi-device, and, for some recipes, multi-node training.
  • litgpt uses the Apache-2.0 license, while torchtune uses BSD-3-Clause.
  • litgpt is active, with recent commits and releases; torchtune development wound down in 2025 and is no longer actively maintained.

Choose litgpt if you…

  • need workflows spanning pretraining, fine-tuning, evaluation, and serving.
  • want from-scratch implementations and recipes across 20+ model families.
  • need documented TPU support or HTTP inference serving.
Read the litgpt analysis →

Choose torchtune if you…

  • want editable PyTorch recipes for post-training methods such as DPO or knowledge distillation.
  • need YAML configurations and model-specific training workflows.
  • are maintaining or studying an existing torchtune workflow and can plan for limited upstream support.
Read the torchtune analysis →

Compare the numbers side by side, or add more projects

This comparison is generated with AI from the OSRepos analyses of both projects. Always check each project's repository and documentation before choosing.