Technology · LLMs → Fine-tuning · Open Source · wiki:deep

Axolotl

Axolotl is a popular open toolkit for fine-tuning LLMs with YAML configs covering LoRA, QLoRA, full FT, and many model families. Operationalizes domain specialization. Relevant when prompting alone cannot meet estimating/ops language needs. Go ahead and axolotl questions - 2026/08: - New model support has been added in Axolotl for Ling 3.0, Muse Glimmer, North Micro Vision Instruct and Shieldstral. - 2026/07: - NVFP4 (4-bit) MoE LoRA training is now supported via ScatterMoE (W4A16) and SonicMoE (W4A4), including adapter merge back into a plain NVFP4 checkpoint. - 2026/06: - Expert Parallelism (EP) for distributed MoE training via DeepEP, remote training through Tinker-compatible APIs, Context Parallelism for hybrid SSM models (Nemotron-H, Falcon-H1, Bamba), BitNet 1.58-bit fine-tuning, and a multimodal assistant-only loss-masking fix. - 2026/04: - New model support.

Why it matters here

In this catalog it is the Fine-tuning option when you need to adapt base weights to domain data. Keep Axolotl on the observe/propose side of the loop: useful signals and drafts, with human or policy authority still required before anything irreversible runs.

How it works

Axolotl fine-tunes LLMs from YAML configs (LoRA/QLoRA/full) across many model families.

  1. Author a training YAML (model, data, method).
  2. Launch training; checkpoints write to disk.
  3. Evaluate against held-out metrics.
  4. Export adapters/weights for serving.

Related: unsloth · llamafactory · vllm · topics/04-data

Flow

When to reach for it

  • Use when: Axolotl is a popular open toolkit for fine-tuning LLMs with YAML configs covering LoRA, QLoRA, full FT, and many model families matches the bottleneck and you specifically need to adapt base weights to domain data.
  • Skip when: another pack already covers the need with less ops surface, or Axolotl would become a second place people retype truth.
  • Prefer instead: compare Unsloth, LlamaFactory, vLLM before locking the cell.

Limits

  • Ops: confirm license, hosting, and release cadence for Axolotl (axolotl-ai-cloud/axolotl) before relying on it in a live corridor.
  • Integration: bad credentials, scopes, or schema drift produce empty retrievals or runaway tool/model spend without an obvious UI alarm.
  • Scope: Fine-tuning components support agents; they are not the company ledger or the approval authority.

What we checked

Claims below are backed by science sources on disk.

Primary / product role

axolotl-ai-cloud/axolotl · MODERATE

“Axolotl is a popular open toolkit for fine-tuning LLMs with YAML configs covering LoRA, QLoRA, full FT, and many model families. Operationalizes domain specialization.”

Docs or contrast

LlamaFactory contrast · MODERATE

“hiyouga/LLaMA-Factory — Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)”

Additional source

Unsloth contrast · MODERATE

“Easy and Efficient Fine-tuning of Large Language Models.”
Research inventory

9 tags · 6 out · 7 in · 3 artifacts · 1 gaps · 14 corpus docs

Catalog tags

landscape.layer
LLMs
landscape.subcategory
Fine-tuning
license_tag
Open Source
maps.dm
absent
maps.features
4
one_liner
LLMs
review.depth
science
slug
axolotl
title
Axolotl

Artifacts

  • dm_map · absent
  • features_map · present · technologies/axolotl/features.md
  • readme · present · technologies/axolotl/README.md

Out · alternative_to

Out · maps_to

In · alternative_to

In · in_stack

In · maps_to

Corpus tags

category
LLMs → Fine-tuning
dedication
open-source
feature
bring-your-own-model
learning-adaptation
model-flexibility-routing
r2-08-self-learning
kind
map_edge
tech_features
tech_quote
tech_readme
needs_deepen
false
quality
ok
slug
axolotl
source_id
axolotl-github
llamafactory-contrast
unsloth-contrast
technology
axolotl

Corpus documents (14)

map_edge · 4

  • axolotl → bring-your-own-model
  • axolotl → learning-adaptation
  • axolotl → model-flexibility-routing
  • axolotl → r2-08-self-learning

tech_features · 1

  • Axolotl · features

tech_quote · 8

  • Axolotl · axolotl-github
  • Axolotl · axolotl-github
  • Axolotl · axolotl-github
  • Axolotl · llamafactory-contrast
  • Axolotl · llamafactory-contrast
  • Axolotl · llamafactory-contrast
  • Axolotl · unsloth-contrast
  • Axolotl · unsloth-contrast

tech_readme · 1

  • Axolotl