Technology · LLMs → Fine-tuning · Open Source · wiki:deep
LlamaFactory
LlamaFactory is a unified efficient fine-tuning toolkit for 100+ LLMs and VLMs (LoRA/QLoRA and related methods). It is a practical model-factory companion to Axolotl/Unsloth. Use when the OS needs domain-adapted models (estimating language, invoice fields) and you want one harness across many base models. Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024). In this catalog, LlamaFactory is treated as a first-class stack choice: read the primary sources and evidence table before wiring it into a corridor, and prefer measured fit over fashion when peers cover the same job.
Why it matters here
In this catalog it is the Fine-tuning option when you need to adapt base weights to domain data. Keep LlamaFactory on the observe/propose side of the loop: useful signals and drafts, with human or policy authority still required before anything irreversible runs.
How it works
LlamaFactory is a unified fine-tuning toolkit for 100+ LLMs/VLMs (LoRA/QLoRA and related).
- Pick model + method in the factory UI/CLI.
- Train on curated datasets.
- Store adapters/checkpoints.
- Export for inference servers.
Related: axolotl · unsloth · topics/04-data
When to reach for it
- Use when: LlamaFactory is a unified efficient fine-tuning toolkit for 100+ LLMs and VLMs (LoRA/QLoRA and related methods) matches the bottleneck and you specifically need to adapt base weights to domain data.
- Skip when: another pack already covers the need with less ops surface, or LlamaFactory would become a second place people retype truth.
- Prefer instead: compare Axolotl, Unsloth before locking the cell.
Limits
- Ops: confirm license, hosting, and release cadence for LlamaFactory (hiyouga/LlamaFactory) before relying on it in a live corridor.
- Integration: bad credentials, scopes, or schema drift produce empty retrievals or runaway tool/model spend without an obvious UI alarm.
- Scope: Fine-tuning components support agents; they are not the company ledger or the approval authority.
What we checked
Claims below are backed by science sources on disk.
Founding / research paper
LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models · STRONG
“We present LlamaFactory, a unified framework that integrates a suite of cutting-edge efficient training methods.”
Primary / product role
LlamaFactory docs · MODERATE
“Easy and Efficient Fine-tuning of Large Language Models.”
Docs or contrast
hiyouga/LlamaFactory · MODERATE
“Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)”
Additional source
Unsloth contrast · MODERATE
“hiyouga/LLaMA-Factory — Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)”
Research inventory
9 tags · 6 out · 7 in · 3 artifacts · 1 gaps · 12 corpus docs
Catalog tags
- landscape.layer
- LLMs
- landscape.subcategory
- Fine-tuning
- license_tag
- Open Source
- maps.dm
- absent
- maps.features
- 4
- one_liner
- Fine-tuning
- review.depth
- science
- slug
- llamafactory
- title
- LlamaFactory
Artifacts
- dm_map · absent
- features_map · present · technologies/llamafactory/features.md
- readme · present · technologies/llamafactory/README.md
Out · alternative_to
Out · maps_to
- bring-your-own-modelfeature
- learning-adaptationfeature
- model-flexibility-routingfeature
- r2-08-self-learningfeature
In · alternative_to
In · in_stack
- llms-fine-tuningstack · alternative_slot
In · maps_to
- bring-your-own-modelfeature
- learning-adaptationfeature
- model-flexibility-routingfeature
- r2-08-self-learningfeature
Corpus tags
- category
- LLMs → Fine-tuning
- dedication
- open-source
- feature
- bring-your-own-modellearning-adaptationmodel-flexibility-routingr2-08-self-learning
- kind
- map_edgetech_featurestech_quotetech_readme
- needs_deepen
- false
- quality
- ok
- slug
- llamafactory
- source_id
- llamafactory-docsllamafactory-githubunsloth-contrast
- technology
- llamafactory
Corpus documents (12)
map_edge · 4
- llamafactory → bring-your-own-model
- llamafactory → learning-adaptation
- llamafactory → model-flexibility-routing
- llamafactory → r2-08-self-learning
tech_features · 1
- LlamaFactory · features
tech_quote · 6
- LlamaFactory · llamafactory-docs
- LlamaFactory · llamafactory-docs
- LlamaFactory · llamafactory-github
- LlamaFactory · llamafactory-github
- LlamaFactory · unsloth-contrast
- LlamaFactory · unsloth-contrast
tech_readme · 1
- LlamaFactory