Easily Train a Specialized LLM: PEFT, LoRA, QLoRA, LLaMA-Adapter, and More

In this reference
A practical introduction to parameter-efficient fine-tuning methods, including LoRA and QLoRA.
Cite the original work
Cameron R. Wolfe, Ph.D.. Easily Train a Specialized LLM: PEFT, LoRA, QLoRA, LLaMA-Adapter, and More. cameronrwolfe.substack.com. https://cameronrwolfe.substack.com/p/easily-train-a-specialized-llm-peft
View BibTeX
@misc{easily_train_a_specialized_llm_peft_lora_qlora_llama_adapter_and_more,
author = {Cameron R. Wolfe, Ph.D.},
title = {{Easily Train a Specialized LLM: PEFT, LoRA, QLoRA, LLaMA-Adapter, and More}},
howpublished = {cameronrwolfe.substack.com},
url = {https://cameronrwolfe.substack.com/p/easily-train-a-specialized-llm-peft}
}
