Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
In this reference
A guide to 4-bit model loading and QLoRA with bitsandbytes.
Cite the original work
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA. Hugging Face. https://huggingface.co/blog/4bit-transformers-bitsandbytes
View BibTeX
@misc{making_llms_even_more_accessible_with_bitsandbytes_4_bit_quantization_and_qlora,
title = {{Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA}},
howpublished = {Hugging Face},
url = {https://huggingface.co/blog/4bit-transformers-bitsandbytes}
}
