AI Tools
Home/Self-Hosted AI/QLoRA

QLoRA

by artidoro9.2k

Efficient fine-tuning of quantized LLMs

View on GitHub

About

Efficient fine-tuning of quantized LLMs Provides comprehensive functionality for seamless integration.

Installation

pip install bitsandbytes

Tags

fine-tuningquantizedefficient

Details

Category
Self-Hosted AI
Added
Aug 26, 2024
GitHub Stars
9.2k
artidoro/qlora

Related Tools

llama.cpp

ggerganov

54.0k

Port of Facebook's LLaMA model in C/C++

localcppefficientFeatured

Mistral

Mistral AI

28.0k

Efficient open-source language models

mistralefficientopen-sourceFeatured

Mixtral

Mistral AI

8.5k

Mixture of experts model from Mistral

moemistralefficient
← Back to Self-Hosted AI