Local LLMs, private AI tools, and self-hosted solutions
8 tools (filtered)
turboderp
Memory-efficient LLM inference
Faster and better ExLlama implementation
casper-hansen
AWQ quantization for efficient inference
ggerganov
Tensor library for ML on consumer hardware
Hugging Face
Parameter-efficient fine-tuning methods
Microsoft
Low-Rank Adaptation for fine-tuning
artidoro
Efficient fine-tuning of quantized LLMs
unslothai
2x faster LLM fine-tuning