Local LLMs, private AI tools, and self-hosted solutions
2 tools (filtered)
casper-hansen
AWQ quantization for efficient inference
AutoGPTQ
Easy-to-use GPTQ quantization