AI Tools
Home/Self-Hosted AI/AutoGPTQ

AutoGPTQ

by AutoGPTQ3.2k

Easy-to-use GPTQ quantization

View on GitHub

About

Easy-to-use GPTQ quantization Provides comprehensive functionality for seamless integration.

Installation

pip install auto-gptq

Tags

quantizationgptqeasy

Details

Category
Self-Hosted AI
Added
Jun 23, 2024
GitHub Stars
3.2k
autogptq/autogptq

Related Tools

Ollama

Ollama

52.0k

Run large language models locally

localinferenceeasyFeatured

Embedchain

Embedchain

8.5k

Framework to create ChatGPT-like bots

ragchatboteasy

Marqo

Marqo

4.2k

Tensor search for humans

vector-searchtensoreasy
← Back to Self-Hosted AI