AI Tools
Home/Self-Hosted AI/GGUF

GGUF

by ggerganov4.2k

File format for LLM weights

View on GitHub

About

File format for LLM weights Provides comprehensive functionality for seamless integration.

Installation

pip install gguf

Tags

formatweightsllama

Details

Category
Self-Hosted AI
Added
Feb 23, 2024
GitHub Stars
4.2k
ggerganov/ggml

Related Tools

Turbopilot

ravenscroftj

3.8k

Self-hosted Copilot clone using llama.cpp

copilotself-hostedllama

Ollama

Ollama

52.0k

Run LLMs locally with ease

localeasyinferenceFeatured

LocalAI

mudler

18.0k

Self-hosted OpenAI alternative

localopenai-compatibleapiFeatured
← Back to Self-Hosted AI