AI Tools
Home/Self-Hosted AI/GGML

GGML

by ggerganov9.2k

Tensor library for ML on consumer hardware

View on GitHub

About

Tensor library for ML on consumer hardware Provides comprehensive functionality for seamless integration.

Installation

git clone ggml

Tags

inferenceefficientc

Details

Category
Self-Hosted AI
Added
Jan 27, 2024
GitHub Stars
9.2k
ggerganov/ggml

Related Tools

Ollama

Ollama

52.0k

Run large language models locally

localinferenceeasyFeatured

vLLM

vLLM

18.0k

High-throughput LLM serving engine

servingperformanceinferenceFeatured

TGI

Hugging Face

7.5k

Hugging Face's LLM deployment solution

servinghuggingfaceinference
← Back to Self-Hosted AI