AI Tools
Home/Self-Hosted AI/TGI

TGI

by Hugging Face7.5k

Text Generation Inference from Hugging Face

View on GitHub

About

Text Generation Inference from Hugging Face Provides comprehensive functionality for seamless integration.

Installation

docker pull ghcr.io/huggingface/text-generation-inference

Tags

servinghuggingfaceproduction

Details

Category
Self-Hosted AI
Added
Sep 8, 2024
GitHub Stars
7.5k
huggingface/text-generation-inference

Related Tools

Hugging Face MCP

Community

3.6k

Hugging Face models and datasets access

huggingfacemlmodels

vLLM

vLLM

18.0k

High-throughput LLM serving engine

servingperformanceinferenceFeatured

TGI

Hugging Face

7.5k

Hugging Face's LLM deployment solution

servinghuggingfaceinference
← Back to Self-Hosted AI