AI Tools
Home/Self-Hosted AI/Petals

Petals

by BigScience8.5k

Run LLMs at home across multiple machines

View on GitHub

About

Run LLMs at home across multiple machines Provides comprehensive functionality for seamless integration.

Installation

pip install petals

Tags

distributedinferencecollaborative

Details

Category
Self-Hosted AI
Added
Jul 7, 2024
GitHub Stars
8.5k
bigscience-workshop/petals

Related Tools

Ollama

Ollama

52.0k

Run large language models locally

localinferenceeasyFeatured

vLLM

vLLM

18.0k

High-throughput LLM serving engine

servingperformanceinferenceFeatured

TGI

Hugging Face

7.5k

Hugging Face's LLM deployment solution

servinghuggingfaceinference
← Back to Self-Hosted AI