AI Tools
Home/Self-Hosted AI/OpenLLM

OpenLLM

by BentoML8.2k

Operating LLMs in production

View on GitHub

About

Operating LLMs in production Provides comprehensive functionality for seamless integration.

Installation

pip install openllm

Tags

productionservingbentoml

Details

Category
Self-Hosted AI
Added
Jul 14, 2024
GitHub Stars
8.2k
bentoml/openllm

Related Tools

vLLM

vLLM

18.0k

High-throughput LLM serving engine

servingperformanceinferenceFeatured

TGI

Hugging Face

7.5k

Hugging Face's LLM deployment solution

servinghuggingfaceinference

Vespa

Yahoo

4.5k

Big data serving engine for AI applications

vector-searchyahooserving
← Back to Self-Hosted AI