AI Tools
Home/Self-Hosted AI/CTranslate2

CTranslate2

by OpenNMT2.8k

Fast inference engine for Transformer models

View on GitHub

About

Fast inference engine for Transformer models Provides comprehensive functionality for seamless integration.

Installation

pip install ctranslate2

Tags

inferencefastoptimized

Details

Category
Self-Hosted AI
Added
Jan 16, 2024
GitHub Stars
2.8k
opennmt/ctranslate2

Related Tools

Ollama

Ollama

52.0k

Run large language models locally

localinferenceeasyFeatured

vLLM

vLLM

18.0k

High-throughput LLM serving engine

servingperformanceinferenceFeatured

TGI

Hugging Face

7.5k

Hugging Face's LLM deployment solution

servinghuggingfaceinference
← Back to Self-Hosted AI