vLLM
by vLLM18.0k
High-throughput LLM serving engine
About
High-throughput LLM serving engine Provides comprehensive functionality for seamless integration.
Installation
pip install vllmDetails
- Category
- Agent Tools
- Added
- Jun 10, 2024
- GitHub Stars
- 18.0k