AI Tools
Home/Self-Hosted AI/ExLlama

ExLlama

by turboderp3.2k

Memory-efficient LLM inference

View on GitHub

About

Memory-efficient LLM inference Provides comprehensive functionality for seamless integration.

Installation

pip install exllamav2

Tags

localefficientexl2

Details

Category
Self-Hosted AI
Added
Aug 14, 2024
GitHub Stars
3.2k
turboderp/exllama

Related Tools

PrivateGPT

imartinez

48.0k

Interact with documents using LLMs privately

privacydocumentslocalFeatured

LocalGPT

PromptEngineer

18.0k

Chat with documents on local device using LLMs

privacylocaldocuments

GPT4All

Nomic AI

62.0k

Open-source assistant-style large language models

localassistantopen-sourceFeatured
← Back to Self-Hosted AI