AI Tools
Home/Self-Hosted AI/ExLlamaV2

ExLlamaV2

by turboderp2.8k

Faster and better ExLlama implementation

View on GitHub

About

Faster and better ExLlama implementation Provides comprehensive functionality for seamless integration.

Installation

pip install exllamav2

Tags

localfastefficient

Details

Category
Self-Hosted AI
Added
Jul 20, 2024
GitHub Stars
2.8k
turboderp/exllamav2

Related Tools

PrivateGPT

imartinez

48.0k

Interact with documents using LLMs privately

privacydocumentslocalFeatured

LocalGPT

PromptEngineer

18.0k

Chat with documents on local device using LLMs

privacylocaldocuments

GPT4All

Nomic AI

62.0k

Open-source assistant-style large language models

localassistantopen-sourceFeatured
← Back to Self-Hosted AI