AI Tools
Home/Self-Hosted AI/Llama.cpp Server

Llama.cpp Server

by ggerganov54.0k

HTTP server for llama.cpp inference

View on GitHub

About

HTTP server for llama.cpp inference Provides comprehensive functionality for seamless integration.

Installation

./server -m model.gguf

Tags

localserverapi

Details

Category
Self-Hosted AI
Added
Apr 9, 2024
GitHub Stars
54.0k
ggerganov/llama.cpp

Related Tools

Twitter MCP Server

Community

2.6k

Twitter/X API integration for posts and analysis

twittersocialapi

PrivateGPT

imartinez

48.0k

Interact with documents using LLMs privately

privacydocumentslocalFeatured

LocalGPT

PromptEngineer

18.0k

Chat with documents on local device using LLMs

privacylocaldocuments
← Back to Self-Hosted AI