GPTCache

Name: GPTCache
Rating: 3.1 (6200 reviews)
Author: Zilliz

by Zilliz6.2k

Semantic cache for LLM queries

About

Semantic cache for LLM queries Provides comprehensive functionality for seamless integration.

pip install gptcache

Community

Redis cache and data store integration

Stanford NLP

Framework for algorithmically optimizing LM prompts

OpenAI

Fast BPE tokenizer for OpenAI models