AI Tools
Home/Open Source AI/The Pile

The Pile

by EleutherAI3.2k

Large-scale diverse text dataset

View on GitHub

About

Large-scale diverse text dataset Provides comprehensive functionality for seamless integration.

Installation

pip install the-pile

Tags

datasetstexttraining

Details

Category
Open Source AI
Added
Feb 16, 2024
GitHub Stars
3.2k
eleutherai/the-pile

Related Tools

AgentTuning

THUDM

1.2k

Generalized agent abilities via instruction tuning

tuningtrainingresearch

CLIP

OpenAI

22.0k

OpenAI's image-text model

visiontextmultimodalFeatured

Accelerate

Hugging Face

6.8k

Easy distributed training and inference

distributedtraininghuggingface
← Back to Open Source AI