Open Source AI

Platform for sharing ML models and datasets

Hugging Face datasets library

Open repository of web crawl data

Large-scale diverse text dataset

Large-scale image-text datasets

Open reproduction of LLaMA training data

AI2's open corpus for training LLMs

Hugging Face's 15T token web dataset

Open-source assistant training data

Instruction-following dataset from Stanford

Evolved instruction dataset for LLMs

Shared ChatGPT conversations dataset

Large-scale real-world LLM conversations