Mining Massive Datasets

Mining Massive Datasets

April 1, 2023

Data Downloading

Data Preprocessing

Data Postprocessing

Data Deduplication

Open Source Datasets

C4

MC4

Refined Web

Red Pajama

Slim Pajama

OSCAR

Roots

NLLB

Pile

Massive Dataset

Dolma Dataset