huggingface/datatrove
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
Python
3.1k
273
65 contributors
Apache License 2.0
Trendshift snapshots GitHub's daily Trending list and runs its own trending list. The dynamic badges below mark the best position this repository has reached on each platform. They refresh automatically as its position climbs
GitHub Trending
huggingface/datatrove has been featured on GitHub Trending, first reaching #15 on May 7, 2024
Trendshift Trending
huggingface/datatrove has trended on Trendshift's daily and weekly list
Daily
First achieved on 20th, Jan 2024 for Python
First achieved on 20th, Jan 2024 across all languages