huggingface/datasets
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
Ranks #253 of 2,841 repositories GStars tracks this week (top 9%).
2 releases in the last 90 days, the latest 3 days ago, with 446 contributors on GitHub.
Use Cases & Benefits
- Provides a lightweight Python library to load, preprocess, and stream a vast collection of public and local datasets for AI and machine learning.
- Enables fast, efficient, and reproducible data manipulation with one-line dataset loading and multi-format, multi-framework interoperability.
- Use for quickly accessing and preparing diverse datasets for training and evaluating NLP, vision, audio, and multimodal AI models.
- Use for streaming large datasets on-the-fly without local storage constraints, ideal for handling internet-scale or disk-limited data.
- Use for integrating custom or local datasets in various formats into ML workflows with seamless conversion to popular frameworks like PyTorch and TensorFlow.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
Apache 2.0
Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.
Community files
- README: present
- Contributing guide: present
- Code of conduct: present
Watch-outs
No watch-outs from GStars' checks.
General guidance from repository metadata, not legal advice. How we score
About datasets
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
https://huggingface.co/docs/datasetsDaily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
+140 stars over 34 days across 6 snapshot days; best day +24 on Sep 7.
Forks
3.5K+116
Open issues
1.5K+113
Compared with peers in AI
Fastest-growing repositories GStars tracks in this cohort for the week of Oct 4, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| ifixai-ai/iFixAi | 30.7K | +4.2K | 75 | 5 days ago |
| heygen-com/hyperframes | 70.0K | +4.0K | 45 | today |
| calesthio/OpenMontage | 70.9K | +3.8K | 75 | — |
| thedotmack/claude-mem | 102.3K | +3.7K | 75 | 2 days ago |
| rohitg00/ai-engineering-from-scratch | 72.5K | +3.5K | 75 | 3 days ago |
| huggingface/datasets | 22.0K | +0 | 75 | 3 days ago |
| Category median | 70.9K | +3.8K | 75 | — |
Also by huggingface
Other repositories from this maintainer that GStars tracks
- Python167.6K stars
transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- Python37.2K stars
pytorch-image-models
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
- Python34.7K stars
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
- Python28.0K stars
lerobot
🤗 LeRobot: Making AI for Robotics more accessible with end-to-end learning
- Rust21.2K stars
candle
Minimalist ML framework for Rust
Discover Repositories
Search across tracked repositories by name or description