huggingface/text-embeddings-inference
A blazing fast inference solution for text embeddings models
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
1 release in the last 90 days, the latest 51 days ago, with 82 contributors on GitHub.
Use Cases & Benefits
- Provides a high-performance Rust-based server for deploying and serving text embeddings and sequence classification models.
- Delivers blazing fast inference with optimized transformer code, dynamic batching, and GPU acceleration for efficient text embedding extraction.
- Use for deploying scalable embedding models in production environments requiring low-latency text vectorization.
- Use for integrating re-ranker models to improve retrieval accuracy in retrieval-augmented generation (RAG) pipelines.
- Use for running sequence classification tasks like sentiment analysis or emotion detection with supported transformer models.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
Apache 2.0
Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.
Community files
- README: present
- Contributing guide: present
- Code of conduct: present
Watch-outs
No watch-outs from GStars' checks.
General guidance from repository metadata, not legal advice. How we score
From the README
A blazing fast inference solution for text embeddings models.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
Forks
450+28
Open issues
192-12
Compared with peers in AI
Fastest-growing repositories GStars tracks in this cohort for the week of Nov 1, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| thedotmack/claude-mem | 113.6K | +8.8K | 35 | today |
| D4Vinci/Scrapling | 98.1K | +6.9K | 65 | 1 day ago |
| Leonxlnx/taste-skill | 110.7K | +5.2K | 55 | 1 day ago |
| calesthio/OpenMontage | 77.2K | +4.2K | 40 | — |
| heygen-com/hyperframes | 79.6K | +4.1K | 45 | today |
| huggingface/text-embeddings-inference | 5.1K | — | 62 | 51 days ago |
| Category median | 98.1K | +5.2K | 45 | — |
Also by huggingface
Other repositories from this maintainer that GStars tracks
- Python168.6K stars
transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- Python37.3K stars
pytorch-image-models
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
- Python34.8K stars
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
- Python28.7K stars
lerobot
🤗 LeRobot: Making AI for Robotics more accessible with end-to-end learning
- Python22.1K stars
datasets
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
Discover Repositories
Search across tracked repositories by name or description