详细内容
Amplitude | HumanSignal
We acquired Erud AI to form HumanSignal Services. Read the blog post.\
→
Virtual EventEverything we shipped in 2025 & what's next →
Open Source Data Labeling Platform
The most flexible data labeling platform to fine-tune LLMs, prepare training data, or evaluate AI models.
Last Commit: November 30, 2025
Latest version: 1.21.0
Quick Start
# Install the package
# into python virtual environment
pip install -U label-studio# Launch it!label-studio
GenAI
LLM Fine-Tuning
Label data for supervised fine-tuning or refine models using RLHF
LLM Evaluations
Response moderation, grading, and side-by-side comparison
RAG Evaluation
Use Ragas scores and human feedback
Flexible and configurable
Configurable layouts and templates adapt to your dataset and workflow.
Integrate with your ML/AI pipeline
Webhooks, Python SDK and API allow you to authenticate, create projects, import tasks, manage model predictions, and more.
ML-assisted labeling
Save time by using predictions to assist your labeling process with ML backend integration.
Connect your cloud storage
Connect to cloud object storage and label data there directly with S3 and GCP.
Explore & understand your data
Prepare and manage your dataset in our Data Manager using advanced filters.
Multiple projects and users
Support multiple projects, use cases and data types in one platform.
From the Blog
HumanSignal acquires Erud AI to build the world’s frontier data lab
AI has outgrown the open web. HumanSignal Services is creating multimodal data from scratch for frontier AI labs, with Label Studio as the backbone.
Michael Malyuk
November 5, 2025
Generative AI Templates for Reinforcement Learning with Verifiable Rewards
Label Studio turns human judgments into structured rewards with ready-made and custom templates, so you can collect preference data and fine-tune models such as a math tutor bot for better answers
Label Studio Team
October 9, 2025
The Last Mile of AI: Agent Evaluation with Domain Experts
Observability shows what happened; domain experts explain why, and their structured reviews turn raw traces into targeted fixes that finally close the last mile.
Nikolai Liubimov
October 9, 2025
Trusted by companies large and small
\
\
\
\
\
\