AI Jobs in India — Remote AI Data Annotation Specialist
About The Role Rex.zone is hiring remote, full-time AI Data Annotation Specialists to support LLM training pipelines through high-quality data labeling, RLHF evaluation, prompt evaluation, and QA evaluation. You will work on multimodal datasets (text and image) and deliver rubric-aligned judgments that improve training data quality and model performance.
What You Will Do
- Execute data labeling and data annotation for NLP and computer vision datasets
- Perform RLHF-style preference comparisons and graded reward-model judgments
- Run prompt evaluation and response grading using detailed rubrics
- Complete QA evaluation audits, guideline compliance checks, and rework cycles
- Apply named entity recognition (NER), taxonomy tagging, and text classification
- Conduct content safety labeling (policy, harm, hate, self-harm, sexual content) with escalation workflows
- Document edge cases and contribute to annotation guidelines updates
- Report throughput, agreement rates, and error categories to improve production quality
What We Are Looking For
- Mid-Senior experience delivering high-precision labeling/evaluation work
- Strong written English and ability to follow complex rubrics
- Familiarity with LLM evaluation, RLHF concepts, and prompt evaluation methods
- Strong QA mindset: sampling, audits, disagreement analysis, and root-cause analysis
- Comfort working remotely with asynchronous communication and versioned guidelines
Compensation $30–$50 per hour (base salary, hourly). Final compensation depends on scope and evaluation complexity. How To Apply Apply via Rex.zone and share relevant labeling, evaluation, and QA experience.