AI Trainer – Generalist (Remote Contractor)

About the role

AuraOne is seeking remote AI Trainer – Generalist contractors to evaluate AI model outputs against a versioned quality rubric. You will compare paired responses, label edge cases, and provide structured feedback that helps the modeling team improve future training runs.

Key responsibilities

• Evaluate AI trainer generalist model outputs using a detailed rubric and assign severity tags.
• Compare paired responses, select the stronger answer, and write a clear rationale.
• Label hallucinations, instruction‑following failures, and unsafe content with structured tags.
• Identify ambiguous prompts and route them for rubric updates.
• Maintain reviewer quality scores by calibrating against gold‑standard examples weekly.
• Document recurring failure modes for targeted model retraining.

Required profile

• Prior experience in evaluation, annotation, or human‑rater work on AI trainer or similar content.
• Comfort applying multi‑page rubrics consistently across large batches.
• Strong written reasoning that cites specific rubric clauses.
• High attention to detail and ability to flag problematic prompts.
• Reliable asynchronous availability of at least 10 hours per week.

Required skills

• Model output evaluation
• Rubric‑based annotation
• Severity tagging
• Inter‑rater calibration
• AI model evaluation

What we offer

• Compensation at $30 per hour.
• Remote‑first contractor work with flexible task volume.
• Opportunity to influence AI model quality and safety.