Senior Manager, Data Quality & Evaluation

About the role

This senior position is based in Italy and leads the quality foundation for advanced AI data programs. You will design evaluation frameworks, set quality standards, and drive operational processes that ensure reliable, scalable human‑data workflows for next‑generation intelligent systems.

Key responsibilities

• Design and manage quality frameworks, standards, acceptance criteria, review processes and performance metrics for AI data and evaluation programs.
• Translate customer requirements into scalable workflows covering data collection, annotation, evaluation, calibration and reporting.
• Identify quality risks early and work with delivery teams to resolve issues affecting timelines or outcomes.
• Build repeatable processes for calibration, QA sampling, adjudication, reviewer performance tracking and customer reporting.
• Lead quality operations across multilingual evaluation, speech/audio review, transcription, annotation, human‑preference evaluation, expert review, coding evaluation and AI model assessment.
• Develop rubrics, task instructions, reviewer guidelines, golden datasets, scorecards and reporting templates.
• Monitor quality indicators such as reviewer agreement, error trends and root‑cause analysis, turning insights into actionable improvements.
• Partner with internal teams to embed quality success from planning through production delivery.
• Coach and develop Quality Managers, Leads, Specialists and reviewers, fostering a culture of ownership and continuous improvement.

Required profile

• 5+ years of experience in quality operations, data operations or AI data programs.
• Proven ability to design and implement quality frameworks at scale.
• Strong analytical and problem‑solving skills with a focus on operational excellence.
• Experience leading cross‑functional teams and collaborating with customers.
• Excellent communication skills and ability to translate complex requirements into practical solutions.

Required skills