Lead AI Operations Engineer

About the role

Johnson & Johnson is seeking a Lead AI Operations Engineer to design, implement and continuously improve enterprise‑wide capabilities for operating AI applications and agents safely, reliably and cost‑effectively at scale.

Key responsibilities

• Design and implement end‑to‑end observability, telemetry and distributed tracing for AI workloads, including prompts, model calls, tool interactions and latency metrics.
• Define service‑level indicators, objectives, error budgets and operational readiness criteria for production AI services.
• Engineer reusable pipelines, templates and automated gates for LLMOps and AgentOps, supporting canary releases, feature flags and rollback mechanisms.
• Build transparent metering, allocation and show‑back capabilities to monitor token consumption, model utilization and infrastructure costs.
• Embed security, privacy, Responsible AI and compliance controls into the AI runtime, including role‑based access, secret management and audit logging.
• Define and operate processes for incident, problem, change and service‑recovery management, producing runbooks and automation to reduce MTTR.
• Act as the technical bridge between AI product teams, cloud infrastructure, data platforms, cybersecurity, privacy and risk stakeholders.

Required skills

• AI platform engineering
• Site Reliability Engineering (SRE)
• DevSecOps and security engineering
• LLMOps and AgentOps implementation
• FinOps and cost‑optimization for AI workloads
• Observability, monitoring and distributed tracing
• Cloud infrastructure and automation
• Compliance, privacy and Responsible AI controls