Opportunity at
ServiceNowStaff Technical Product Manager – AI/LLM expertise + AI Evaluation Science
This full-time, on-site Staff Technical Product Manager role at ServiceNow in Hyderabad leads AI evaluation as a core engineering capability across the DT organisation. The role…
Career Tools
About This Role
This full-time, on-site Staff Technical Product Manager role at ServiceNow in Hyderabad leads AI evaluation as a core engineering capability across the DT organisation. The role has two parts: working with AI platform and product teams to adopt out-of-the-box evaluations, and defining custom metrics, rubrics and datasets for enterprise AI applications and agentic workflows. It suits a technically strong product manager with more than ten years of product experience focused…
Job Description
This full-time, on-site Staff Technical Product Manager role at ServiceNow in Hyderabad leads AI evaluation as a core engineering capability across the DT organisation. The role has two parts: working with AI platform and product teams to adopt out-of-the-box evaluations, and defining custom metrics, rubrics and datasets for enterprise AI applications and agentic workflows.
It suits a technically strong product manager with more than ten years of product experience focused on AI, who can influence engineers and platform teams without direct authority.
Responsibilities
- Drive adoption of platform evaluations and feed enterprise needs into the platform roadmap
- Define custom evaluations, metrics, rubrics and datasets for agents and multi-step workflows
- Establish evaluation-driven development with quality gates across the AI lifecycle
- Enable continuous evaluation in production and set quality thresholds for releases
Requirements
- Ten or more years of product management experience with a focus on AI
- A technical background combining AI and LLM expertise, evaluation science and quality engineering
- Experience with LLM-as-a-Judge, rubrics, evaluation datasets and agent evaluation
Qualifications
- Experience with AI observability, CI/CD and developer platforms
- ServiceNow AI platform experience is a strong plus
Frequently Asked Questions
Answers are based only on the employer’s listing; where it doesn’t say, neither do we.
Where is the job?
The listing places the role in Hyderabad, India, as on-site work.
What experience is needed?
The posting asks for ten or more years of product management experience with a focus on AI.
Is ServiceNow platform experience needed?
It is listed as a strong plus rather than a requirement.
Sample Interview Questions
AI-generated questions tailored to this specific role — a preview of the full practice set.