Opportunity at
ServiceNowStaff Software Engineer
ServiceNow is hiring a Staff Software Engineer to join its team in Hyderabad for a full-time position. This role focuses on cloud-native and AI-native software development,…
Career Tools
About This Role
ServiceNow is hiring a Staff Software Engineer to join its team in Hyderabad for a full-time position. This role focuses on cloud-native and AI-native software development, leveraging large language models, agents, and retrieval systems. The successful candidate will maintain complete code ownership through testing, deployment, evaluation, and validation. Responsibilities include designing technical specifications, building evaluation harnesses for AI features, resolving code and model issues, and ensuring adherence to secure coding…
Job Description
ServiceNow is hiring a Staff Software Engineer to join its team in Hyderabad for a full-time position. This role focuses on cloud-native and AI-native software development, leveraging large language models, agents, and retrieval systems. The successful candidate will maintain complete code ownership through testing, deployment, evaluation, and validation. Responsibilities include designing technical specifications, building evaluation harnesses for AI features, resolving code and model issues, and ensuring adherence to secure coding practices. The position also requires leading a team of software and AI engineers, handling mentorship, code reviews, performance evaluations, and goal setting, alongside cross-functional collaboration with product management and domain specialists.
Responsibilities
- Develop AI-native software solutions and create technical specifications for model selection, data architecture, and agent design
- Build evaluation harnesses and analyze automated tests to check accuracy, regressions, and hallucinations in AI features
- Troubleshoot code and model behavior issues while implementing secure coding practices and prompt-injection defenses
- Monitor production model performance and drift to maintain software updates for customers
- Manage daily tasks for individual contributors, conduct performance reviews, and set quarterly goals
- Mentor and coach software and AI engineers through detailed code reviews and structured feedback
- Partner with cross-functional groups including product management and engineering to build scalable AI applications
- Deliver progress updates and presentations to stakeholders regarding AI capabilities and system trade-offs
Requirements
- 8 to 12 years of practical experience with Java
- 2 years of experience with prompt engineering and prompt or agent scripting
- 2 years of hands-on experience integrating third-party AI and machine learning services and platform APIs
- Proficiency in Python, Java, and JavaScript, with strong Python skills tailored for the machine learning ecosystem
- Experience with RESTful and streaming APIs, model inference endpoints, web services, and integration technologies
- Familiarity with cloud computing and managed AI services like AWS Bedrock, SageMaker, Azure OpenAI, and Google Vertex AI
- Experience developing unit tests and AI evaluation harnesses for code and applications
- Background in Agile and Scrum development methodologies
Qualifications
- Bachelor's degree in computer science or a related field
- Coursework or experience in machine learning and artificial intelligence
- Ability to design and manage domain-specific languages, prompt templates, and agent instruction frameworks
- Experience building and optimizing microservices for data and embedding pipelines handling up to 10 million rows
- Knowledge of LLM orchestration and retrieval frameworks such as LangChain and LlamaIndex
- Familiarity with vector databases including Pinecone, Weaviate, and pgvector
- Experience working with Spring Boot or comparable frameworks
- Familiarity with Kubernetes, containerization, and serving inference or GPU workloads
Core Skills
Frequently Asked Questions
Answers are based only on the employer’s listing; where it doesn’t say, neither do we.
What is the location and work model for this role?
The position is located in Hyderabad. ServiceNow applies flexible work personas based on work nature and distance to the closest office, but the posting does not specify a fully remote or hybrid designation for this specific role.
What is the employment type?
This is a full-time position.
What salary is offered for this position?
The salary is not stated in the job posting.
What are the primary experience requirements?
Candidates must have 8 to 12 years of practical Java experience, 2 years of prompt engineering and scripting experience, and 2 years of experience integrating third-party AI and machine learning services and platform APIs.
Sample Interview Questions
AI-generated questions tailored to this specific role — a preview of the full practice set.