Opportunity at
DialpadSr. Software Development Engineer in Test (Agentic)
Dialpad operates as an AI platform specializing in real-time customer experience solutions across voice and digital channels. The company is currently seeking a Sr. Software Development…
Career Tools
About This Role
Dialpad operates as an AI platform specializing in real-time customer experience solutions across voice and digital channels. The company is currently seeking a Sr. Software Development Engineer in Test (Agentic) to take charge of test automation and quality frameworks supporting AI Voice Agent services. This position suits an experienced software engineer who wants to focus on agentic AI quality assurance, developing automated tests spanning frontend user interfaces, backend services, APIs,…
Job Description
Dialpad operates as an AI platform specializing in real-time customer experience solutions across voice and digital channels. The company is currently seeking a Sr. Software Development Engineer in Test (Agentic) to take charge of test automation and quality frameworks supporting AI Voice Agent services.
This position suits an experienced software engineer who wants to focus on agentic AI quality assurance, developing automated tests spanning frontend user interfaces, backend services, APIs, and audio or text interactions. The engineer will design automation tooling for LLM-driven systems, build evaluation frameworks for response accuracy, and integrate quality checks into continuous integration pipelines.
The role requires operating from one of Dialpad’s Canadian offices, reporting to a QA Engineering Manager located in the United States. Professionals joining the team will collaborate with applied AI groups on prompt engineering and model selection while helping safeguard against hallucinations, bias, and safety risks.
Responsibilities
- Manage end-to-end quality for agentic features, including strategy, creation, execution, and release qualification
- Design and construct automation tooling and frameworks for AI and LLM-driven systems
- Create and maintain evaluation frameworks to track response accuracy, quality, and hallucination rates
- Drive automation coverage past eighty percent for critical AI workflows using deterministic and probabilistic methods
- Incorporate AI quality checks into CI/CD pipelines to achieve fast feedback loops
- Build tools for LLM observability, debugging, prompt tracing, and response analysis
- Collaborate with Applied AI teams on prompt engineering, model selection, and evaluation strategies
- Design and run performance and load tests measuring latency, throughput, and cost efficiency
- Identify and reduce risks associated with hallucinations, bias, safety, and edge cases
- Define and monitor AI quality key performance indicators
- Take part in design and architecture reviews to promote testability, observability, and resilience
- Mentor fellow engineers and elevate AI quality engineering standards
Requirements
- Minimum of 6 years of experience in software engineering or SDET roles focused on software development
- Strong programming proficiency in Python, Java, or JavaScript
- Experience testing distributed, cloud-native SaaS systems and APIs
- Demonstrated skill in coding with AI agents to accelerate development and enhance code quality
- Hands-on exposure to LLMs or AI/ML systems such as OpenAI, Claude, or Gemini
- Familiarity with non-deterministic systems and probabilistic testing approaches
- Experience building test frameworks and scalable automation systems
- Knowledge of AI evaluation techniques including benchmarking and golden datasets
- Working experience with CI/CD pipelines like Jenkins or GitHub Actions
- Strong collaboration skills for working across distributed teams and time zones
Qualifications
- Bachelor’s degree in Computer Science or equivalent practical experience
- Familiarity with backend technologies such as Python, Go, Google Cloud Platform, Cloud Run, App Engine, Kubernetes, Datastore, Redis, and ElasticSearch
- Familiarity with frontend technologies including Vue3 and React
- Experience with the AI stack including LLM APIs, LiveKit, prompt orchestration frameworks, and evaluation tooling
Core Skills
Benefits
- Competitive salary
- Comprehensive benefits
- Real opportunities for professional growth
- Cutting-edge AI tools and a robust training program
Frequently Asked Questions
Answers are based only on the employer’s listing; where it doesn’t say, neither do we.
Where is this position located?
This position is based at one of Dialpad’s Canadian offices.
What is the remote work policy?
The source posting states that this position is on-site at a Canadian office, and does not mention remote work options.
What is the employment type?
The posting specifies full-time employment.
What is the salary range for this role?
For exceptional talent based in Ontario, Canada, the target base salary range is $151,000 to $175,000 CAD, excluding bonuses, equity, or benefits.
Who does this role report to?
The role reports to a QA Engineering Manager located in the United States.
Sample Interview Questions
AI-generated questions tailored to this specific role — a preview of the full practice set.