Opportunity at
DeepgramSoftware Test Engineer
Deepgram operates a voice AI platform offering real-time speech-to-text and text-to-speech APIs, and it also offers software that customers can run themselves or on their own…
Career Tools
About This Role
Deepgram operates a voice AI platform offering real-time speech-to-text and text-to-speech APIs, and it also offers software that customers can run themselves or on their own premises. Its developer community is large, and customers include Twilio and Cloudflare. The company is hiring a Software Test Engineer to strengthen quality across its products and data systems. The engineer plans, builds and maintains automated frameworks and exploratory suites covering products, models, APIs,…
Job Description
Deepgram operates a voice AI platform offering real-time speech-to-text and text-to-speech APIs, and it also offers software that customers can run themselves or on their own premises. Its developer community is large, and customers include Twilio and Cloudflare. The company is hiring a Software Test Engineer to strengthen quality across its products and data systems.
The engineer plans, builds and maintains automated frameworks and exploratory suites covering products, models, APIs, SDKs and data platforms. Coverage spans feature checks, integration work, end-to-end flows, regression runs, API tests, browser checks and load tests for both batch and streaming pipelines, plus datasets built from realistic, adversarial and edge-case inputs.
The job converts product specs and model benchmarks into automated regression checks, evaluation pipelines, data-quality gates and release rules. It includes validating speech and other AI outputs, creating dashboards that make quality trends visible, wiring checks into CI/CD systems, running staging and production validation, and supporting customer acceptance testing. Every defect report must give precise steps, inputs and evidence.
Candidates should hold a bachelor's, master's or doctoral degree in computer science, artificial intelligence, applied mathematics or a related area, or have equivalent practical experience, and bring five-plus years of building software or QA systems that included building test infrastructure or evaluation tools. Strong coding in Python, Rust, Go or a comparable language is needed, along with the ability to tell real regressions from statistical noise. Nice-to-have skills include testing LLMs, retrieval pipelines or agents, voice metrics such as word error rate and latency, mobile test tooling, and cloud or container environments. The company expects an AI-forward work style. No salary or benefits details are included.
Responsibilities
- Write test plans for products, APIs, SDKs, model-driven features and data platforms
- Build automated suites covering service-level behavior, browser flows, APIs and regression sweeps
- Translate requirements and acceptance criteria into test strategies and release gates
- Design realistic and adversarial test datasets and environments
- Assess speech-to-text and text-to-speech behavior with metrics, expected outputs and human review
- Build harnesses, result pipelines and quality dashboards
- Embed quality checks and canary tests in CI/CD
- Check ingestion, labeling and quality-control pipelines for accuracy and leakage
Requirements
- BS, MS or PhD in a technical field, or equivalent experience
- Five or more years in professional software or QA engineering with test infrastructure or evaluation systems
- Practical scripting or backend skill in Python, Rust, Go or similar
- Experience designing evaluation frameworks, data-processing systems or test pipelines that run automatically
- Analytical reasoning about metrics, thresholds and variation
- Ability to tackle unclear technical problems and communicate across teams
Qualifications
- Testing language models, retrieval-augmented systems, agents or multimodal systems
- Voice, audio or real-time systems experience with WER, MOS, latency or time to first byte
- Building evaluation or benchmarking tools used by several teams
- Test tooling for React Native or other cross-platform apps
- Containers, ephemeral environments, Grafana and anomaly detection
- Open-source contributions or maintenance
Core Skills
Frequently Asked Questions
Answers are based only on the employer’s listing; where it doesn’t say, neither do we.
What experience is required?
The posting asks for five-plus years building software or QA systems, including test infrastructure or evaluation systems.
What programming languages are needed?
The posting asks for solid backend or scripting skills in languages like Python, Rust or Go.
Is a salary listed?
The posting does not state a salary figure.
Are benefits listed?
The posting does not list specific benefits.
Sample Interview Questions
AI-generated questions tailored to this specific role — a preview of the full practice set.