This job has expired and is no longer accepting applications.
Remote opportunity at
Rad AISenior Test Automation Engineer
Rad AI builds artificial intelligence solutions designed to revolutionize radiology by saving time, reducing burnout, and improving patient care. The company's generative AI technologies are utilized…
Career Tools
About this role
Senior Test Automation Engineer at Rad AI is a full-time role. Work arrangement: Remote. Location: Applicants in United States only. No salary is shown in this listing. It was posted on Nov 4, 2026. This listing is paused and not taking applications at the moment.
Job Description
Rad AI builds artificial intelligence solutions designed to revolutionize radiology by saving time, reducing burnout, and improving patient care. The company's generative AI technologies are utilized daily by thousands of radiologists, supporting numerous healthcare systems and medical imaging facilities throughout the United States. To support this mission, Rad AI is seeking a Senior Test Automation Engineer to own the test automation strategy for a specific product domain.
In this position, the engineer will function as the primary quality and automation expert for their assigned domain. Responsibilities include shaping test automation strategies, building scalable testing frameworks that allow engineers to write their own tests, conducting pre-release risk assessments, and validating software against real-world radiologist workflows and customer-matched environments. The role also involves driving down test flakiness, addressing non-functional quality aspects such as performance and compliance, evaluating non-deterministic AI outputs, and turning defect incidents into preventative measures. The ideal candidate possesses strong programming capabilities, extensive automation framework experience, and a shift-left testing mentality that empowers developers to own quality.
Responsibilities
- Own the test automation strategy, framework design, and release risk assessments for an assigned product domain
- Build scalable, maintainable testing utilities and frameworks that enable software engineers to author their own tests
- Establish test matrices across various integrations, environments, and customer workflows to determine go/no-go release signals
- Validate software using customer-matched environments, realistic radiologist personas, and exploratory testing
- Minimize test flakiness, reduce suite execution times, and triage failures alongside platform teams
- Lead or co-lead non-functional testing initiatives covering performance, load, security checks, and HIPAA compliance
- Design evaluation methods for non-deterministic AI outputs such as speech recognition and generated impressions
- Analyze escaped defects and incident reviews to introduce new regression coverage and update risk profiles
- Track quality metrics including test stability, time to detect, and escaped defects within a test case management system
- Mentor software engineers and test automation engineers while collaborating closely with engineering leadership
Requirements
- Six or more years of software engineering or test automation experience
- At least three years of experience designing and owning automation frameworks
- Strong programming proficiency in TypeScript and/or Python
- Working experience with object-oriented languages such as C# or Java
- Extensive background with end-to-end testing frameworks like Playwright, Selenium, or Cypress
- Practical API testing experience across REST and GraphQL services, including handling data interactions and downstream dependencies
- Hands-on experience building tests into CI/CD pipelines such as GitHub Actions or CircleCI
- Demonstrated ability to reduce test flakiness and suite runtime using data-driven methods
- Experience implementing risk-based test strategies for integration-heavy systems across customer configurations
- Strong debugging capabilities across data, services, and environments with working knowledge of SQL, logs, and observability tools
- Demonstrated shift-left mindset focused on helping developers own their tests
- Practical use of AI tools for writing, maintaining, and triaging tests with proper output validation
Qualifications
- Experience working in healthcare or other regulated environments such as HIPAA, PHI, or SOC 2, ideally within a startup setting
- Familiarity with radiology systems including PACS, RIS, dictation platforms like PowerScribe or Fluency, HL7/FHIR, FHIRcast, or DICOM
- Experience automating Windows desktop or Electron applications using tools such as WinAppDriver or UI Automation
- Background testing machine learning, artificial intelligence, or speech systems featuring non-deterministic outputs
- Prior ownership of performance testing, load testing, or pipeline security integrations
- Experience working with cloud platforms like AWS or Google Cloud and provisioning test environments via Docker or Terraform
- Familiarity with test case management systems like Testmo or quality dashboard creation tools such as Grafana
Core Skills
Benefits
- Comprehensive Medical, Dental, Vision, and Life insurance
- Health Savings Account with employer match, Flexible Spending Account, and Dependent Care Flexible Spending Account
- 401(k) plan
- 11 paid company holidays
- Flexible paid time off policy
- Annual company-wide offsite events
- Periodic team offsite gatherings
- Annual equipment stipend
Frequently Asked Questions
Answers are based only on the employer’s listing; where it doesn’t say, neither do we.
Is this position remote?
Yes, this role is listed as United States - Remote and is open to candidates located anywhere in the United States.
What is the employment type for this role?
This is a full-time position.
What is the salary for this position?
The salary is not stated in the source posting.
What technical skills are required?
Candidates must have 6+ years of software engineering or test automation experience, 3+ years designing automation frameworks, strong programming skills in TypeScript and/or Python, and deep experience with end-to-end frameworks like Playwright, Selenium, or Cypress.
Sample Interview Questions
AI-generated questions tailored to this specific role — a preview of the full practice set.
Explore more jobs like this
What to do next
This listing is no longer open, so the quickest next step is one of the live roles above. Save the ones that fit, and check the employer's other openings on its company page. To hear about new matches as they are posted, set up a job alert from your candidate account.