Opportunity at
hims & hersSr. Staff Machine Learning Systems Engineer
Hims & Hers is searching for a Senior Staff machine learning engineer to make AI systems dependable enough for a heavily regulated healthcare setting. The engineer…
Career Tools
About This Role
Hims & Hers is searching for a Senior Staff machine learning engineer to make AI systems dependable enough for a heavily regulated healthcare setting. The engineer would own how models and their evaluations are built, versioned and judged before anything reaches patients, covering the data pipelines that feed them, the evaluation infrastructure and the reports used by clinical and product groups. This is a leadership role with wide technical reach.…
Job Description
Hims & Hers is searching for a Senior Staff machine learning engineer to make AI systems dependable enough for a heavily regulated healthcare setting. The engineer would own how models and their evaluations are built, versioned and judged before anything reaches patients, covering the data pipelines that feed them, the evaluation infrastructure and the reports used by clinical and product groups.
This is a leadership role with wide technical reach. The engineer would decide how metrics, LLM judges and scorers are built, choose the statistical logic behind regression decisions, and create systems that log and categorize failures over time. Other duties include designing ingestion, dataset versioning, labeling and calibration processes, and leading red-team testing aimed at safety problems and rare edge cases. Projects are expected to cut across teams and last several quarters, replacing hand-run reviews with automated release gates backed by documented methods.
Candidates need more than a decade across ML infrastructure, data engineering and evaluation work, plus a history of influencing people outside their own team. Fluent Python and enough statistical grounding to defend a testing framework are essential. The posting describes unfamiliar, cross-functional problems and expects the hire to coach experienced engineers. The company is a publicly traded health and wellness firm that delivers tailored care spanning diagnosis, treatment and product delivery.
Responsibilities
- Set direction for evaluation systems, including metric, judge and scorer design
- Establish the statistical methods that guide regression decisions
- Build and scale pipelines for ingestion, dataset versioning, labeling and calibration
- Create tracking that sorts and surfaces model failures over time
- Run red-team and adversarial test programs for safety and edge cases
- Replace inconsistent manual reviews with automated, statistically grounded gates
- Steer work that crosses teams and runs over several quarters
- Publish methods through talks and written guides for other teams
Requirements
- Over ten years building ML infrastructure, data pipelines, or evaluation and testing platforms, data engineering or evaluation and testing systems
- Hands-on work designing and calibrating LLM judges and scorers
- Ability to run regression testing with paired significance tests and multiple-comparison correction
- Experience measuring agreement between automated judges and human labels
- Proficient in Python, with enough statistics to defend the decisions you make
- A record of impact that goes beyond one project or team
Qualifications
- Familiarity with Databricks, MLflow and Unity Catalog, or similar evaluation platforms
- Tools built for non-engineers, such as automated digests or spreadsheet reports
- Previous experience in healthcare, fintech or life sciences
Core Skills
Benefits
- Base salary and equity for full-time employees
- Flexible time off, holidays plus quarterly mental health days
- Medical, dental and vision coverage and parental leave
- Employee share purchase plan
- Retirement plan with employer matching
- Team retreats held offsite
Frequently Asked Questions
Answers are based only on the employer’s listing; where it doesn’t say, neither do we.
Where is the job located?
The posting does not name a city or office. The listing marks the role as on-site.
What is the base salary?
The listing shows USD 240,000 to 265,000 per year, and the posting mentions equity for full-time roles.
How much experience is needed?
The posting asks for over a decade of work across ML infrastructure, data engineering and evaluation testing.
Is the job full-time?
Yes, the listing is for a full-time position.
Sample Interview Questions
AI-generated questions tailored to this specific role — a preview of the full practice set.