Opportunity at
CanvaEngineering Manager - (ML) - Evaluation Platform
Canva is hiring an Engineering Manager to lead its Evaluation Platform team inside the AI Platform Group, which supplies infrastructure and tools for AI features across…
Career Tools
About This Role
Canva is hiring an Engineering Manager to lead its Evaluation Platform team inside the AI Platform Group, which supplies infrastructure and tools for AI features across the business. The job is full-time and on-site, and the listing does not name a city. The team handles the whole evaluation life cycle: test-style evaluations that live in developer workflows, the Arena head-to-head comparison service, monitoring evaluations drawn from live traffic, and human…
Job Description
Canva is hiring an Engineering Manager to lead its Evaluation Platform team inside the AI Platform Group, which supplies infrastructure and tools for AI features across the business. The job is full-time and on-site, and the listing does not name a city. The team handles the whole evaluation life cycle: test-style evaluations that live in developer workflows, the Arena head-to-head comparison service, monitoring evaluations drawn from live traffic, and human labelling tools.
The manager guides a senior group of nine or more engineers through a stage of consolidation and expansion, while supporting each person toward their own objectives. Duties include setting the team's direction, merging evaluation tools into a coherent self-service platform, anticipating evaluation requirements alongside AI product squads and CORE senior staff, and coordinating with neighbouring platform groups for Inference, Datasets and Training. The manager runs large cross-team projects, establishes team routines, planning cycles and success measures, encourages knowledge sharing, and handles hiring and staffing.
Ideal candidates have led technical teams, preferably including senior and staff individual contributors, and have worked on generative model evaluation, LLM-based systems or ML infrastructure. The job calls for designing complicated distributed systems, negotiating scope with competing customer teams, and making bold calls from first principles. A blend of technical depth and people leadership is needed, plus strong written and spoken communication. Generative AI evaluation changes month to month, so continuous learning is expected. Interviews are online.
Responsibilities
- Mentor and develop a team of nine or more engineers, most of them senior
- Shape and evolve the evaluation platform direction, merging test-style evals, Arena, monitoring evals and labelling tools
- Anticipate evaluation requirements alongside AI product squads and CORE senior staff
- Align with the Inference, Datasets and Training groups, plus the evals programme manager
- Deliver large initiatives that span teams and groups
- Set development practices, planning rhythm, stand-ups and retrospectives
- Establish goals and success metrics that line up across company, group and team
- Encourage knowledge sharing and argue for evaluation and ML engineering priorities
- Manage hiring and resourcing for the roadmap
Requirements
- Record of leading people and mentoring engineers, including senior and staff ICs
- Hands-on background in generative model evaluation, LLM-based systems or platform work for ML
- Background designing complex distributed systems, ideally with machine learning
- Strong stakeholder management amid competing priorities
- First-principles reasoning and willingness to make bold decisions
- Balance of technical and people leadership
- Solid problem solving and the ability to deliver through others
- Clear written and spoken communication
Core Skills
Benefits
- Equity packages
- Inclusive parental leave policy
- Annual Vibe and Thrive allowance
- Flexible leave options
Frequently Asked Questions
Answers are based only on the employer’s listing; where it doesn’t say, neither do we.
Where is the Engineering Manager (ML), Evaluation Platform role based?
The listing does not name a city and marks the role as on-site.
What experience is required?
The posting asks for leadership of people, ideally including senior and staff individual contributors, plus hands-on work in generative model evaluation or ML infrastructure.
Is a salary stated?
No salary is given.
How are interviews conducted?
They are held online.
Sample Interview Questions
AI-generated questions tailored to this specific role — a preview of the full practice set.
