This job has expired and is no longer accepting applications.
Remote opportunity at
Sprout Social, Inc.Senior Applied AI/ML Scientist
Sprout Social, Inc. is seeking a Senior Applied AI/ML Scientist to help advance its suite of agentic and machine learning capabilities within the AI, Data, and…
Career Tools
About this role
Senior Applied AI/ML Scientist at Sprout Social, Inc. is a full-time role. Work arrangement: Remote. Location: Applicants in United States only. No salary is shown in this listing. It was posted on Sep 30, 2026. This listing is paused and not taking applications at the moment.
Job Description
Sprout Social, Inc. is seeking a Senior Applied AI/ML Scientist to help advance its suite of agentic and machine learning capabilities within the AI, Data, and Intelligence Business Unit. Sprout Social builds social media management tools that handle over one billion social messages every day and supply metrics to more than 30,000 brands globally. In this position, the professional will sit at the intersection of AI trustworthiness and capability development, focusing primarily on evaluation, measurement, and quality control rather than basic model building.
This role suits an experienced practitioner who is energized by determining how artificial intelligence can effectively solve complex customer problems. The incumbent will steer model adoption, calibrate automated judges, define quality standards, and design rigorous experimentation for production agents. Throughout the first year, the professional will transition from onboarding and understanding existing eval systems to anchoring the evaluation layer across multiple features, influencing long-term AI roadmaps, and elevating team excellence.
Responsibilities
- Manage end-to-end development of agents and agentic features by establishing requirements, success criteria, evaluations, guardrails, and necessary tools alongside engineers, product managers, and designers.
- Evaluate and validate models by choosing optimal configurations, conducting rigorous experimentation like A/B testing, and measuring real customer impact.
- Set and evolve the quality bar for agents while partnering with engineering teams to scale evaluation infrastructure.
- Identify improvement opportunities for the agent platform through prompt iteration, context window management, tool use, reusable judges, and modern model adoption.
- Communicate AI limitations, capabilities, and quality metrics clearly to leadership, engineering, product, and design teams.
Requirements
- Minimum of 5 years of applied AI/ML experience featuring a strong track record in evaluation, measurement, and quality for systems that shipped and produced measurable impact.
- Demonstrated background in designing evaluation frameworks, building and calibrating automated evaluators or judges, and establishing system reliability.
- Solid judgment in model selection, validation, and distinguishing between different technical approaches.
- Rigorous experimentation and statistical capabilities including A/B testing, power analysis, and measurement design.
- Foundational modeling and machine learning knowledge covering Python, transformers, embeddings, common frameworks, SQL, and large datasets.
Qualifications
- Direct production experience evaluating LLM-driven or agentic products regarding prompt quality, hallucination measurement, judge design, and tool-calling reliability.
- Experience defining evaluation methodology and quality bars adopted by other teams.
- Ability to rapidly prototype using new artificial intelligence techniques.
- Familiarity with MLOps practices, observability, and evaluation tooling such as Phoenix or Datadog.
- Experience shaping product roadmaps using evidence of AI feasibility and quality alongside awareness of model security, bias mitigation, and responsible AI practices.
Core Skills
Benefits
- BCBSIL medical, dental, and vision insurance for employees and eligible dependents.
- Mental health support via Modern Health offering coaching, therapy sessions, and digital wellness resources.
- 401(k) retirement plan featuring a 50% company match on the first 6% of contributions.
- Employer-paid life and disability insurance.
- Flexible paid time off paired with company-wide Rest and Recharge days.
- Up to 16 weeks of paid parental leave.
- $1,000 annual lifestyle spending account.
- $550 one-time home office setup stipend and $50 monthly internet stipend.
- 16 hours of annual paid volunteer time and a $100 annual match for charitable donations.
- Pre-tax commuter benefits, subsidized child or elder care through Care.com, discounted pet insurance, and personalized financial wellness support.
Frequently Asked Questions
Answers are based only on the employer’s listing; where it doesn’t say, neither do we.
What is the salary range for the Senior Applied AI/ML Scientist role?
The hiring range is $168,000 to $210,000 annually. Sprout Social utilizes two geographic pay zones in the United States, with Zone 1 ranging from $184,800 to $277,200 and Zone 2 ranging from $168,000 to $252,000.
What is the remote work policy for this position?
The role is classified as remote with a workforce distributed across many states in the United States, though Sprout Social is not registered in every state. Candidates should review the application drop-down menu to check if their state is supported.
What are the core experience requirements?
Applicants must have a minimum of 5 years of applied AI/ML experience with a strong track record in evaluation, measurement, and quality of AI, ML, or LLM systems that have shipped and driven measurable impact.
Sample Interview Questions
AI-generated questions tailored to this specific role — a preview of the full practice set.
Explore more jobs like this
What to do next
This listing is no longer open, so the quickest next step is one of the live roles above. Save the ones that fit, and check the employer's other openings on its company page. To hear about new matches as they are posted, set up a job alert from your candidate account.