AI Agent Evaluation Specialist (CS / Data Science Students Welcome)

Mindrift is currently seeking individuals for the AI Agent Evaluation Specialist role. This remote freelance position invites data science and computer science students, as well as…

View Company

Role Snapshot

Hiring Now

Work arrangement: Remote
Where applicants may be: Applicants in Canada only
Salary: Not specified
Apply by: Not specified
Employment type: Full-time
Experience: Not specified

Added to Jobsiz2h agoEmployer posted Oct 16, 2026

Listing Views0

Applications0

Apply BeforeNo deadline

Career Tools

About This Role

Mindrift is currently seeking individuals for the AI Agent Evaluation Specialist role. This remote freelance position invites data science and computer science students, as well as qualified professionals, to engage with advanced artificial intelligence projects. Mindrift operates a platform that links specialists with prominent technology innovators to help unlock the full potential of generative AI through global expertise. In this capacity, contributors design realistic evaluation scenarios for large language model-based…

Job Description

In this capacity, contributors design realistic evaluation scenarios for large language model-based agents. Responsibilities include formulating test cases that mimic human tasks, establishing optimal target behaviors, and working alongside developers to refine test clarity. The arrangement is part-time and remote, designed to accommodate existing academic or professional schedules.

Candidates should possess a strong analytical perspective and an interest in AI decision-making processes. Qualified individuals must be enrolled in or hold a degree in a relevant technical field and maintain an advanced level of English proficiency. This opportunity allows contributors to earn compensation while building relevant portfolio experience in the field of artificial intelligence.

Responsibilities

Design structured test scenarios based on real-world tasks
Define the golden path and acceptable agent behavior
Annotate task steps, expected outputs, and edge cases
Work with developers to test scenarios and improve clarity
Review agent outputs and adapt tests accordingly

Requirements

Currently reside in the specified country
Hold or be currently pursuing a Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Science, Data Analytics, Artificial Intelligence, Machine Learning, Computational Linguistics, Natural Language Processing, Information Systems, or a related field
Demonstrate an advanced C1 level of English or above
Possess a laptop and an internet connection
Be able to learn new methods, switch between tasks quickly, and handle complex guidelines

Qualifications

Background or studies in Computer Science, Data Science, or related technical disciplines

Core Skills

Machine Learning

Benefits

Earn compensation based on skills, experience, and project needs with rates up to $20 per hour
Participate in a part-time, remote freelance project that fits around academic or professional commitments
Gain experience on advanced AI projects to enhance a professional portfolio

Frequently Asked Questions

Answers are based only on the employer’s listing; where it doesn’t say, neither do we.

Is this position remote?

Yes, this freelance role is fully remote, allowing you to work from home using your own laptop and internet connection.

What is the salary for this role?

Rates can reach up to $20 per hour, depending on your skills, experience, and project needs.

What are the educational requirements?

You must have or be currently pursuing a Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Science, Data Analytics, Artificial Intelligence, Machine Learning, Computational Linguistics, Natural Language Processing, Information Systems, or a related field.

How do I apply?

You can get started by simply applying to the post and completing the qualification process.