Remote opportunity at
MindriftFreelance AI Test Scenario Designer - CS & AI Students Eligible
Mindrift connects subject matter experts with artificial intelligence projects originating from major technology innovators. The organization aims to utilize collective intelligence to guide the evolution of…
Career Tools
About This Role
Mindrift connects subject matter experts with artificial intelligence projects originating from major technology innovators. The organization aims to utilize collective intelligence to guide the evolution of generative AI ethically. This remote freelance position invites qualified computer science and artificial intelligence students or graduates to participate in cutting-edge technology development. As an AI Test Scenario Designer, the selected individual will build structured and realistic evaluation scenarios intended for large language model…
Job Description
Mindrift connects subject matter experts with artificial intelligence projects originating from major technology innovators. The organization aims to utilize collective intelligence to guide the evolution of generative AI ethically. This remote freelance position invites qualified computer science and artificial intelligence students or graduates to participate in cutting-edge technology development.
As an AI Test Scenario Designer, the selected individual will build structured and realistic evaluation scenarios intended for large language model agents. The duties involve drafting test cases that mimic human tasks, establishing gold-standard benchmarks, and detailing proper agent behaviors. Contributors will collaborate with developers to verify test clarity, assess model outputs, and refine scenarios over time.
This part-time engagement accommodates existing academic or professional schedules. Ideal candidates possess an analytical perspective, strong attention to detail, and a keen interest in automated decision-making processes. Participants gain practical experience while helping shape how future systems understand and communicate within their specific areas of expertise.
Responsibilities
- Design structured test scenarios derived from real-world tasks
- Define golden paths and acceptable agent behaviors
- Annotate task steps, expected outputs, and edge cases
- Collaborate with developers to test scenarios and enhance clarity
- Analyze agent outputs and modify tests as needed
Requirements
- Currently pursuing or holding a Bachelor's or Master's degree in Computer Science, Software Engineering, Data Science, Data Analytics, Artificial Intelligence, Machine Learning, Computational Linguistics, Natural Language Processing, Information Systems, or a related field
- Advanced C1 level of English proficiency or higher
- Ability to learn new methods, pivot between tasks quickly, and handle complex guidelines
- Must possess a laptop, internet connection, available time, and currently reside in the specified country
Core Skills
Benefits
- Compensation with rates reaching up to $20 per hour based on skills, experience, and project requirements
- Part-time freelance schedule that adapts to primary professional or academic commitments
- Opportunity to work on advanced AI projects and build relevant portfolio experience
- Ability to influence the understanding and communication of future AI models
Frequently Asked Questions
Answers are based only on the employer’s listing; where it doesn’t say, neither do we.
Is this position remote?
Yes, this freelance role is fully remote.
What is the compensation for this role?
Rates can reach up to $20 per hour, depending on your skills, experience, and project needs.
Who is eligible to apply?
Candidates must currently reside in the specified country and currently hold or pursue a degree in Computer Science, Software Engineering, Data Science, Data Analytics, Artificial Intelligence, Machine Learning, Computational Linguistics, Natural Language Processing, Information Systems, or a related field.
What are the working hours?
This is a part-time freelance project designed to fit around your primary academic or professional commitments.
Sample Interview Questions
AI-generated questions tailored to this specific role — a preview of the full practice set.