Remote opportunity at
AskableSoftware Engineer, AI Coding Tasks (Contract)
Askable is seeking experienced software engineers for a remote contract position focused on creating AI coding tasks. In this role, contractors convert real code modifications from…
Career Tools
About This Role
Askable is seeking experienced software engineers for a remote contract position focused on creating AI coding tasks. In this role, contractors convert real code modifications from repositories they are deeply familiar with into rigorous testing scenarios designed to evaluate and train advanced artificial intelligence coding models. The objective is to construct challenges that present a high degree of difficulty for current AI systems while remaining fully solvable by proficient human…
Job Description
Askable is seeking experienced software engineers for a remote contract position focused on creating AI coding tasks. In this role, contractors convert real code modifications from repositories they are deeply familiar with into rigorous testing scenarios designed to evaluate and train advanced artificial intelligence coding models. The objective is to construct challenges that present a high degree of difficulty for current AI systems while remaining fully solvable by proficient human developers.
The workflow begins by submitting a short proposal based on a known repository. Once approved, the developer establishes the repository state prior to the modification, drafts the project brief, provides the correct resolution, and implements grading checks. Contractors must stress-test their scenarios against shortcut solutions and leading AI models to ensure top-tier models frequently fail while skilled engineers succeed. Reviews and revisions follow before final task approval.
Compensation is fixed at USD 1,000 for each task that successfully passes the quality review process. Contributors commit a minimum of 10 hours per week and can complete as many tasks as they choose. All generated work is utilized for artificial intelligence training purposes, requiring complete original ownership and adherence to strict non-publication policies.
Responsibilities
- Transform actual repository changes into coding tasks that challenge top AI models
- Set up repository environments within the platform to match states prior to changes
- Develop clear briefs, correct solutions, and robust grading checks
- Stress-test tasks using incorrect, lazy, or shortcut solutions to verify check accuracy
- Evaluate tasks against leading AI models to confirm difficulty levels
- Revise tasks through multiple review rounds based on reviewer feedback
Requirements
- Minimum of two years of professional software engineering experience
- Demonstrated code contributions merged into a public open-source repository or a qualifying personally owned private codebase
- Strong proficiency in Python, TypeScript, Go, Rust, Java, or C++
- Working familiarity with Docker, Linux, Git, and automated testing procedures
- Frequent utilization of AI coding assistants in daily work
- Background in authoring tests, evaluation criteria, or rubrics
- Ability to articulate code modifications clearly and concisely
- Availability of at least 10 hours weekly
- Access to a secure personal or work computer
Qualifications
- Deep specialization in domains such as databases, distributed systems, compilers, infrastructure, or security
- Past experience in creating agent tasks or reinforcement learning environments
Core Skills
Benefits
- USD 1000 paid for each task passing quality review
- Flexibility to complete as many tasks as desired
Frequently Asked Questions
Answers are based only on the employer’s listing; where it doesn’t say, neither do we.
Where is this position located?
This is a remote role available from any location.
What is the compensation for this contract?
Contractors receive USD 1,000 for each task that successfully passes the quality review, with no limit on the number of tasks you can perform.
What are the weekly time commitments for this role?
The posting specifies a minimum commitment of one task a week, which takes about 10 hours weekly.
What technical background is required?
Applicants need at least two years of professional software engineering experience, code merged into an open-source repository or a private codebase they own, strong skills in at least one major programming language, and familiarity with Docker, Linux, Git, and automated testing.
Sample Interview Questions
AI-generated questions tailored to this specific role — a preview of the full practice set.