Askable: Software Engineer, AI Coding Tasks (Contract)

<img src="https://we-work-remotely.imgix.net/logos/0171/6591/logo.gif?ixlib=rails-4.0.0&w=50&h=50&dpr=2&fit=fill&auto=compress" /> <p> <strong>Headquarters:</strong> Australia <br /><strong>URL:</strong> <a href="https://www.askablelabs.com/">https://www.askablelabs.com/</a> </p> <p>We're looking for experienced software engineers to build AI coding tasks from a codebase they know well. US$1,000 per task, and you can do as many tasks as you want.</p> <p>You turn a real change from a repository you know into a task that today's best AI coding models struggle with: hard for the models, but fair for a skilled engineer. Your tasks are used to measure and train AI coding models.</p> <p>Remote, any location. US$1,000 per task that passes review. Minimum of one task a week, about 10 hours a week.</p> <p><strong>How it works</strong></p> <ol class="iiilu2 iiil4m iiimkb"> <li><strong>Apply. </strong>Complete a short screener interview and upload your resume.</li> <li><strong>Propose.</strong> Once you're selected, pick a change from a repository you know and submit a short proposal. We approve it or suggest a better candidate.</li> <li><strong>Build.</strong> In our platform, set up the repository as it was before the change, then write the brief, the correct solution and the grading checks.</li> <li><strong>Stress-test. </strong>Try lazy, incorrect and shortcut solutions and make sure your checks catch them.</li> <li><strong>Model testing.</strong> Run your task against leading AI models until strong models often fail but a skilled engineer can clearly solve it.</li> <li><strong>Review.</strong> A reviewer checks your task and you revise it. Most tasks take more than one round.</li> <li><strong>Next task.</strong> Once your task is accepted, start another.</li> </ol> <p><strong>Requirements</strong></p> <ul class="iiilu2 iiil4n iiimkb"> <li>2+ years of professional software engineering</li> <li>Code merged into a public open-source repository, ideally one you know well. A private codebase you own may also qualify (not employer or client code)</li> <li>Strong in at least one of Python, TypeScript, Go, Rust, Java or C++</li> <li>Solid with Docker, Linux, Git and automated testing</li> <li>Regular use of an AI coding tool</li> <li>Experience writing tests, rubrics or evaluation criteria, ideally for AI models</li> <li>You can explain a change clearly and concisely, in your own words</li> <li>At least 10 hours a week, starting now</li> <li>A secure personal or work computer (no public or shared machines)</li> </ul> <p><strong>Nice to have</strong></p> <ul class="iiilu2 iiil4n iiimkb"> <li>Deep expertise in one area, such as databases, compilers, distributed systems, security or infrastructure</li> <li>Experience building agent tasks or RL environments</li> </ul> <p><strong>Terms</strong></p> <ul class="iiilu2 iiil4n iiimkb"> <li>US$1,000 for each task that passes our quality review, paid directly to you</li> <li>Once your proposal is qualified, you sign Askable's contract and accept its terms</li> <li>The work is used for AI training. The change and your solution must be your own, and you must be free to license them to us</li> <li>Don't publish the work anywhere: no public pull request or public fork</li> </ul> <p>Apply at https://www.askable.com/experts/roles/senior-software-engineer</p> <p><strong>To apply:</strong> <a href="https://weworkremotely.com/remote-jobs/askable-software-engineer-ai-coding-tasks-contract">https://weworkremotely.com/remote-jobs/askable-software-engineer-ai-coding-tasks-contract</a></p>