Software Engineer AI Coding Tasks

Askable
📍 Remote (probably - not specified)
2d
  • Your natural curiosity and love for problem-solving make you great at designing tricky tasks for AI models.
  • You thrive in independent work settings where you can deeply explore a codebase and its nuances.
  • Your analytical mind excels at breaking down code changes into clear, logical steps for evaluation.
  • Your tendency to over-complicate or refine ideas could conflict with the need for straightforward, fair tasks.
  • You may struggle with the structured, step-by-step workflow and strict deadline of at least one task per week.

We're looking for experienced software engineers to build AI coding tasks from a codebase they know well. US$400-US$1,000 per task, and you can do as many tasks as you want.

You turn a real change from a repository you know into a task that today's best AI coding models struggle with: hard for the models, but fair for a skilled engineer. Your tasks are used to measure and train AI coding models.

Remote, any location. US$400-US$1,000 per task that passes review. Minimum of one task a week, about 10 hours a week.

How it works

  1. Apply. Complete a short screener interview and upload your resume.

  2. Propose. Once you're selected, pick a change from a repository you know and submit a short proposal. We approve it or suggest a better candidate.

  3. Build. In our platform, set up the repository as it was before the change, then write the brief, the correct solution and the grading checks.

  4. Stress-test. Try lazy, incorrect and shortcut solutions and make sure your checks catch them.

  5. Model testing. Run your task against leading AI models until strong models often fail but a skilled engineer can clearly solve it.

  6. Review. A reviewer checks your task and you revise it. Most tasks take more than one round.

  7. Next task. Once your task is accepted, start another.


Requirements


Nice to have


Terms


Apply at https://www.askable.com/experts/roles/senior-software-engineer



Please mention the word **FANS** and tag RMmEwMTo0Zjg6YzAxNTpjNjYxOjox when applying to show you read the job post completely (#RMmEwMTo0Zjg6YzAxNTpjNjYxOjox). This is a beta feature to avoid spam applicants. Companies can search these words to find applicants that read this and see they're human.

Apply
This job listing is sourced from Remote OK

Best personality fits for this role

Browse more

Similar jobs