Software Engineer - Backend
CodingRemoteTask-basedPosted Nov 11
Paid per taskThis opportunity lists pay per task, rather than an hourly rate.
Pay: $50–100
Time per task: 5 hours for trainers and 1.5 hours for reviewers
Location: Fully remote
You’ll need: Hands-on expertise in at least one of Python, Java, Rust, Go, C++, or TypeScript
Your tasks: Build challenging coding problems from real repositories, with reproducible environments and verifiers
Location: Remote
You’ll create Reinforcement Learning Environments that test a model’s ability to solve real software engineering problems: tracking down subtle bugs, building non-trivial features, refactoring, and optimizing performance. Each task means defining the problem, building a reproducible environment, and writing a reference solution.
Scope of Work
- Create realistic, challenging coding tasks for frontier AI models, drawn from repositories you know well.
- Design problems that require real engineering skill — subtle bugs, non-trivial features, meaningful performance work — not lookup or boilerplate.
- Build a reproducible environment for each task.
- Write deterministic verifiers that accept correct solutions across different valid implementations, while rejecting incorrect, incomplete, or hard-coded approaches.
