Software Engineers: Paid Code Review for AI Agent Evaluation
What we're researching
We're running a paid study on the coding environments and programming tasks used to benchmark artificial intelligence agents. Creating robust evaluation harnesses ensures that AI models are tested against realistic software engineering scenarios. This work directly feeds into improving how autonomous agents handle complex coding objectives.
What you'll do
- Review realistic programming tasks for accuracy and difficulty
- Verify the logic and test cases within provided evaluation harnesses
- Assess whether coding environments effectively measure software engineering skills
- Walk us through your thought process while analyzing complex code structures
Compensation
$65 per hour
READY TO PARTICIPATE?
Start your paid interview now https://terac.com/interview/start/r/bf37b4c7-b2ce-40e5-8e13-d41d4d33e9b1?utm_source=ashby_listing_description
About terac
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Learn more at terac.com https://terac.com or on YouTube at @jointerac https://www.youtube.com/@jointerac.
