G2i is hiring a contract remote Senior AI Interaction Evaluator to assess the quality of interactions with modern AI coding agents such as OpenAI Codex and Claude Code.
This is not a traditional software engineering role – you’ll use your senior engineering judgment to evaluate whether AI coding agents reason, communicate, and make decisions like strong engineers.
Evaluate AI-generated coding interactions from beginning to end
Assess whether responses are useful, correct at a high level, and aligned with strong engineering practices
Evaluate the quality of AI explanations, reasoning, and preambles—not just the code itself
Distinguish between different levels of response quality
Identify what worked, what didn’t, and what felt misleading or technically “off”
Provide clear, direct, and opinionated feedback
Help define what excellent AI coding interactions should look like
Evaluate tools and workflows involving coding agents such as Codex, Claude Code, and Cursor
Staff-, Principal-level engineer, or equivalent experience
Strong background in Python or TypeScript/JavaScript
Hands-on experience using OpenAI Codex, Claude Code, and Cursor
Deep familiarity with modern AI-assisted software development workflows
Strong engineering judgment and a high bar for quality
Able to evaluate code and engineering decisions without needing to execute or deeply review every line
Comfortable making subjective but rigorous judgments
Comfortable giving direct, specific, and opinionated feedback
Strong understanding of what effective engineering communication and decision-making look like
Experience with Cursor or similar AI-first development tools
Experience with prompt design or AI evaluation workflows
Experience mentoring senior engineers or defining engineering standards
Rate: $100–$200/hour
Hours: Approximately 10–20 hours/week
Start: ASAP
Duration: Through early May, with possible extension
Selection Process: Take-home evaluation exercise followed by one behavioral interview
Tagged as: AI Code Evaluation, AI Code Reviewer, AI Code Reviewer Remote, AI Coding Evaluator, AI Engineer, AI-assisted Development, Python Developer, Python Engineer, Python Engineer Remote, Senior AI Interaction Evaluator
About This Opportunity Spreetail is hiring a remote Affiliate Program Coordinator – TikTok Shop to support the operational side...
Apply For This JobAbout This Opportunity Percona is hiring a remote Executive Assistant to CEO to manage the CEO’s schedule and provide...
Apply For This JobAbout This Opportunity HighLevel is looking for a motivated and detail-oriented remote People Operations Apprentice to join its People...
Apply For This JobAbout This Opportunity Cloudbeds is hiring a remote Customer Support & Onboarding Specialist – Accounting to help European hotel...
Apply For This JobAbout This Opportunity They are seeking highly skilled and motivated remote Bug Bounty Security Researchers to join their team....
Apply For This JobAbout This Opportunity Katapult Labs is hiring a remote Full-Stack AI Engineer to join a fast-growing fintech company building...
Apply For This Job