AI Interaction Evaluator (Codex / Claude Code, up to $200/hr)

Ever wondered if an AI can truly think like a top-tier software engineer? At G2i, we're not just wondering, we're actively exploring that frontier. We're on the hunt for highly experienced software engineers, folks who've shipped serious code, to join us as an AI Interaction Evaluator. This isn't your typical coding gig; you won't be writing production systems. Instead, you'll be putting your deep engineering intuition to the ultimate test, guiding and assessing the "thought processes" of cutting-edge AI coding agents like OpenAI Codex and Claude Code. If you've got a sharp eye for logic, a knack for debugging, and a passion for shaping the future of AI, this unique, project-based contract role could be your next big adventure, offering up to $200 an hour.

Overview

G2i is seeking Senior AI Interaction Evaluators for a unique, fully remote contract opportunity, open to talent worldwide. This project-based role offers significant flexibility with hourly rates ranging from $50 to $200, requiring a commitment of 10+ hours per week, though projects often involve 40+ hours once they commence. We operate on a rolling hiring basis, building a talent bench for upcoming projects. While specific roles might be filled at this moment, applying now ensures you're considered for the earliest genuine opportunity. This isn't about traditional software development. Instead, your primary focus will be evaluating whether an AI model truly understands and approaches coding challenges like an expert human engineer.

Key Responsibilities

As an AI Interaction Evaluator, your core task involves deeply assessing the behavior of AI coding agents in various real-world scenarios. Your evaluations will center on several critical aspects:

Evaluating whether the AI's generated response makes complete logical and technical sense.
Assessing the usefulness and clarity of the AI's preamble and underlying reasoning.
Determining if the AI's output demonstrates strong engineering principles and best practices.

Requirements

We're looking for individuals who bring a robust background in software engineering. To thrive in this role, you'll need:

Significant experience as a software engineer, typically at a Senior level or above (SR+).
A profound understanding of modern software engineering principles, design patterns, and best practices.
Exceptional critical thinking abilities to dissect and analyze complex code and problem-solving approaches.
Strong analytical skills to identify nuances in AI responses and provide constructive feedback.
Excellent communication skills, both written and verbal, for articulating detailed evaluations.
Availability to commit at least 10 hours per week, with the understanding that projects typically require 40+ hours once active.

What You'll Gain

Joining G2i as an AI Interaction Evaluator offers more than just a contract; it's a chance to be at the forefront of AI development:

Influence the Future: Directly shape the evolution of cutting-edge AI coding tools like OpenAI Codex and Claude Code.
Competitive Compensation: Earn an attractive hourly rate of up to $200, recognizing your expert-level insights.
Flexibility and Remote Work: Enjoy the freedom of a fully remote, worldwide contract position.
Exposure to Innovation: Work closely with advanced AI technologies and contribute to groundbreaking projects.
Variety and Challenge: Engage with diverse coding scenarios and complex AI interactions on a project-by-project basis.