Junior Software Engineer – AI Code Evaluation

Compensation

Annualized Compensation: $288,000–$384,000 per year
Hourly Rate: $150–$200 per hour
Employment Type: Contractor
Work Arrangement: Remote

The annualized figure is based on 40 hours per week and 48 working weeks per year. Actual earnings will depend on project workload, assignments, and hours worked.

About the Role

We are seeking junior software engineers with professional experience at leading technology companies to evaluate AI-generated code and help improve AI performance on real-world software engineering tasks.

In this role, you will assess code for correctness, quality, and design, create challenging programming problems with reference solutions and test cases, and evaluate AI reasoning across software architecture, debugging, and system design.

This opportunity is suited to software engineers who combine strong technical judgment with the ability to explain engineering decisions clearly. Your feedback will help improve the quality and reliability of AI-generated software solutions.

Key Responsibilities

• Evaluate AI-generated code for correctness, quality, maintainability, and design.

• Develop challenging coding problems that test practical software engineering skills.

• Create reference solutions and test cases to assess code correctness and performance.

• Review AI reasoning across software architecture, debugging, algorithms, data structures, and system design.

• Identify errors, weaknesses, and opportunities for improvement in generated code and technical approaches.

• Assess whether proposed solutions demonstrate sound engineering judgment.

• Provide detailed technical feedback to support improvements in AI model performance.

• Explain technical decisions and evaluation findings clearly in writing.

Required Qualifications

• At least one year of professional software engineering experience at a leading technology company, with at least part of that experience gained within the past three years.

• Strong understanding of software engineering fundamentals, including algorithms and data structures.

• Knowledge of system design and software architecture.

• Ability to review code, identify defects, and evaluate implementation quality.

• Strong debugging and analytical problem-solving skills.

• Ability to explain technical decisions and findings clearly in writing.

• Based in an English-speaking country.

Preferred Qualifications

• Experience evaluating code quality, software design, and engineering trade-offs.

• Experience developing coding challenges, reference implementations, or test cases.

• Familiarity with reviewing technical reasoning across debugging, architecture, and system design.

• Ability to assess multiple approaches to a software engineering problem and identify their strengths and weaknesses.

Key Skills

• Software Engineering

• Code Review

• AI-Generated Code Evaluation

• Algorithms

• Data Structures

• System Design

• Software Architecture

• Debugging

• Problem Solving

• Coding Challenge Development

• Test Case Design

• Reference Solution Development

• Code Correctness

• Software Quality Assessment

• Technical Analysis

• Written Technical Communication

• Critical Thinking

What Success Looks Like

• AI-generated code is evaluated accurately for correctness, quality, and design.

• Coding challenges, reference solutions, and test cases effectively assess software engineering capabilities.

• Weaknesses in AI reasoning, debugging, and system design are identified and documented.

• Technical feedback is clear, actionable, and grounded in sound engineering judgment.

• Evaluations contribute to improved AI performance on practical software engineering tasks.