Senior Python Developer - AI code review

Job Description

We are seeking experienced Python developers to join an exciting AI project supporting one of the world's top 15 companies. This role involves reviewing and validating AI-generated code to ensure quality, accuracy, and adherence to industry standards.

As a Python Code Reviewer, you will be responsible for auditing and validating AI-generated Python code evaluations. This critical role ensures that AI outputs meet high standards for functionality, clarity, and correctness while adhering to specific project guidelines.

Key Responsibilities

• Code Review & Validation: Evaluate AI-generated Python code snippets for accuracy, functionality, and adherence to prompt instructions
• Quality Assurance: Review annotator assessments and ensure all evaluations meet internal quality benchmarks
• Feedback & Documentation: Provide clear, actionable feedback on incorrect assessments and document technical issues
• Testing & Validation: Validate code functionality using proof-of-work methodologies and Docker-based sandbox environments
• Process Improvement: Identify patterns in evaluation errors and contribute to continuous quality enhancement
• Compliance: Ensure all reviews align with established project guidelines and frameworks

Qualifications

Required Qualifications

Technical Requirements

• 5-7+ years of hands-on Python development experience
• Deep Python expertise including syntax, testing strategies, debugging, and edge case handling
• Docker experience for containerized testing and isolated code validation environments
• QA background with structured workflows, annotation processes, or similar review pipelines

Professional Requirements

• Excellent written communication skills with ability to document and explain technical concepts clearly
• Professional English fluency (B2+ level or above)
• Independent work capability with strong attention to detail
• Immediate availability to start

Preferred Qualifications

• Experience with AI/ML model evaluation, reinforcement learning (RLHF), or large language model tuning
• Familiarity with annotation tools or data labeling platforms
• Knowledge of secure coding practices and environment replication
• Previous experience in code review or technical auditing roles

null