Senior Software Engineer – AI Quality Analyst

About The Role

What if your years of software engineering experience could directly influence how AI writes, reasons about, and debugs code for millions of developers around the world? We're looking for Senior Software Engineers to critically evaluate frontier AI models — identifying where they fail, why they fail, and how they can be made better.

This is a fully remote, flexible contract role built for experienced engineers who want to do something genuinely interesting with their skills. No background in AI research required — just deep, hands-on coding experience and the ability to think critically about complex systems.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You'll Do

• Evaluate frontier AI models on complex, real-world software engineering tasks
• Identify bugs, logical errors, hallucinations, and reliability issues in AI-generated code
• Design prompts, test cases, and evaluation scenarios that push models to their limits
• Write precise, structured feedback that captures model strengths, weaknesses, and failure modes
• Assess AI outputs across multiple languages and codebases to evaluate generalization and correctness
• Think critically about model behavior — not just whether the output looks right, but whether it actually is

Who You Are

• 3+ years of professional software engineering experience
• Strong proficiency in at least one of: TypeScript, Ruby, Java, or C++
• Excellent written and spoken English — you can articulate technical reasoning clearly
• A natural debugger who spots non-obvious issues and thinks in edge cases
• Comfortable working with Git, CLI workflows, and modern testing frameworks
• Able to critically evaluate AI outputs rather than simply accept them at face value

Nice to Have

• Experience across multiple programming languages or diverse codebases
• Familiarity with LLMs, prompt engineering, or AI evaluation workflows
• Background in software testing, code review, or QA processes
• Exposure to systems design, compiler theory, or low-level programming

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs and frontier model teams
• Fully remote and flexible — work when and where it suits you, on your own schedule
• Freelance autonomy with the substance of genuinely challenging, meaningful work
• Make a direct, tangible impact on how AI understands and produces software
• Potential for ongoing work and contract extension as new projects launch