Software Engineer — AI Code Ranking

About The Role

What if your years of software engineering experience could directly shape how AI writes code for millions of developers? We're looking for Software Engineers in New York to evaluate, rank, and refine AI-generated code — helping the next generation of coding assistants produce solutions that are correct, efficient, idiomatic, and production-ready.

Your deep understanding of software architecture, design patterns, and real-world engineering trade-offs is exactly what AI models need to get better. This isn't about writing boilerplate — it's about applying expert judgment to push the boundaries of what AI can do with code.

This is a fully remote, flexible contract role built for experienced developers who want meaningful, high-impact work on their own schedule.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You'll Do

• Review and rank AI-generated code solutions across multiple programming languages and problem domains
• Evaluate code for correctness, efficiency, readability, maintainability, and adherence to best practices
• Identify bugs, anti-patterns, security issues, and performance bottlenecks in AI-generated outputs
• Write detailed, structured feedback explaining why one solution is better than another
• Refine and improve AI-generated code to meet production-level engineering standards
• Provide preference rankings that help AI models learn what "good code" actually looks like
• Work independently and asynchronously — fully on your own schedule

Who You Are

• Software engineer with 3+ years of professional development experience
• Proficient in one or more major programming languages (e.g., Python, JavaScript/TypeScript, Java, C++, Go, Rust)
• Strong grasp of data structures, algorithms, and computational complexity
• Deep understanding of software design principles, clean code practices, and engineering trade-offs
• Experienced with code review — you know how to assess quality and articulate why something works or doesn't
• Clear, concise written communicator who can explain technical decisions effectively
• Self-motivated and reliable when working independently without supervision

Nice to Have

• Experience across multiple languages, frameworks, or tech stacks
• Background in systems design, distributed systems, or backend architecture
• Familiarity with AI/ML concepts or experience using AI coding tools (Copilot, ChatGPT, etc.)
• Prior experience with code evaluation, technical mentoring, or open-source contribution
• Knowledge of security best practices and performance optimization
• Experience in competitive programming or technical interviewing

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Directly influence how AI coding assistants learn to write better software
• Fully remote and flexible — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Leverage your hard-earned engineering expertise in a new, high-impact way
• Potential for ongoing work and contract extension as new projects launch
• Join a global community of top-tier engineers shaping the future of AI-assisted development