Principal Software Engineer

Crossing Hurdles is a recruitment firm. We refer top candidates to our partners working with the world’s leading AI research labs to help build and train cutting-edge AI models. This project sits at the intersection of software engineering, open-source ecosystems, and frontier AI.

Position: Software Engineer – AI Trainer & LLM Evaluator

Referral Partner: Crossing Hurdles

Type: Hourly Contract (Remote)

Compensation: $35–$200/hour (based on experience)

Location: Remote

Duration: 10–40 hrs/week, 1–2 months (extensions possible)

Requirements

Experience in ANY of the following areas will be a great fit:

• Strong experience in software development, systems analysis, or technical support
• Proficiency in JavaScript, Python, Go, Rust, Java, C++, or related stacks (MERN, backend APIs, CI/CD)
• Strong grasp of software architecture, design, debugging, testing, and code review
• Experience with code diffs, manual/automated testing, and code quality assessment
• Excellent written communication to articulate evaluation rationale
• Experience at top product companies is preferred
• Bachelor's or higher in Computer Science, IT, or related field

What You’ll Do

• Design prompt-based software tasks simulating real-world engineering and QA workflows
• Evaluate AI-generated outputs for correctness, quality, maintainability, and style
• Lead agent-driven use cases such as coding copilots or home automation agents
• Identify edge cases, errors, and ambiguities in model behavior
• Review and rank AI model responses with detailed feedback and structured rationales
• Support intelligent agent development with insights from modern software practices