Senior Java Developer (3-Month Contract)

Work Type: Contractor | Permanent Remote

Note

• Contract-based, fully remote role. Payment based on actual hours worked. No paid leaves/benefits. The contractor handles own taxes/compliance.

About The Project

• We're building LLM evaluation/training datasets to solve realistic software engineering problems. Our approach involves creating verifiable SWE tasks using public repository histories through synthetic methods with human-in-the-loop validation, expanding coverage across programming languages, difficulty levels, and task types.

About The Role

• Seeking a Tech Lead-level software engineer experienced with high-quality public GitHub repositories. You'll drive hands-on engineering work including environment automation, issue triaging, and test coverage/quality evaluation to advance LLM capabilities for real-world coding tasks.

Day-to-Day Responsibilities

• Analyze and triage GitHub issues from trending open-source libraries
• Configure code repositories (Dockerization, environment setup)
• Evaluate unit test coverage and software quality
• Modify/run codebases locally to validate LLM bug-fix performance
• Collaborate with researchers to identify LLM-challenging repositories/issues
• Lead junior engineers on assigned projects

Required Skills

• 5+ years overall software engineering experience
• Tech Lead experience with complex codebases
• Proficiency in Java (primary) or similar enterprise languages
• Expertise with Git, Docker, and CI/CD pipeline configuration
• Ability to run/debug/test real-world projects locally
• Open-source contribution/evaluation experience

Nice-to-Have Skills

• LLM research/evaluation project exposure
• Developer tools/automation agent experience