Senior Software Engineer, AI

For our client, we are seeking a Senior Software Engineer AI to join the team of a leader in the Enterprise Technology space. This role will lead work at the intersection of data, AI-enabled capabilities, and scalable technology delivery. You will work across engineering, product, operations, and business stakeholders to translate complex requirements into practical technology solutions. The position offers the opportunity to influence architecture, execution quality, and the technology capabilities that enable long-term growth within a technology-driven environment.

Location: Remote - US based candidates only, no visa sponsorship available

Compensation: $160,000 – $185,000 annually

Responsibilities

• Design and implement a comprehensive AI evaluation framework
• Define critical metrics for measuring AI performance and user engagement
• Create and maintain evaluation datasets and automated scoring systems
• Identify factors influencing agent quality improvements
• Architect reusable agent infrastructure and workflows
• Build and optimize RAG pipelines and retrieval systems
• Lead projects from inception to completion, ensuring effective collaboration

Qualifications

• 5+ years in software engineering with a focus on production AI/ML systems
• Hands-on experience with LLM systems: prompt engineering and evaluation metrics
• Strong statistical knowledge for data-driven experiments
• Proven ability to build scalable agentic AI systems in production
• Solid understanding of AI evaluation frameworks and metrics
• Proficient in production-grade Python coding

Benefits

• Medical, dental, and vision insurance
• Life and disability insurance
• Paid parental leave and generous PTO, including holidays
• Commuter and parking accounts, as well as daily office lunches
• 401(k) retirement plan with financial planning assistance
• Learning and development budget for career growth

Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.