AI/ML Software engineer -25-02840

Lead Stack Inc. is an award-winning, one of the nation's fastest-growing, certified minority-owned (MBE) staffing services provider of contingent workforce. As a recognized industry leader in contingent workforce solutions and Certified as a Great Place to Work, we're proud to partner with some of the most admired Fortune 500 brands in the world.

TITLE: AI Software developer

LOCATION: Remote in USA

DURATION: 6-Month Contract with possible extension

No C2C

GC/USC preferred

Rate: $90-$100/hr on W2

Description:

We are seeking experienced Software Engineers to develop and evaluate high-quality training data for our advanced AI models. As part of the Human Data Operations team, you will architect, analyze, and curate sophisticated datasets that facilitate the training of large language models. You will work closely with our research and engineering teams to ensure our AI systems demonstrate key traits like helpfulness, honesty, and harmlessness while maintaining technical excellence.

Key Responsibilities:

• Design and implement data collection systems and pipelines for AI model training
• Architect and evaluate datasets for AI model training and benchmarking
• Provide in-depth analysis of model behaviors, performance, and interaction patterns
• Develop and curate complex code examples and solutions in multiple languages (Python, JavaScript, Rust, C/C++)
• Lead evaluation efforts of AI-generated code to enforce industry-leading standards
• Identify and analyze emerging trends, edge cases, and opportunities for improvement
• Develop advanced benchmarks and evaluation methodologies for AI capabilities
• Create technical documentation and evaluation frameworks

Quality Standards:

• Maintain high levels of precision and consistency in data labeling and code evaluation
• Follow annotation guidelines and quality control processes
• Participate in regular quality audits and calibration exercises
• Document clear rationales for evaluation decisions
• Flag edge cases and provide detailed feedback on challenging examples

Required Qualifications:

• Bachelor's degree or equivalent experience in Computer Science, Software Engineering, or related technical field
• 5+ years of professional software development experience
• Expert proficiency in multiple programming languages (Python, JavaScript, Rust)
• Strong full-stack development experience across frontend and backend systems
• Advanced understanding of data structures, algorithms, and system architecture
• Experience with ML/AI systems, preferably language models or related technologies
• Strong attention to detail with exceptional analytical and critical thinking skills
• Outstanding written and verbal communication abilities
• Proven ability to work independently while delivering high-quality output

Preferred Qualifications:

• Master's degree in Computer Science, AI, or related field
• Experience with AI language models, prompt engineering, or model evaluation
• Deep knowledge of machine learning frameworks and concepts
• Previous experience developing tooling for data labeling or annotation platforms
• Expertise in cloud infrastructure (AWS, GCP, Azure) and containerization (Docker, Kubernetes)
• Experience with distributed systems and high-performance computing
• Understanding of ethical considerations in AI development

To know more about current opportunities at Lead Stack, please visit us at https://leadstackinc.com/careers/

Should you have any questions, feel free to call me on 415 985-0816 or send an email on Nishanth.allam@leadstackinc.com