Rex.zone

About The Role 
 
As an AI Engineer in the United States (Remote) via Rex.zone, you will design, build, and operate ML systems that move from experimentation to production. The work includes training and fine-tuning models (including LLMs), establishing evaluation harnesses, and using RLHF-style feedback loops where appropriate. 
 
What You Will Do 
 


* Develop and maintain end-to-end ML pipelines for training, evaluation, and deployment
* Implement model evaluation and offline/online metrics to track model performance improvement
* Integrate human feedback and RLHF signals into training workflows when applicable
* Partner with data teams on annotation guidelines compliance, QA sampling, and error analysis
* Build prompt evaluation and regression test suites for LLM features
* Optimize inference latency, throughput, and cost for production services
* Implement monitoring, drift detection, and incident response runbooks for model behavior 
 
 

Required Qualifications 
 


* Mid-Senior experience shipping ML systems into production
* Strong Python engineering skills and familiarity with ML libraries
* Practical experience with model training, fine-tuning, and evaluation workflows
* Understanding of training data quality, labeling noise, and QA evaluation methods
* Familiarity with LLM training pipelines and prompt evaluation practices 
 
 

How To Apply 
 
Search Rex.zone for AI Engineer jobs in the United States and apply to roles that match your domain and stack. 
 
Highlight production ML impact, evaluation methodology, and measurable reliability/performance improvements.

Experimentation

Python

Testing

Data

Compliance

Analysis

Training

Workflows

Data Quality

Monitoring

Incident Response

Annotation

Regression testing

Critical Feedback

AI Engineer Jobs in the United States