Data Science Experts
Hourly Contract | Remote | $60–$110 per hour + bonus
Role Overview
Data Science professionals are invited to participate in a major AI research collaboration with one of the world’s leading AI labs. The role involves developing evaluations for exploratory data analysis to support the training, testing, and calibration of advanced AI agents. Work will include identifying patterns, trends, and associations in datasets and producing high-quality Python-based analyses and visualizations.
Key Responsibilities
- Evaluate AI-generated data analysis for accuracy, clarity, and quality.
- Perform statistical analysis and modeling based on both specific and open-ended prompts.
- Design prompts and rubrics for reward modeling and evaluation.
- Produce Python notebooks, explanatory text, and visualizations as gold-standard responses.
- Translate data science reasoning and workflows into structured evaluation criteria.
Ideal Qualifications
- Bachelor’s, Master’s, or PhD in Data Science, Machine Learning, or related field.
- 2+ years of industry experience in data science.
- Proficiency in Python and libraries such as pandas, numpy, scikit-learn.
- Strong understanding of statistical modeling, machine learning, and data analysis techniques.
- Experience identifying patterns in complex datasets and communicating insights through visualization.
- Strong analytical writing skills with the ability to present clear, data-driven insights.
Project Timeline
- Start Date: Immediate
- Duration: 5–6 weeks
- Commitment: ~20 hours/week (flexible, part-time)
- Schedule: Fully remote and asynchronous
Compensation & Contract
- Pay Rate: $60–$110 per hour (based on experience).
- Performance Bonus: Additional $20–$50/hr for top performers.
- Status: Independent Contractor
- Payments: Weekly via Stripe Connect
Application & Onboarding Process
- Submit resume.
- Complete a short technical interview (~25 minutes) including project-based questions and a Google Colab data analysis exercise.
- Paid work trial:
- 6 lessons on rubric-writing fundamentals
- Short comprehension quizzes (non-evaluative)
- Final quiz and a 1–2 hour prompt-writing exercise
- Total time: ~3 hours | Paid $180
- Offer extension upon successful completion.