For companies
  • Hire developers
  • Hire designers
  • Hire marketers
  • Hire product managers
  • Hire project managers
  • Hire assistants
  • How Arc works
  • How much can you save?
  • Case studies
  • Pricing
    • Remote dev salary explorer
    • Freelance developer rate explorer
    • Job description templates
    • Interview questions
    • Remote work FAQs
    • Team bonding playbooks
    • Employer blog
For talent
  • Overview
  • Remote jobs
  • Remote companies
    • Resume builder and guide
    • Talent career blog
ItsaCheckmate
ItsaCheckmate

Senior/Staff Data Scientist - Product Experimentation & Evaluation (LLMs & AI)

Location

Remote restrictions apply
See all remote locations

Salary Estimate

N/AIconOpenNewWindows

Seniority

Staff

Tech stacks

Experimentation
Data
Data Science
+16

Visa

U.S. visa required

Permanent role
a day ago
Apply now

We are looking for a senior-level Data Scientist to drive experimentation, evaluation, and AI/LLM-powered product improvements. In this role, you will act as a strategic partner to product, engineering, and trust & safety teams, responsible for defining evaluation frameworks, leading experiments (A/B tests, quasi-experiments, etc.), and translating both offline and live model performance into actionable product enhancements.

The ideal candidate will have a strong track record in startup-style experimentation—moving quickly and efficiently with rigorous methods—as well as experience conducting product experimentation at scale. Proven expertise in leading and managing teams to deliver high-impact data science outcomes is highly desirable.

Requirements

  • :8-12+ years of experience in data science / ML roles, ideally with experiment design / product analytics
  • Proven track record in both startup-style and large-scale product experimentation
  • Experience leading teams, setting strategy, and driving execution in cross-functional environments
  • Strong background with statistical methods, causal inference, and rigorous measurement
  • Experience using LLMs / NLP / AI / prompt engineering or closely related field
  • Excellent coding skills in Python (or similar), strong SQL; experience building and deploying models or analytic pipelines
  • Ability to work in cross-functional teams, translate technical results into business or product changes
  • Strong communication skills; ability to explain complex analyses to non-technical stakeholders

Nice to have:

  • Experience fine-tuning or working with multiple LLM providers / APIs
  • Experience with experiment platforms or building internal tooling for experimentation & model evaluation
  • Experience in voice / ASR or other multi-modal data

Working Terms:

  • Candidates must be flexible and work during US hours at least until 6 p.m. ET in the USA, which is essential for this role & must also have their own system/work setup for remote work

About ItsaCheckmate

👥11-50
📍New York, United States
🔗Website

ItsaCheckmate Service

ItsaCheckmate product / service
ItsaCheckmate product / service
ItsaCheckmate product / service
ItsaCheckmate product / service
ItsaCheckmate product / service

How does ItsaCheckmate work?

empowers operators to focus on what matters: their food and customers

Company culture

Hard Work

We put in the maximum amount of effort in everything that we do in order to get the job done. We are industrious and diligent.

Diligence

We are devoted and persistent. No stone is left unturned as we work to achieve our team and Company goals.

Visit company profileIconOpenNewWindows

Unlock all Arc benefits!

  • Browse remote jobs in one place
  • Land interviews more quickly
  • Get hands-on recruiter support
PRODUCTS
Arc

The remote career platform for talent

Codementor

Find a mentor to help you in real time

LINKS
About usPricingArc Careers - Hiring Now!Remote Junior JobsRemote jobsCareer Success StoriesTalent Career BlogArc Newsletter
JOBS BY EXPERTISE
Remote Front End Developer JobsRemote Back End Developer JobsRemote Full Stack Developer JobsRemote Mobile Developer JobsRemote Data Scientist JobsRemote Game Developer JobsRemote Data Engineer JobsRemote Programming JobsRemote Design JobsRemote Marketing JobsRemote Product Manager JobsRemote Project Manager JobsRemote Administrative Support Jobs
JOBS BY TECH STACKS
Remote AWS Developer JobsRemote Java Developer JobsRemote Javascript Developer JobsRemote Python Developer JobsRemote React Developer JobsRemote Shopify Developer JobsRemote SQL Developer JobsRemote Unity Developer JobsRemote Wordpress Developer JobsRemote Web Development JobsRemote Motion Graphic JobsRemote SEO JobsRemote AI Jobs
© Copyright 2025 Arc
Cookie PolicyPrivacy PolicyTerms of Service