For companies
  • Hire developers
  • Hire designers
  • Hire marketers
  • Hire product managers
  • Hire project managers
  • Hire assistants
  • How Arc works
  • How much can you save?
  • Case studies
  • Pricing
    • Remote dev salary explorer
    • Freelance developer rate explorer
    • Job description templates
    • Interview questions
    • Remote work FAQs
    • Team bonding playbooks
    • Employer blog
For talent
  • Overview
  • Remote jobs
  • Remote companies
    • Resume builder and guide
    • Talent career blog
Ellipsis Health
Ellipsis Health

Senior Data Scientist

Location

Remote restrictions apply
See all remote locations

Salary Estimate

N/AIconOpenNewWindows

Seniority

Senior

Tech stacks

Data
AI
Data Science
+28

Visa

U.S. visa required

Permanent role
21 days ago
Apply now

Ellipsis Health is creating cutting-edge AI/ML products that solve healthcare staffing issues and administrative burdens using conversational AI and our patented voice biomarker technology in the delivery of better healthcare for everyone. We are headquartered in Silicon Valley and are funded and supported by some of the most preeminent venture capital teams.

As a Data Scientist specializing in AI Quality & Evaluation, you will play a pivotal role in ensuring the robustness, accuracy, and fairness of our AI models and systems. You will be instrumental in developing comprehensive evaluation frameworks, creating diverse and high-quality datasets, and implementing metrics to drive continuous improvement across our AI initiatives. Your work will directly contribute to accelerating customer onboarding and enhancing the overall user experience.

Ellipsis Health is located in the San Francisco Bay Area, but we are open to remote candidates for this role, as long as they are located in the U.S.

Responsibilities

  • Drive High-Impact Projects: Own data science and AI evaluation projects end-to-end—from defining the problem and developing the methodology to executing the analysis, communicating results, and driving implementation.
  • Drive Continuous Improvement of LLM-as-a-Judge: Build the data and evaluation infrastructure for a closed-loop AI quality system, including golden datasets, ground-truth benchmarks, judge calibration, error analysis, and production feedback. Continuously identify failure modes and translate insights into improvements to datasets, evaluation methodologies, LLM-as-a-Judge systems, and the underlying AI products.
  • Develop Evaluation Frameworks: Design and implement robust evaluation frameworks, methodologies, and metrics for LLM- and speech-based AI systems. Develop scalable approaches that help us measure quality and accelerate customer onboarding.
  • Build and Manage Evaluation Datasets: Design, curate, and maintain high-quality datasets for training, testing, benchmarking, and evaluating conversational AI systems and their components.
  • Create and Manage Data Pipelines and Dashboards: Build and maintain scalable data pipelines and intuitive dashboards that enable reliable data analysis,ongoing AI quality monitoring, and data-driven decision-making across the organization.
  • Collaborate and Innovate: Work closely with AI/ML Engineers and Product Managers to integrate your findings into product enhancements. You'll stay current with the latest advancements in AI evaluation, particularly in Large Language Models (LLMs) and speech systems, contributing to our overall technical strategy.
  • Mentor and Lead: Mentor junior data scientists, establish best practices, and raise the technical bar across the team.

Qualifications

  • 5+ years of industry experience in data science, machine learning, or a related quantitative field.
  • Bachelor's or Master's degree in Computer Science, Data Science, Statistics, Mathematics, or a related quantitative field.
  • Strong proficiency in programming languages such as Python (with libraries like Pydantic, Pandas, NumPy, Scikit-learn).
  • Strong foundation in statistical analysis, experimental design, hypothesis testing, and A/B testing methodologies.
  • Experience working with large-scale datasets, data pipelines, and analytical tools to generate actionable insights.
  • Familiarity with evaluation metrics (precision, recall, agreement metrics like Cohen's Kappa) to calibrate judge models against human ground truth.
  • Demonstrated ability to independently own and drive projects from problem definition through execution and implementation..
  • Excellent communication and interpersonal skills, with the ability to collaborate effectively with AI/ML Engineers, Product Managers, and other cross-functional stakeholders in a fast-paced environment.

Bonus Points If You Have

  • Experience with Natural Language Processing (NLP) techniques and understanding of LLM architectures and their evaluation challenges. Experience with Speech Technologies and their evaluation is a significant advantage.
  • Experience in a regulated industry (e.g., healthcare, finance). Familiarity with data governance principles, particularly concerning PII/PHI.
  • Experience with MLOps practices and deploying models to production.
  • Familiarity with Langfuse, cloud platforms (GCP, AWS, Azure) and data platforms such as Databricks.

Salary And Benefits

We offer competitive salary and benefits, including 401k matching up to a certain percentage of your salary, health, vision, and dental insurance, and very flexible paid time off. The typical salary range for this role is $180k-230k USD. The amount offered will be determined by a variety of factors including but not necessarily limited to your individual skills, qualifications, and past experience relative to the requirements of the role.

Background Checks

As a health technology company, we reserve the right to run a background check on any applicant to which we extend an offer and to re-perform any such check at any time during the course of employment. Please know that there is no set policy on rejecting candidates because of certain background check results, and that we look at a candidate as a whole before making any decisions. We comply with all “ban the box” laws in applicable jurisdictions.

Assistance

If you have a disability or otherwise require any assistance whatsoever in the application or recruitment process, please feel free to submit a request to careers@ellipsishealth.com.

About Ellipsis Health

🔗Website
Visit company profileIconOpenNewWindows

Unlock all Arc benefits!

  • Browse remote jobs in one place
  • Land interviews more quickly
  • Get hands-on recruiter support
PRODUCTS
Arc

The remote career platform for talent

Codementor

Find a mentor to help you in real time

LINKS
About usPricingArc Careers - Hiring Now!Remote Junior JobsRemote jobsCareer Success StoriesTalent Career BlogArc Newsletter
JOBS BY EXPERTISE
Remote Front End Developer JobsRemote Back End Developer JobsRemote Full Stack Developer JobsRemote Mobile Developer JobsRemote Data Scientist JobsRemote Game Developer JobsRemote Data Engineer JobsRemote Programming JobsRemote Design JobsRemote Marketing JobsRemote Product Manager JobsRemote Project Manager JobsRemote Administrative Support Jobs
JOBS BY TECH STACKS
Remote AWS Developer JobsRemote Java Developer JobsRemote Javascript Developer JobsRemote Python Developer JobsRemote React Developer JobsRemote Shopify Developer JobsRemote SQL Developer JobsRemote Unity Developer JobsRemote Wordpress Developer JobsRemote Web Development JobsRemote Motion Graphic JobsRemote SEO JobsRemote AI Jobs
© Copyright 2026 Arc
Cookie PolicyPrivacy PolicyTerms of Service