Prompt/QA engineer for AI healthcare startup

Company

Tensor provides AI Call Center Agents for companies working in healthcare.

Role Overview

Seeking an experienced Prompt Engineer to:

• Develop and maintain our AI testing infrastructure,
• Improve model performance,
• Ensure quality across our AI agent deployments.

Key Responsibilities

1. Write testsUse customer feedback to identify patterns and areas for improvement
   Develop test cases based on these real-world examples to improve our AI agent’s performance
2. Prompt engineerIterate and improve on our LLM prompts to achieve our quality targets
3. Gather & prepare data for fine-tuningGather and curate high-quality training data for model fine-tuning

Requirements

• Phenomenal clarity and written communication skills in English. This is by far the most critical skill to success as a prompt engineer – because LLMs take direction in English.
• Demonstrated experience with LLMs and prompt engineering
• Strong scripting/programming skills in Python or similar languages

Nice to have

• Experience with testing frameworks and automation tools
• Excellent analytical and problem-solving abilities
• Strong documentation and communication skills
• Understanding of ML concepts and fine-tuning processes