This role is for one of our clients
Compensation: $80-$150 per hour
Join an exciting AI research initiative focused on advancing how AI systems understand and evaluate real-world marketing work. We are seeking experienced marketing professionals who can apply their industry expertise to define high-quality standards, develop structured evaluation criteria, and assess marketing deliverables with accuracy and consistency.
Rather than creating marketing campaigns yourself, you will establish what exceptional work looks like by designing detailed scoring frameworks and evaluating AI-generated and human-created marketing content using well-reasoned, evidence-based assessments.
Requirements
Key Responsibilities
Develop clear, task-specific evaluation rubrics for a variety of marketing deliverables, including:
Creative briefs
Campaign concepts and presentations
Brand positioning and messaging frameworks
Advertising copy and scripts
Integrated marketing campaign plans
Client-ready strategy decks
Evaluate AI-generated and human-created marketing work against established criteria, providing detailed written justifications for every score
Apply objective, consistent, and evidence-based judgment to ensure evaluations are accurate, repeatable, and defensible
Collaborate with reviewers and project stakeholders to refine evaluation standards and continuously improve scoring quality
Incorporate structured feedback and iterate quickly to maintain consistency across the evaluation process
Core Qualifications
5+ years of professional experience in marketing, advertising, or brand strategy
Experience as a Creative Director, Brand Strategist, Account Lead, Marketing Manager, or similar senior marketing role at a leading agency or consumer brand
Strong expertise in:
Creative brief development
Brand positioning and messaging
Multi-channel campaign strategy
Creative evaluation against business objectives
Marketing communications
Exceptional written communication skills with the ability to clearly explain evaluation decisions and provide actionable feedback
Strong analytical thinking, attention to detail, and the ability to make consistent, unbiased judgments
Prior experience with AI evaluation, data annotation, human-feedback projects, or AI model training is preferred but not required
Comfortable working independently while collaborating effectively with distributed teams
Application Process
Equal Opportunity
We are committed to creating an inclusive workplace and welcome applicants from all backgrounds. Qualified candidates will be considered without regard to any legally protected characteristic. Reasonable accommodations are available throughout the application and engagement process upon request.
Contract & Engagement Details