Your strategic planning shines in designing complex evaluation frameworks for AI search models.
Independence aligns perfectly with the autonomous task of creating structured training data.
Analytical depth ensures accurate assessment of search intent and ranking responses.
Determination drives production of high-quality prompts and rubrics without supervision.
Perfectionism might slow down initial task generation, requiring minor adjustments.

Project Overview

We are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As AI models increasingly interpret search intent, analyze indexing protocols, and evaluate search rank responses, their accuracy relies entirely on robust, expert-crafted training data. The objective of this project is to autonomously produce high-quality evaluation tasks, strong prompts, and clear, well-structured rubrics that generate clean, reliable data for model training.

Project Deliverables & Scope

Operate autonomously to design complex evaluation frameworks and provide structured training data. Expected deliverables include:

Please mention the word **JUBILANT** and tag ROTEuMTE4Ljg2LjE5MA== when applying to show you read the job post completely (#ROTEuMTE4Ljg2LjE5MA==). This is a beta feature to avoid spam applicants. Companies can search these words to find applicants that read this and see they're human.

Apply

This job listing is sourced from Remote OK