Job Title: AI Evaluation Specialist

Job Type: Contractor

Location: Remote

Job Summary:

As a AI Evaluation Specialist, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required , your domain knowledge is what matters.

Key Responsibilities:

• Review and critically assess AI-generated outputs for quality, clarity, usability, and overall user experience.

• Identify inconsistencies, weaknesses, and improvement opportunities across diverse content types and visual experiences.

• Apply structured evaluation guidelines and provide insightful, nuanced feedback to inform model improvements.

• Collaborate with cross-functional teams to define and refine quality standards, scoring criteria, and review processes.

• Maintain high accuracy and consistency across evaluations, ensuring reliable and actionable results.

• Contribute to the continuous enhancement of evaluation workflows and best practices.

• Support the development of training data that enhances AI system performance and reliability.