Software Developer AI Trainer, $100-$130/hour

Remote Full-time
Project Overview:

Join a growing community of professionals advancing the next wave of AI. As an AI Trainer, you'll play a hands-on role by analyzing and providing feedback on data to improve LLM performance, helping ensure that the next generation of AI technology is accurate and trustworthy.

We are seeking a skilled Senior Software Engineer to work as a project consultant in our AI Labor Marketplace. This is not a full-time employment position - you will be engaged as an expert project consultant on a contract basis.

Location: U.S.-based experts only

Engagement: Part-time, project-based expert evaluation work

Work Type: Remote

Project Summary:

Consultants will design realistic, senior-level software engineering tasks, evaluate GPT-5.2 model reasoning using structured rubrics, and produce gold-standard responses that reflect real-world engineering best practices.

Consultant Engagement Terms:

This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors' allowances).

Responsibilities:

Contributors will:
• Create realistic, complex software engineering prompts based on professional experience
• Design clear, criteria-based evaluation rubrics
• Evaluate GPT-5.2 model outputs against defined success criteria
• Author high-quality gold responses demonstrating senior-level reasoning
• Ensure all work is synthetic, non-proprietary, and objectively evaluable

Expected Outcomes:
• High-quality prompts that reflect real engineering challenges
• Clear, defensible evaluation rubrics
• Consistent, well-reasoned model evaluations
• Gold-standard responses suitable for model training and benchmarking

Qualifications:
• 10+ years of professional software engineering experience
• Senior, Staff, Principal, Tech Lead, or Architect-level background
• Strong CS fundamentals and production system experience
• Experience at top SaaS companies or scaled startups preferred
• Prior data annotation or model evaluation experience is a strong plus

Apply Now

Apply Now
Apply Now

Similar Opportunities

Experienced Registered Behavior Technician for In-Home ABA Therapy - Atlanta, GA

Remote Full-time

Immediate Hiring: Experienced Registered Behavioral Technician (RBT) for Clinic-Based ABA Therapy Services

Remote Full-time

Experienced Registered Behavioral Technician (RBT) - ABA Therapy for Children with Autism Spectrum Disorder

Remote Full-time

Experienced Registered Nurse - Telehealth: Providing Remote Care Coordination and Patient Support

Remote Full-time

Experienced Substitute Teacher for Riverside County Schools - Join Scoot Education's Innovative Team

Remote Full-time

Experienced Substitute Teacher for San Bernardino County - Flexible Schedules & Competitive Pay

Remote Full-time

Experienced School Year Instructional Coach for High-Dosage Tutoring Programs in Edgewater Park, NJ

Remote Full-time

Experienced School Year Tutor for K-8 Students in Math and Literacy - Mickleton, NJ

Remote Full-time

Experienced Secondary Social Studies Teacher for Kansas - Flexible Hybrid Remote Arrangement

Remote Full-time

USPS Office Helper

Remote Full-time

**Experienced Data Entry Associate – Flexible Remote Work Opportunity with Competitive Pay and Comprehensive Benefits**

Remote Full-time

Remote OCCC Universal Agent (Overnight)

Remote Full-time

Public Finance Associate - Native American Financial Services

Remote Full-time

Experienced Online Live Chat Support Specialist – Remote Part-Time Opportunity for Career Growth and Development

Remote Full-time

HR Coordinator – Hiring Internationally

Remote Full-time

Looking for Baldwin Elementary - General Education / Noon Recess Building Paraeducator in Rochester, MI

Remote Full-time

**Experienced Customer Service Representative – Clinical Trials Management**

Remote Full-time

Experienced Technical Customer Success Engineer – eCommerce Platform Support and Customer Advocacy Specialist

Remote Full-time

Corporate Communications Marketing Manager

Remote Full-time

Strategic Project Lead-1

Remote Full-time
← Back to Home