Italian Senior Prompt Engineer: LLM Migration & Optimization

Remote Full-time
Are you an expert at navigating the complex architecture of Large Language Models? Welo Data is seeking a highly technical Senior Prompt Engineer based in Italy to lead the end-to-end migration of template workflows into high-performance LLM autoraters.

This is a specialized role for a technical architect who understands that "perfecting a prompt" is a rigorous engineering discipline. You will leverage advanced APG/APO tools and manual refinement to ensure our automated systems meet—and exceed—human accuracy baselines in both German and English contexts.
The Mission: Automated Quality at Scale
• Architectural Migration: Take full ownership of the end-to-end technical migration of templates to LLM autoraters.
• Optimization Leadership: Utilize Automatic Prompt Generation (APG) and supervise Automated Prompt Optimization (APO) tools to push model performance past plateaus and logic deadlocks.
• Metrics-Driven Excellence: Continuously measure quality against "gold data" baselines, tracking precision, recall, and F1 scores to justify launch readiness.
• Edge-Case Engineering: Manually draft and refine complex prompts to overcome anti-patterns and architecture gaps that automated tools cannot solve.
Project Details
• Schedule: Part-Time (Set your own hours within project milestones).
• Location: 100% Remote (Must be currently based in Italy ).
• Language: Native fluency in Italian and professional fluency in English.
• Employment Type: Freelance / Independent Contractor.
Candidate Profile
• Educational Foundation: Bachelor’s, Master’s, or PhD in Computer Science, Data Science, Computational Linguistics, or a related analytical field.
• Prompt Engineering Mastery: 4+ years of experience tuning LLMs for strict, structured outputs, complex classification, and few-shot learning.
• Analytical Power: High proficiency in identifying error patterns and using SQL or data analytics tools to monitor performance.
• Technical Agility: Fast learner capable of mastering proprietary internal tools and "Goose API" style interfaces with minimal oversight.
Preferred Technical Skills
• Familiarity with shadowbot monitoring and disagreement tracking between human and LLM ratings.
• Hands-on experience with Chain-of-Thought (CoT) prompting and APO systems.
• Deep linguistic expertise, including a strong understanding of semantics and formal logic.
• Proven ability to draft high-level Launch Certification Documentation.

Apply Now

Apply Now
Apply Now

Similar Opportunities

Experienced Registered Behavior Technician for In-Home ABA Therapy - Atlanta, GA

Remote Full-time

Immediate Hiring: Experienced Registered Behavioral Technician (RBT) for Clinic-Based ABA Therapy Services

Remote Full-time

Experienced Registered Behavioral Technician (RBT) - ABA Therapy for Children with Autism Spectrum Disorder

Remote Full-time

Experienced Registered Nurse - Telehealth: Providing Remote Care Coordination and Patient Support

Remote Full-time

Experienced Substitute Teacher for Riverside County Schools - Join Scoot Education's Innovative Team

Remote Full-time

Experienced Substitute Teacher for San Bernardino County - Flexible Schedules & Competitive Pay

Remote Full-time

Experienced School Year Instructional Coach for High-Dosage Tutoring Programs in Edgewater Park, NJ

Remote Full-time

Experienced School Year Tutor for K-8 Students in Math and Literacy - Mickleton, NJ

Remote Full-time

Experienced Secondary Social Studies Teacher for Kansas - Flexible Hybrid Remote Arrangement

Remote Full-time

USPS Office Helper

Remote Full-time

[Work From Home] Remote Part Time Focus Group Participant

Remote Full-time

Data Entry Manager

Remote Full-time

Sales Director

Remote Full-time

Data Entry Specialist (Night Shift) at The Elite Job - VacancyGlobal

Remote Full-time

Hourly Warehouse: 1st shift, Full-Time, 4-day Week!

Remote Full-time

Experienced Full Stack Remote Data Entry Specialist – Global Logistics and E-commerce Operations at Blithequark

Remote Full-time

Sr Analyst, Corporate Strategy

Remote Full-time

Need English Tutor ? Work from Home in Peoria, AZ

Remote Full-time

Senior Backend Engineer - Startup

Remote Full-time

SEM Manager

Remote Full-time
← Back to Home