Quality Assurance (QA) Analyst – AI Data Annotation
About ExpedockWe are a tech-enabled workforce augmentation platform leveraging top 1% offshore talent & cutting edge technology to enable businesses to unlock their full potential
Role OverviewThe QA Analyst is responsible for ensuring the accuracy, consistency, and quality of annotated data across all workflows. This role plays a critical part in maintaining high-quality datasets used for training AI/ML models by auditing outputs, providing feedback, and driving continuous improvement among annotators.
Key Responsibilities
1. Quality Auditing
Review annotated data (images, text, video, or audio) based on defined guidelines
Perform random and targeted 25% sampling (initial)
Identify errors, inconsistencies, and edge cases
2. Error Analysis & Reporting
Categorize errors (e.g., labeling, bounding box accuracy, classification mistakes)
Track QA metrics such as accuracy rate, defect rate, and rework volume
Provide daily/weekly QA reports with actionable insights
3. Feedback & Coaching
Deliver structured feedback to annotators
Conduct calibration sessions to ensure alignment on guidelines
Support Team Leads in coaching low-performing annotators
4. Guideline Adherence & Improvement
Ensure strict compliance with annotation guidelines and client requirements
Flag ambiguous cases and recommend guideline improvements
Collaborate with Ops/Training teams to refine SOPs
5. Process Improvement
Identify trends and recurring quality issues
Recommend workflow enhancements to improve accuracy and efficiency
Support pilot runs and new workflow validation
Key Metrics (KPIs)
Annotation Accuracy (%)
QA Pass Rate
Error Rate / Defect Density
Turnaround Time (TAT) for QA reviews
Rework Reduction Rate
Qualifications
Bachelor’s degree or equivalent experience
1–2 years experience in QA, data annotation, or BPO operations (preferred)
Strong attention to detail and analytical skills
Experience reviewing datasets (image, text, or video) is a plus
Familiarity with annotation tools (e.g., CVAT, Labelbox, etc.) is an advantage
Tools & Systems (Nice to Have)
Annotation platforms (CVAT, Labelbox, Supervisely)
Google Sheets / Excel for tracking and reporting
QA dashboards or internal tools
Candidate Data & Privacy NoticeBy submitting your application to Expedock, you acknowledge and consent to the collection, use, and processing of your personal information for recruitment and hiring purposes. Your information will be used to:
Evaluate your qualifications and suitability for current and future roles
Communicate with you throughout the recruitment process, improve our hiring processes, and overall candidate experience
Maintain talent pools for future opportunities, where permitted by law
We handle candidate data with care and in accordance with applicable data protection and privacy regulations. Your information will only be accessed by authorized team members and will not be shared with third parties without your consent, unless required by law.
Apply Now
Role OverviewThe QA Analyst is responsible for ensuring the accuracy, consistency, and quality of annotated data across all workflows. This role plays a critical part in maintaining high-quality datasets used for training AI/ML models by auditing outputs, providing feedback, and driving continuous improvement among annotators.
Key Responsibilities
1. Quality Auditing
Review annotated data (images, text, video, or audio) based on defined guidelines
Perform random and targeted 25% sampling (initial)
Identify errors, inconsistencies, and edge cases
2. Error Analysis & Reporting
Categorize errors (e.g., labeling, bounding box accuracy, classification mistakes)
Track QA metrics such as accuracy rate, defect rate, and rework volume
Provide daily/weekly QA reports with actionable insights
3. Feedback & Coaching
Deliver structured feedback to annotators
Conduct calibration sessions to ensure alignment on guidelines
Support Team Leads in coaching low-performing annotators
4. Guideline Adherence & Improvement
Ensure strict compliance with annotation guidelines and client requirements
Flag ambiguous cases and recommend guideline improvements
Collaborate with Ops/Training teams to refine SOPs
5. Process Improvement
Identify trends and recurring quality issues
Recommend workflow enhancements to improve accuracy and efficiency
Support pilot runs and new workflow validation
Key Metrics (KPIs)
Annotation Accuracy (%)
QA Pass Rate
Error Rate / Defect Density
Turnaround Time (TAT) for QA reviews
Rework Reduction Rate
Qualifications
Bachelor’s degree or equivalent experience
1–2 years experience in QA, data annotation, or BPO operations (preferred)
Strong attention to detail and analytical skills
Experience reviewing datasets (image, text, or video) is a plus
Familiarity with annotation tools (e.g., CVAT, Labelbox, etc.) is an advantage
Tools & Systems (Nice to Have)
Annotation platforms (CVAT, Labelbox, Supervisely)
Google Sheets / Excel for tracking and reporting
QA dashboards or internal tools
Candidate Data & Privacy NoticeBy submitting your application to Expedock, you acknowledge and consent to the collection, use, and processing of your personal information for recruitment and hiring purposes. Your information will be used to:
Evaluate your qualifications and suitability for current and future roles
Communicate with you throughout the recruitment process, improve our hiring processes, and overall candidate experience
Maintain talent pools for future opportunities, where permitted by law
We handle candidate data with care and in accordance with applicable data protection and privacy regulations. Your information will only be accessed by authorized team members and will not be shared with third parties without your consent, unless required by law.
Apply Now