Quality Assurance (QA) Analyst – AI Data Annotation

About Expedock
We are a tech-enabled workforce augmentation platform leveraging top 1% offshore talent & cutting edge technology to enable businesses to unlock their full potential

Role Overview
The QA Analyst is responsible for ensuring the accuracy, consistency, and quality of annotated data across all workflows. This role plays a critical part in maintaining high-quality datasets used for training AI/ML models by auditing outputs, providing feedback, and driving continuous improvement among annotators.

Key Responsibilities

1. Quality Auditing

Review annotated data (images, text, video, or audio) based on defined guidelines

Perform random and targeted 25% sampling (initial)

Identify errors, inconsistencies, and edge cases

2. Error Analysis & Reporting

Categorize errors (e.g., labeling, bounding box accuracy, classification mistakes)

Track QA metrics such as accuracy rate, defect rate, and rework volume

Provide daily/weekly QA reports with actionable insights

3. Feedback & Coaching

Deliver structured feedback to annotators

Conduct calibration sessions to ensure alignment on guidelines

Support Team Leads in coaching low-performing annotators

4. Guideline Adherence & Improvement

Ensure strict compliance with annotation guidelines and client requirements

Flag ambiguous cases and recommend guideline improvements

Collaborate with Ops/Training teams to refine SOPs

5. Process Improvement

Identify trends and recurring quality issues

Recommend workflow enhancements to improve accuracy and efficiency

Support pilot runs and new workflow validation

Key Metrics (KPIs)

Annotation Accuracy (%)

QA Pass Rate

Error Rate / Defect Density

Turnaround Time (TAT) for QA reviews

Rework Reduction Rate

Qualifications

Bachelor’s degree or equivalent experience

1–2 years experience in QA, data annotation, or BPO operations (preferred)

Strong attention to detail and analytical skills

Experience reviewing datasets (image, text, or video) is a plus

Familiarity with annotation tools (e.g., CVAT, Labelbox, etc.) is an advantage

Tools & Systems (Nice to Have)

Annotation platforms (CVAT, Labelbox, Supervisely)

Google Sheets / Excel for tracking and reporting

QA dashboards or internal tools

<!-- notionvc: 5aa50ef1-6fb0-4458-880a-5825eb79a608 -->

Candidate Data & Privacy Notice
By submitting your application to Expedock, you acknowledge and consent to the collection, use, and processing of your personal information for recruitment and hiring purposes. Your information will be used to:

Evaluate your qualifications and suitability for current and future roles

Communicate with you throughout the recruitment process, improve our hiring processes, and overall candidate experience

Maintain talent pools for future opportunities, where permitted by law

We handle candidate data with care and in accordance with applicable data protection and privacy regulations. Your information will only be accessed by authorized team members and will not be shared with third parties without your consent, unless required by law.