Assessment Consultant

Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span:

ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output.

Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.

Role Overview

We are seeking a detail-oriented and motivated Assessment Consultant to join our team. In this role, you will act as a fully independent professional contributor responsible for developing and validating assessments, applying judgment to moderately complex problems, and improving assessment quality. The role contributes directly to assessment design decisions and delivers insights that influence stakeholder outcomes.

Key Responsibilities:
• Independently develop and validate assessment tools across multiple formats.
• Conduct job analyses and synthesize competencies into assessment requirements.
• Apply psychometric methods to analyze assessment data and interpret results.
• Build and maintain analytical reports and dashboards, including PowerBI outputs.
• Partner with subject matter experts and stakeholders to align assessments with business needs.
• Identify opportunities to improve assessment methodologies and processes.
• Provide guidance and informal mentoring to junior team members.
• Ensure compliance with legal, ethical, and professional standards.

Qualifications:
• Bachelor’s degree in Industrial-Organizational Psychology, Psychometrics, Data Analytics, or related field.
• Strong understanding of psychometric principles and validation techniques.
• 3+ years hands-on experience developing and analyzing assessments.
• Proficiency in statistical tools (e.g., SPSS, R) and reporting platforms.
• Ability to work independently with limited supervision.
• Native or near-native fluency in English.
• Experience with computerized adaptive testing and item response theory.
• Knowledge of legal and professional guidelines related to employee selection and assessment.
• Previous experience in a consulting or client-facing role is a plus