Data Quality Automation Engineer

About the project:

The Client provides comprehensive operational support and a range of expert services to the world’s leading insurers, brokers, fleet managers, and automotive manufacturers. 3,300 employees across ten countries deliver exceptional standards on a large scale for over 1,200 clients. We help the global insurance market to handle millions of claims each year in the most cost-effective and efficient ways possible.

The Client is embarking on an exciting and challenging transformation program, and our software solutions are a driving force behind this strategy, using cloud computing and leading-edge design patterns.

Key Responsibilities

• Define and implement data quality rules across ingestion, transformation, and reporting layers

• Validate data in Databricks-based pipelines

• Monitor and test Databricks transformations (PySpark/SQL) for correctness and completeness

• Ensure Databricks / Power BI reports reflect accurate and reconciled data

• Set up data validation checks (schema, nulls, duplicates, ranges, referential integrity)

• Identify, log, and track data quality issues with root cause analysis

• Collaborate with data engineers and analysts to fix issues

• Build automated data quality monitoring and alerts

Required Skills

• 4-5+ years of Relevant work experience in data analysis, quality assurance, data governance, or a similar field is highly desirable.

• Strong knowledge of Databricks / Spark (SQL, PySpark)

• Understanding of ETL/ELT pipelines and data transformations (dbt)

• Experience validating BI/reporting outputs (Power BI preferred)

• SQL proficiency for data validation and reconciliation

• Familiarity with data quality frameworks/tools (e.g., Great Expectations is a plus)

Nice to Have

• Experience with AWS data stack

• Experience with data governance or data catalog tools

• Exposure to CI/CD for data pipelines

• Knowledge of data lineage and observability tools

Success Criteria

• Reduced data defects in pipelines and reports

• Automated data quality checks are in place

• Clear visibility and tracking of data issues

We offer*:

• Flexible working format - remote, office-based or flexible

• A competitive salary and good compensation package

• Personalized career growth

• Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)

• Active tech communities with regular knowledge sharing

• Education reimbursement

• Memorable anniversary presents

• Corporate events and team buildings

• Other location-specific benefits

*not applicable for freelancers