Lead Data Engineer

Important Information

Location: Brazil
Job Mode: Full-time
Work Mode: Work from home

Job Summary

We are seeking a highly experienced Data Engineer Lead to architect, develop, and deliver robust, scalable, end-to-end automation solutions. This role demands deep technical expertise across solution architecture, environment setup, deployments, observability, governance, and continuous improvement. The ideal candidate is a strong technical leader and communicator who partners closely with business stakeholders to define automation strategies and deliver high-impact, enterprise-grade solutions.

Responsibilities and Duties

• Lead and mentor a team of data engineers, providing technical guidance, code reviews, and best practices to ensure high-quality deliverables;

• Own the end-to-end data migration strategy from Snowflake on AWS to Azure Databricks and DBT, including planning, execution, and optimization;

• Collaborate with cross-functional stakeholders (data, product, architecture, and business teams) to align data initiatives with organizational goals;

• Architect and oversee scalable, secure, and reliable data pipelines and infrastructure in Azure;

• Drive the design and implementation of infrastructure-as-code using Terraform, ensuring consistency and maintainability;

• Ensure efficient data integration between Snowflake and Azure environments, establishing robust and scalable data flows;

• Oversee data transformation frameworks using Databricks and DBT, promoting reusable and modular design patterns;

• Establish and enforce data engineering standards, governance practices, and CI/CD workflows;

• Proactively identify risks, troubleshoot complex technical issues, and implement long-term solutions;

• Lead documentation efforts for architecture, processes, and best practices across the data platform.

Essential Skills

• Experience in Data Engineering;

• Proven experience leading data engineering teams and delivering large-scale data platform initiatives;

• Strong hands-on experience with Snowflake, Azure Databricks, and DBT;

• Deep expertise in cloud infrastructure and infrastructure-as-code tools, especially Terraform;

• Extensive experience with cloud data migration projects (AWS to Azure preferred);

• Strong experience with CI/CD pipelines and Git-based version control;

• Advanced proficiency in SQL, data modeling, and ETL/ELT design patterns;

• Strong understanding of data architecture, scalability, and performance optimization;

• Ability to operate in a fast-paced, collaborative, and evolving environment;

• Mandatory experience in the insurance industry, with understanding of insurance data domains (policies, claims, underwriting, etc.).

Highly Desirable Skills

• Experience with data governance frameworks (data cataloging, lineage, quality, and observability tools);

• Knowledge of security and compliance standards relevant to insurance and financial data;

• Familiarity with streaming and real-time data processing (Kafka, Event Hubs, Delta Live Tables);

• Experience designing lakehouse architectures and implementing cost-optimization strategies;

• Exposure to multi-cloud environments and advanced automation practices.

About Encora

Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.

At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.