Senior Data Engineer

We are seeking a Data Engineer for a short-term, 8-week engagement to support the implementation of a Databricks Lakehouse on AWS for a global manufacturing client. The project focuses on modernizing financial data workflows by centralizing, automating, and governing data across multiple ERP systems.

The role involves building and maintaining ETL/ELT pipelines, developing transformations and data models in Databricks, supporting infrastructure setup, and implementing data governance and security practices. You’ll work closely with architects, stakeholders, and other engineers to deliver a proof-of-capability solution that replaces manual Excel-based reporting processes.

This position is ideal for an engineer experienced with Databricks, PySpark, and AWS, comfortable working in discovery-driven environments, and able to balance immediate project delivery with foundational data architecture work.

Key Responsibilities

• Build and maintain ERP data ingestion pipelines (e.g., SyteLine, Epicor iScala)

• Develop data transformation workflows across Lakehouse layers

• Implement data models for financial reporting (GL and sub-ledger focus)

• Configure and support Databricks infrastructure and clusters

• Apply data governance, security, and access controls using Unity Catalog

• Collaborate with architects and stakeholders on data architecture, compliance, and regulatory requirements

• Contribute to documentation, runbooks, and knowledge transfer

• Support delivery of reporting datasets and dashboards with validated accuracy

Required Skills & Qualifications

• 5+ years of professional experience in data engineering or similar roles

• Strong hands-on experience with Databricks and Apache Spark (PySpark)

• Solid SQL skills and experience with data transformations, modeling, and ETL/ELT pipelines

• Experience working with ERP or financial data systems

• Familiarity with AWS services and cloud-based data platforms

• Knowledge of data governance, security, and regulatory compliance requirements

• Comfortable working in complex, ambiguous, or inconsistent ERP data environments

• Strong collaboration and communication skills for technical and non-technical stakeholders

• Upper-intermediate English, written and spoken.

Nice to Have

• Experience with regulated or secure data environments.

• Prior involvement in data modernization or financial reporting automation projects.

• Exposure to version control workflows (GitHub) and CI/CD practices for data pipelines.

Soft Skills & Personal Competencies

• Quick learner, able to ramp up on existing systems and datasets.

• Pragmatic, solution-oriented approach to problem solving.

• Collaborative mindset and comfort working with distributed teams.

• Ability to balance short-term delivery with long-term foundational improvements.

Why Join Robots & Pencils?

At Robots & Pencils, you’ll join a global team of engineers, designers, and strategists who value engineering excellence, collaboration, and delivering solutions that make a real impact. You’ll contribute to a high-profile, short-term initiative while working in a supportive, innovative environment that encourages learning, ownership, and meaningful collaboration.