Data Engineer - Multi-Cloud

UBDS Group is seeking a skilled Data Engineer to support the design, development, and optimisation of data platforms across complex transformation programmes. This role is suited to an engineer with hands-on experience in data pipelines, cloud platforms, and ETL processes, who is looking to further develop their expertise in a collaborative, delivery-focused environment.

You will contribute to building reliable, scalable data solutions that enable analytics, reporting, and operational use cases.

Key Responsibilities

• Develop and maintain data pipelines and ETL processes using cloud-native technologies (e.g. Spark)
• Support integration of cloud and on-premise data sources
• Assist in implementing event-driven data pipelines, improving performance and scalability
• Contribute to the development of data access layers and reusable ETL components
• Support the onboarding of new data sources, including preparation and transformation of datasets
• Work with senior engineers to implement data engineering best practices and standards
• Contribute to CI/CD pipelines and Infrastructure as Code (IaC) activities
• Operate within AWS and Azure environments, supporting deployment and maintenance of data solutions
• Work with services such as:
• AWS: EC2, EMR, S3, Lambda
• Azure: Blob Storage and related services

• Collaborate with wider teams to ensure data quality, reliability, and performance
• Participate in knowledge sharing and continuous improvement activities

Skills & Experience

Essential

• Experience in data engineering or ETL development
• Working knowledge of data pipelines and data processing frameworks (e.g. Spark or similar)
• Experience with cloud platforms (AWS and/or Azure; exposure to both preferred)
• Understanding of ETL processes and data integration concepts
• Basic experience with Infrastructure as Code (e.g. Terraform) and/or CI/CD tools (e.g. GitLab)
• Familiarity with key services such as:
• AWS: EC2, S3 (EMR/Lambda exposure beneficial)
• Azure: Blob Storage

• Understanding of version control and collaborative development practices
• Awareness of data security and governance considerations

Desirable

• Experience working with event-driven architectures or streaming technologies
• Exposure to data access layers or data platform design
• Experience in public sector or regulated environments
• Knowledge of cloud networking fundamentals
• Exposure to fraud, analytics, or large-scale data use cases

Security Requirements

• This role requires Security Clearance (SC).
• Candidates must be eligible and willing to undergo the clearance process.

Engineering Practices

• Developing understanding of DevOps and agile delivery practices
• Commitment to writing maintainable, scalable code
• Willingness to adopt automation and reusable patterns
• Participation in code reviews and team collaboration

Personal Attributes

• Eager to learn and develop technical skills
• Strong problem-solving ability
• Collaborative and team-oriented
• Comfortable working in fast-paced delivery environments

Benefits:
Why people choose to grow their careers at UBDS Group

Professionals choose to grow their careers at UBDS Group for its reputation as a dynamic and forward-thinking organisation that is deeply committed to both innovation and employee development. At UBDS Group, employees are given unique opportunities to work on cutting-edge projects across a diverse range of industries, exposing them to new challenges and learning opportunities that are pivotal for professional growth. The Group’s culture emphasises continuous improvement, offering ample training programs, mentorship, and the chance to gain certifications that enhance their skills and marketability.

UBDS Group fosters a collaborative environment where creativity and innovation are encouraged, allowing employees to contribute ideas and solutions that have a tangible impact on the company and its clients. This combination of professional development, a culture of innovation, and the opportunity to make meaningful contributions makes UBDS Group an attractive place for those looking to advance their careers and be at the forefront of technological and operational excellence.

Employee Benefits

• Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
• Private medical cover for you and your spouse/partner, offered via Vitality
• Discretionary bonus based on a blend of personal and company performance
• Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
• Electric Vehicle leasing with salary sacrifice
• Contributed Pension Scheme
• Death in service cover

About UBDS Group

At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.

Equal Opportunities

We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.