Senior Data Engineer(Azure/Apache Kafka)

Confidential

Not specified contract

Posted: February 25, 2026

Job Description

About Billigence:

Billigence is a boutique data consultancy with global outreach & clientele, transforming the way organizations work with data. We leverage proven, cutting-edge technologies to design, tailor, and implement advanced Business Intelligence solutions with high added value across a wide range of applications from process digitization through to Cloud Data Warehousing, Visualisation, Data Science, and Engineering or Data Governance. Headquartered in Sydney, Australia with offices around the world, we help clients navigate difficult business conditions, remove inefficiencies, and enable scalable adoption of analytics culture.

About the role:

We are seeking an experienced Senior Data Engineer with strong hands-on expertise in Microsoft Azure–based data platforms. The role focuses on development of scalable, high-performance data pipelines and streaming solutions. The ideal candidate will have deep experience with big data technologies, cloud-native services, and modern data engineering practices.

What you'll do:

Design, develop, and maintain scalable data pipelines on Microsoft Azure

Build and manage real-time and batch data processing solutions using Kafka, Spark, and Python

Develop and optimize ETL/ELT workflows using Azure Data Factory (ADF)

Work extensively with Databricks for large-scale data processing and analytics

Design, develop, and optimize Snowflake data models and queries

Write efficient and optimized SQL for data transformation and analysis

Process and manage structured and semi-structured data, including XML and JSON formats

Collaborate with cross-functional teams to support data-driven solutions

Ensure data quality, reliability, performance, and scalability of data systems

Follow best practices for cloud infrastructure, security, and performance optimization

What you'll need:

Apache Kafka (Queue-based messaging / streaming) – Strong hands-on experience

Python – Advanced development skills

Apache Spark – Strong experience in distributed data processing

Databricks – Hands-on experience in development and data engineering workflows

Azure Data Factory (ADF) – ETL/ELT pipeline development

Snowflake – Data warehousing and SQL optimization

SQL – Advanced querying and performance tuning

XML & JSON – Strong understanding of data structures and transformations

Scala – Basic working knowledge

Benefits:

Hybrid/remote working environment, allowing you a flexible work-life balance to thrive both in the office and from the comfort of your home.

Competitive compensations package + performance bonus.

Referral bonus scheme.

Coaching, mentoring, and buddy scheme (for faster integration during the probationary period)

Certification opportunities throughout your time with us.

Career growth support, internal moves, and career advancement opportunities.

Team building and networking events.

Why Apply Through MisuJob?

AI-Powered Job Matching: MisuJob uses advanced artificial intelligence to analyze your skills, experience, and career goals. Our matching algorithm compares your profile against thousands of job requirements to find positions where you have the highest chance of success. This saves you hours of manual job searching and ensures you only see relevant opportunities.

One-Click Applications: Once you create your profile, applying to jobs is effortless. Your resume and cover letter are automatically tailored to highlight the most relevant experience for each position. You can apply to multiple jobs in minutes, not hours.

Career Intelligence: Beyond job matching, MisuJob provides valuable career insights. See how your skills compare to market demands, identify skill gaps to address, and understand salary benchmarks for your experience level. Make data-driven decisions about your career path.

Frequently Asked Questions

How do I apply for this position?

Click the "Register to Apply" button above to create a free MisuJob account. Once registered, you can apply with one click and track your application status in your dashboard.

Is MisuJob free for job seekers?

Yes, MisuJob is completely free for job seekers. Create your profile, get matched with jobs, and apply without any cost. We help you find your dream job without any hidden fees.

How does AI matching work?

Our AI analyzes your resume, skills, and experience to understand your professional profile. It then compares this against job requirements using natural language processing to calculate a match percentage. Higher matches mean better fit for the role.

Can I apply to jobs in other countries?

Absolutely. MisuJob features jobs from companies worldwide, including remote positions. Filter by location or look for remote opportunities to find jobs that match your preferences.

Ready to Apply?

Join thousands of job seekers using MisuJob's AI to find and apply to their dream jobs automatically.