Data Flow Engineer

InventYOU AB

Warsaw, Masovian Voivodeship, Poland permanent

Posted: May 5, 2026

Required Skills

Job Description

We are looking for an external consultant, Data Flow Engineer, to join our team and support data integration, big data streaming, and flow management initiatives. The role focuses on designing, implementing, and maintaining complex data flows using modern data engineering tools and platforms, with emphasis on Apache NiFi, data streaming, and real-time data processing within enterprise environments.

Key Responsibilities

• Design, implement, test, and maintain complex data flows using Apache NiFi (Cloudera DataFlow)
• Build and optimise CDC-based data pipelines (real-time / near real-time)
• Integrate data flows with external systems using REST APIs, JDBC, Kafka, and other protocols
• Manage data ingestion, transformation, enrichment, routing, and delivery processes
• Configure and maintain data schemas, metadata, and lineage
• Implement and manage security and governance policies for data flows
• Monitor, troubleshoot, and optimise performance and reliability of data pipelines
• Collaborate with data engineers, architects, and business stakeholders
• Create and maintain documentation, SOPs, and runbooks
• Participate in platform upgrades, migrations, and continuous improvement activities

Requirements:
• Minimum 8 years of overall IT experience
• Minimum 6 years of experience in similar positions
• Experience working with Apache NiFi / Cloudera DataFlow environments
• Strong experience in data integration and data flow design
• Advanced Python programming skills (data processing, automation, integrations)
• Strong experience building integrations using REST APIs (OAuth/JWT, error handling, rate limiting)
• Hands-on experience with CDC pipelines and relational database integrations
• Experience with Apache Kafka and data streaming architectures
• Knowledge of Apache Avro and schema evolution concepts
• Experience with Apache Iceberg (tables, schema evolution, partitioning)
• Knowledge of data governance tools such as Apache Atlas and Apache Ranger
• Experience working in CDP (Cloudera Data Platform) environments
• Strong analytical and problem-solving skills
• Fluency in English (minimum B2 level)
• Minimum education level equivalent to Level 6 qualification
• Valid Security Clearance is mandatory

Certifications (mandatory):

• At least one of the following:
• Cloudera Certified Developer for Apache NiFi (or equivalent)
• Cloudera DataFlow (CFM) certification (or equivalent internationally recognised certification)

You will be a great candidate for us if you

• Have strong hands-on experience with Apache NiFi in production environments
• Are comfortable working with complex data integration and streaming architectures
• Can design and optimise real-time data pipelines
• Have a structured and detail-oriented approach to data engineering
• Are able to work independently and deliver high-quality solutions
• Collaborate effectively with technical and business teams

Benefits:
Why join inventYOU

• Work on complex and large-scale data engineering environments
• Contribute to modern data integration and streaming architectures
• Collaborate with experienced data engineers and architects
• Be part of technically challenging and high-impact projects
• Develop your expertise in big data, streaming, and data flow technologies

Why Apply Through MisuJob?

AI-Powered Job Matching: MisuJob uses advanced artificial intelligence to analyze your skills, experience, and career goals. Our matching algorithm compares your profile against thousands of job requirements to find positions where you have the highest chance of success. This saves you hours of manual job searching and ensures you only see relevant opportunities.

One-Click Applications: Once you create your profile, applying to jobs is effortless. Your resume and cover letter are automatically tailored to highlight the most relevant experience for each position. You can apply to multiple jobs in minutes, not hours.

Career Intelligence: Beyond job matching, MisuJob provides valuable career insights. See how your skills compare to market demands, identify skill gaps to address, and understand salary benchmarks for your experience level. Make data-driven decisions about your career path.

Frequently Asked Questions

How do I apply for this position?

Click the "Register to Apply" button above to create a free MisuJob account. Once registered, you can apply with one click and track your application status in your dashboard.

Is MisuJob free for job seekers?

Yes, MisuJob is completely free for job seekers. Create your profile, get matched with jobs, and apply without any cost. We help you find your dream job without any hidden fees.

How does AI matching work?

Our AI analyzes your resume, skills, and experience to understand your professional profile. It then compares this against job requirements using natural language processing to calculate a match percentage. Higher matches mean better fit for the role.

Can I apply to jobs in other countries?

Absolutely. MisuJob features jobs from companies worldwide, including remote positions. Filter by location or look for remote opportunities to find jobs that match your preferences.

Ready to Apply?

Join thousands of job seekers using MisuJob's AI to find and apply to their dream jobs automatically.