Lead Cloud Data Engineer

Qode

South Carolina, South Carolina, United States Hybrid permanent

Posted: March 26, 2026

Quick Summary

We are looking for a highly experienced Data Engineer – AWS Tech Lead to design and lead scalable cloud-based data solutions. This role will combine hands-on engineering with leadership responsibilities, guiding a team of data engineers while collaborating with architects, product owners, and business stakeholders. The ideal candidate will have deep expertise in AWS data services, ETL/ELT pipelines, and big data frameworks, with proven experience in leading technical direction.

Required Skills

Job Description

Job Title: Lead Cloud Data Engineer
Locations: Fort Mill, SC or New York City, NY (Hybrid/Onsite)
Type: Full Time

Job Summary
We are looking for a highly experienced Data Engineer – AWS Tech Lead to design and lead scalable cloud-based data solutions. This role will combine hands-on engineering with leadership responsibilities, guiding a team of data engineers while collaborating with architects, product owners, and business stakeholders. The ideal candidate will have deep expertise in AWS data services, ETL/ELT pipelines, and big data frameworks, with proven experience in leading technical delivery.

Key Responsibilities
• Lead the design, development, and deployment of large-scale data pipelines and solutions on AWS.
• Provide technical leadership and mentorship to a team of data engineers, ensuring best practices in coding, architecture, and performance optimization.
• Architect data lake and data warehouse solutions leveraging AWS Glue, Redshift, S3, Athena, EMR, and Lambda.
• Drive development of ETL/ELT processes using PySpark, Python, and SQL.
• Implement and enforce data governance, quality checks, and security standards across the platform.
• Collaborate with business analysts, data scientists, and product teams to translate business requirements into scalable solutions.
• Optimize cost and performance of AWS-based data workloads.
• Troubleshoot production issues and ensure high availability of data pipelines.
• Participate in sprint planning, backlog refinement, and Agile ceremonies as a technical lead.

Required Qualifications
• 13+ years of experience in Data Engineering, with at least 4+ years in a technical leadership role.
• Strong expertise in AWS data services: Glue, S3, Redshift, Athena, Lambda, Step Functions, EMR.
• Proficiency in PySpark, Python, and SQL for large-scale data processing.
• Solid experience in data modeling (star, snowflake, dimensional modeling) and data lake/warehouse architectures.
• Proven track record in leading and mentoring data engineering teams.
• Strong understanding of Agile methodologies and CI/CD practices for data pipelines.

Preferred Qualifications
• Experience in BFSI / Wealth Management domain.
• AWS Certification (Data Analytics Specialty, Solutions Architect, or Big Data).
• Familiarity with containerization (Docker, Kubernetes) and orchestration frameworks.

Education
• Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field.
• Master’s degree preferred.

Why Apply Through MisuJob?

AI-Powered Job Matching: MisuJob uses advanced artificial intelligence to analyze your skills, experience, and career goals. Our matching algorithm compares your profile against thousands of job requirements to find positions where you have the highest chance of success. This saves you hours of manual job searching and ensures you only see relevant opportunities.

One-Click Applications: Once you create your profile, applying to jobs is effortless. Your resume and cover letter are automatically tailored to highlight the most relevant experience for each position. You can apply to multiple jobs in minutes, not hours.

Career Intelligence: Beyond job matching, MisuJob provides valuable career insights. See how your skills compare to market demands, identify skill gaps to address, and understand salary benchmarks for your experience level. Make data-driven decisions about your career path.

Frequently Asked Questions

How do I apply for this position?

Click the "Register to Apply" button above to create a free MisuJob account. Once registered, you can apply with one click and track your application status in your dashboard.

Is MisuJob free for job seekers?

Yes, MisuJob is completely free for job seekers. Create your profile, get matched with jobs, and apply without any cost. We help you find your dream job without any hidden fees.

How does AI matching work?

Our AI analyzes your resume, skills, and experience to understand your professional profile. It then compares this against job requirements using natural language processing to calculate a match percentage. Higher matches mean better fit for the role.

Can I apply to jobs in other countries?

Absolutely. MisuJob features jobs from companies worldwide, including remote positions. Filter by location or look for remote opportunities to find jobs that match your preferences.

Ready to Apply?

Join thousands of job seekers using MisuJob's AI to find and apply to their dream jobs automatically.

Interested in this position?