Data Engineer

About Us

Abacus Insights is changing the way healthcare works for you. We’re on a mission to unlock the power of data so health plans can enable the right care at the right time—making life better for millions of people. No more data silos, no more inefficiencies. Just smarter care, lower costs, and better experiences.

Backed by $100M from top VCs, we’re tackling big challenges in an industry that’s ready for change. And while GenAI is still new for many, we’ve already mastered turning complex healthcare data into clear, actionable insights. That’s our superpower—and it’s why we’re leading the way.

Abacus, innovation starts with people. We’re bold, curious, and collaborative—because the best ideas come from working together. Ready to make an impact? Join us and let's build the future, together.

About the Role:

We are seeking an experienced Data Engineer to join our Connector Factory team. This role offers an opportunity to be a key contributor in a critical feature delivery team, where your expertise will guide the evolution of our data pipeline infrastructure. Our team is responsible for the development and operation of data pipelines that handle diverse data sources through both large batch and streaming systems. You'll work extensively with AWS services and play a crucial role in driving the growth and innovation of our platform.

Your Day to Day

• Architect, build, and maintain data pipelines and ETL processes utilizing tools such as Databricks, Snowflake, SQL, and PySpark.

• Play a pivotal role in creating and optimizing data assets to uphold high standards of data quality, performance, and reliability.

• Actively monitor and troubleshoot data pipelines to ensure efficient and uninterrupted data distribution.

• Partner with the Connector Factory team and cross-functional teams to understand client data requirements and transform these into scalable data solutions.

• Apply Agile methodologies and best practices to drive incremental improvements and adapt to emerging requirement.

• Keep communication channels open with stakeholders to gather and clarify requirements and provide regular updates on project progress.

• Stay committed to data privacy, security, and regulatory compliance, particularly given the sensitive nature of healthcare data.

• Work in FHIR (Fast Healthcare Interoperability Resources) framework.

What you bring to the team

• Bachelor’s degree in computer science, Engineering, or a related field.

• 2-4 years of experience in data engineering, software engineering, or a related field.

• Proficiency in SQL, Python, and experience with big data tools such as PySpark or Spark.

• Familiarity with cloud platforms (e.g., AWS, Azure, or Google Cloud) and building scalable, distributed systems.

• Experience in data analysis and modeling, with the ability to work with large datasets. Strong analytical and problem-solving skills, with a proven ability to address complex data challenges.

• Experience managing technical projects and ensuring timely delivery.

• Eagerness to learn new technologies and adapt to shifting project requirements.

• Understanding of Agile delivery frameworks and project management practices.

Working Conditions

• Standard hours: 9 hours/day; 5 days/ week

• Work time: 10AM - 7 PM

• Work Mode: Onsite

Our Commitment as an Equal Opportunity Employer

As a mission-led technology company helping to drive better healthcare outcomes, Abacus Insights believes that the best innovation and value we can bring to our customers comes from diverse ideas, thoughts, experiences, and perspectives. Therefore, we dedicate resources to building diverse teams and providing equal employment opportunities to all applicants. Abacus prohibits discrimination and harassment regarding race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

At the heart of who we are is a commitment to continuously and intentionally building an inclusive culture—one that empowers every team member across the globe to do their best work and bring their authentic selves. We carry that same commitment into our hiring process, aiming to create an interview experience where you feel comfortable and confident showcasing your strengths. If there’s anything we can do to support that—big or small—please let us know.