Data Engineer

About Us

Abacus Insights is transforming how data works for health plans. Our mission is simple: make healthcare data usable, so the people responsible for care and cost decisions can act faster, with confidence.
We help health plans break down data silos to create a single, trusted data foundation. That foundation powers better decisions —so plans can improve outcomes, reduce waste, and deliver better experiences for members and providers alike.

Backed by $100M from top investors, we’re tackling big challenges in an industry that’s ready for change. Our platform enables GenAI use cases by delivering clean, connected, and reliable healthcare data that can support automation, prioritization, and decision workflows—and it’s why we are leading the way.

Our innovation begins with people. We are bold, curious, and collaborative—because the best ideas come from working together. Ready to make an impact? Join us and let's build the future together.

About the Role

Our Connector Factory team is looking for a Data Engineer to join our growing Tech Ops division. In this role, you’ll work closely with clients, data vendors, and internal teams to integrate data into our modern data platform built on scalable and resilient cloud architectures. You’ll help ensure accurate data ingestion and transformation, supporting the successful adoption of Abacus’s core data management solutions.

Your day to day

• Collaborate with clients and implementation teams to understand data distribution requirements.

• Develop and maintain data pipelines using Databricks and Snowflake to ensure data accuracy and integrity.

• Build ETL workflows and optimize data processes for efficiency and scalability.

• Translate business requirements into technical solutions in partnership with cross-functional teams.

• Implement best practices for data security and compliance with healthcare regulations.

• Document processes, workflows, and technical specifications to support ongoing improvements.

What you bring to the team

• Bachelor’s degree in Computer Science, Engineering, or related field.

• Proficiency in Python and SQL for data processing and analysis.

• Experience building and managing ETL pipelines using Databricks workflows or similar tools.

• Familiarity with structured and semi-structured data and processing with PySpark.

• Basic knowledge of cloud services such as AWS (S3, SQS) or equivalent.

• Understanding of version control and CI/CD tools (e.g., GitLab).

• Ability to optimize queries and troubleshoot performance issues in SQL or SparkSQL.

• Exposure to data warehousing technologies like Snowflake or similar platforms.

What we would like to see, but not required:

• Experience with DBT or Kafka.

• Knowledge of healthcare data domains (e.g., claims, eligibility).

• Familiarity with Terraform and infrastructure-as-code concepts.

Our Commitment as an Equal Opportunity Employer

As a mission-led technology company helping to drive better healthcare outcomes, Abacus Insights believes that the best innovation and value we can bring to our customers comes from diverse ideas, thoughts, experiences, and perspectives. Therefore, we dedicate resources to building diverse teams and providing equal employment opportunities to all applicants. Abacus prohibits discrimination and harassment regarding race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

At the heart of who we are is a commitment to continuously and intentionally building an inclusive culture—one that empowers every team member across the globe to do their best work and bring their authentic selves. We carry that same commitment into our hiring process, aiming to create an interview experience where you feel comfortable and confident showcasing your strengths. If there’s anything we can do to support that—big or small—please let us know.