Senior AI Engineer (Databricks)

About Us

Abacus Insights is transforming how data works for health plans. Our mission is simple: make healthcare data usable, so the people responsible for care and cost decisions can act faster, with confidence.
We help health plans break down data silos to create a single, trusted data foundation. That foundation powers better decisions —so plans can improve outcomes, reduce waste, and deliver better experiences for members and providers alike.

Backed by $100M from top investors, we’re tackling big challenges in an industry that’s ready for change. Our platform enables GenAI use cases by delivering clean, connected, and reliable healthcare data that can support automation, prioritization, and decision workflows—and it’s why we are leading the way.

Our innovation begins with people. We are bold, curious, and collaborative—because the best ideas come from working together. Ready to make an impact? Join us and let's build the future together.

About the role

As a Senior AI Engineer, you will help architect, build and implement our AI platforms, working closely with data quality engineers, data/software engineers, platform engineers, DevOps, product owners and business. You provide technical leadership for multiple, diverse, and geographically distributed teams. You will coach and guide teams to enable future success. Also be a partner with engineering managers, directors and VP on strategic initiatives and future business growth opportunities especially around AI and ensuring the engineering organization can scale to meet the need.

As a member of the engineering team, you are responsible for coaching, mentoring, and driving change to enable us to deliver and innovate in an agile environment.

Your day to day

• Help shape the direction of our applied AI areas and intelligence features in our products. Drive the deployment of state-of-the-art AI models and systems that directly impacts on the capabilities and performance of Abacus’s products and services (e.g., Abacus Agents, MCP, SQL and RAG agents and tools, etc.)

• Develop novel data collection, fine-tuning, and LLM technologies that achieve optimal performance on specific tasks and domains

• Design and implement ML/AI pipelines for data preprocessing, feature engineering, model training, hyperparameter tuning, and model evaluation, enabling rapid experimentation, iteration and self-healing

• Work closely with cross-functional teams, including AI engineers, data engineers, and product teams, to deliver impactful AI solutions that enhance user productivity and satisfaction

• Build scalable, reusable backend systems to support GenAI products across the company. Develop robust logging, telemetry, and evaluation harnesses to ensure reliable model and GenAI system performance

• Skillful at driving critical projects (e.g. AI and data engineering Innovation, Development Productivity and Benchmarking)

• Meaningful experience in the world of Data and AI

• Capable of credible customer interactions

• Mentoring development team members to ensure delivered solutions adhere to the software architecture strategy, coding standards, and established organizational policies and procedures

• Participating in software architectural discussions, influencing decisions, and collaborating with peers to maintain consistency across the organization

• Identifying people and process improvement strategies for the Agile/Scrum team(s), especially for AI projects/teams where innovation and iteration are critical

• Communicate organizational updates to ensure teams adhere to the established policies and procedures

• Ensure projects are completed on time and according to our quality standards

• Facilitates communication upward around architecture, design, and implementation objectives

• Proven experience in leading software development teams or projects

• Excellent knowledge of software development design, QA and test automation, and experience with agile development methodologies

• Demonstrated knowledge of Cloud Architecture, AI Architecture, Agents/Agentic systems, Massive Parallel Processing (MPP) compute frameworks for Data+AI platforms, Security, and MCP/API based services

• Good understanding of Incident Management, Configuration Management, Operational efficiency and Customer Escalation Management preferred. Can manage the balance of deliveries on our roadmap commitments while dealing with interruptions and client escalations

• Good experience with open source

• Coach and mentor software and AI developers, develop staff skills, provide continuous feedback

• Has relentlessly high standards (is never satisfied with the status quo)

• Responsible for protecting, securing, and proper handling of all confidential data held by Abacus to ensure against unauthorized access, improper transmission, and/or unapproved disclosure of information that could result in harm to Abacus or our clients.

What you bring to the team

• 7-10 years of overall experience in software engineering or related discipline.

• 3-5 years of ML/AI engineering experience in high-velocity, high-growth companies. Alternatively, a strong background in relevant ML/AI research in academia will be considered as contributing qualification

• 2+ years of experience with Databricks, Mosaic AI Gateway and associated technologies in Databricks stack related to Data and AI engineering

• Strong track record of working with language modeling technologies and GenAI. This could include the following: Developing generative and embedding techniques, modern model architectures, fine tuning / pre-training datasets, evaluation benchmarks, Agents and Agentic workflows (e.g. orchestration, workflow management, observability, debugging), RAG, SQL Agents, MCP, etc.

• Proficiency in Python, TensorFlow/PyTorch, and scalable ML/AI architecture

• Ability to drive end-to-end model and system development, from research and prototyping to deployment and monitoring

• Strong analytical and problem-solving skills, with a passion for improving AI-driven user experiences

• Strong coding and software engineering skills, and familiarity with software engineering principles around testing, code reviews and deployment

• Experience and good understanding of designing scalable, distributed systems for running small to medium scale data processing applications and services (10s – 100s of TBs of data)

• Possesses a level of breadth and depth of software and AI development experience that allows for influence and competence in technical discussions with internal and external stakeholders

• Solid understanding of roles adjacent to the software development (product management, project management, client delivery, operations etc.). Ability to adapt to these roles as defined at Abacus and work with others in these roles

• Proven record of success of driving and/or leading engineering teams/projects towards developing production grade systems supporting customers

What we would like to see, but not required:

• Snowflake, FHIR, Healthcare Data exposure

What you’ll get in return

• Unlimited paid time off – recharge when you need it

• Work from anywhere – flexibility to fit your life

• Comprehensive health coverage – multiple plan options to choose from

• Equity for every employee – share in our success

• Growth-focused environment – your development matters here

• Home office setup allowance – one-time support to get you started

• Monthly cell phone allowance – stay connected with ease #LI-RF1 #LI-Remote

Our Commitment as an Equal Opportunity Employer

As a mission-led technology company helping to drive better healthcare outcomes, Abacus Insights believes that the best innovation and value we can bring to our customers comes from diverse ideas, thoughts, experiences, and perspectives. Therefore, we dedicate resources to building diverse teams and providing equal employment opportunities to all applicants. Abacus prohibits discrimination and harassment regarding race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

At the heart of who we are is a commitment to continuously and intentionally building an inclusive culture—one that empowers every team member across the globe to do their best work and bring their authentic selves. We carry that same commitment into our hiring process, aiming to create an interview experience where you feel comfortable and confident showcasing your strengths. If there’s anything we can do to support that—big or small—please let us know.