Senior Product Manager, Data & Retrieval

Why Harvey

At Harvey, we’re transforming how legal and professional services operate — not incrementally, but end-to-end. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come.

This is a rare chance to help build a generational company at a true inflection point. With 1000+ customers in 58+ countries, strong product-market fit, and world-class investor support, we’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched.

Our team is sharp, motivated, and deeply committed to the mission. We move fast, operate with intensity, and take real ownership of the problems we tackle — from early thinking to long-term outcomes. We stay close to our customers — from leadership to engineers — and work together to solve real problems with urgency and care. If you thrive in ambiguity, push for excellence, and want to help shape the future of work alongside others who raise the bar, we invite you to build with us.

At Harvey, the future of professional services is being written today — and we’re just getting started.

Role Overview

Harvey is building the AI platform for the world’s top legal and professional services teams. Our users rely on fast, accurate access to external legal data to perform research that underpins their most important work. As we scale, our Data & Knowledge organization sits at the center of this mission—turning raw, fragmented information into intelligent systems that power research and reasoning at global scale.

Our Data Team is responsible for ingesting, structuring, understanding, and retrieving millions of documents across jurisdictions, formats, and domains. Whether public or private, offline or online, our mission is to organize the world’s legal information and make it accessible, reliable, and useful.

We’re looking for a Product Manager with deep search, retrieval, and data platform expertise to lead the next generation of Harvey’s data engine as we 100× our capabilities. You will shape the strategy, roadmap, and architecture behind the systems that make advanced reasoning possible. The team owns end-to-end RAG (retrieval-augmented generation) pipelines across domains such as case law, legislation, tax code, and IP law across 50+ jurisdictions. As generation quality continues improving, retrieval quality has become the new frontier—and one of Harvey’s highest priorities.

If you’re passionate about large-scale data problems, complex information retrieval, and building the backbone of cutting-edge AI systems, we’d love to meet you.

What You'll Do

• Drive the roadmap and strategy for Harvey’s “Data Factory”, ensuring we scale our data 100x through new platforms that build the ‘legal index’ of the world

• Work with internal operations and external data providers to methodically expand coverage, accelerate execution, and improve dataset quality.

• Own and evolve Harvey’s end-to-end data architecture—from ingestion and transformation to storage, indexing, and retrieval—ensuring performance, reliability, and scalability for LLM-powered products.

• Partner with Applied AI engineers to build and optimize retrieval systems, embeddings, search models, and evaluation frameworks.

• Architect and oversee large-scale ingestion pipelines that aggregate, normalize, and continuously update millions of heterogeneous legal documents across global jurisdictions.

• Collaborate cross-functionally with Product Engineering, Applied AI, Research, and Platform teams to deliver high-quality production systems that support reasoning, summarization, and legal research workflows.

What You Have

• 5+ years of experience building or managing search, retrieval, recommendation, or data platforms at scale.

• Experience working with complex, heterogeneous, or domain-specific datasets with structured + unstructured data.

• Understanding of modern retrieval methods, including hybrid search (lexical + vector), dense retrieval, re-ranking, embeddings, chunking strategies, and index optimization.

• Hands-on experience with LLMs or RAG frameworks (evaluation, grounding, hybrid pipelines, query rewriting, LLM-as-a-judge, retrieval metrics).

• Ability to partner with engineers on technical architecture, with enough depth to challenge assumptions, propose solutions, and influence design.

• A product mindset for search—balancing user needs, domain complexity, and system constraints to propose high-leverage improvements.

Compensation Range

$178,500 - $241,500 USD

Please find our CA applicant privacy notice here.

#LI-ML1

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made by emailing [email protected]