Senior Data Scientist - ML Operations & Analytics

Filevine is forging the future of legal work with cloud-based workflow tools. We have a reputation for intuitive, streamlined technology that helps professionals manage their organization and serve their clients better. We’re also known for our team of extraordinary and passionate professionals who love working together to help organizations thrive. Our success has catapulted Filevine to the forefront of our field—we are ranked as one of the most innovative and fastest-growing technology companies in the country by both Deloitte and Inc.

Our Mission
Filevine is building the seamless intersection between legal and business by creating a world- class platform to help professionals scale.

Role Summary:
We're a team of driven, enthusiastic problem solvers with strong backgrounds in machine learning, engineering, product management, legal and operations, on a mission to help attorneys resolve cases faster, for better outcomes. With two established ML teams pushing boundaries in transcription, NLP and GenAI applications, we're now building a critical analytics layer to ensure operational excellence, quality assurance, and continuous improvement across all our AI systems.

Responsibilities:
• Build ML operations analytics tracking pipeline health, costs, latency, and quality metrics across all services
• Lead production LLM evaluation initiatives, designing custom metrics, quality monitoring and LLM observability in general
• Drive development efforts in collaboration with different ML teams based on analytics outputs
• Collaborate with our data annotation team on prompt engineering and evaluation dataset creation
• Help with curating the Filevine dataset
• Create actionable dashboards and insights for ML teams and leadership
• Help define SLAs, cost optimization and failure prevention strategies for our ML pipelines

Qualifications:
• 3+ years in data science, ML operations, or analytics engineering
• Experience with LLM evaluation frameworks and quality metrics design
• Strong Python, SQL, and data visualization skills
• Knowledge of prompt optimization techniques
• Deep understanding of latest trends in LLMs and their production deployments
• Excellent communication skills in English to translate technical metrics into business insights
• Collaborative mindset with ability to work across machine learning teams

This opportunity is for independent contractors and is not intended to establish an employment relationship. Contractors are responsible for their own taxes and compliance with applicable laws in their jurisdiction.

This role is open exclusively to candidates currently residing in, or willing to relocate to, Czechia or Slovakia with the legal right to work in these countries. Unfortunately, we are unable to consider applications from candidates based outside of these locations due to operational and regulatory requirements

Privacy Policy Notice
Filevine will handle your personal information according to what’s outlined in our Privacy Policy.