Data Engineering Lead, AVP

Lead the design, build, and operation of trusted analytical data products on the Target State xData Platform. Own end‑to‑end delivery of complex batch and streaming data pipelines, curated Lakehouse datasets, and analytics‑ready models supporting Core Reference Data, Security Master, IBOR Holdings & Transactions, Datahub, Stamford Data Warehouse, and many other data initiatives. Partner closely with Platform Engineering and Data Platform Architecture to deliver scalable, governed, and production grade data solutions.

Key Responsibilities

• Lead the design and delivery of scalable batch and streaming data pipelines using Databricks, Snowflake, Spark, and/or Informatica ETL (where reused)
• Own end‑to‑end implementation of Iceberg‑based lakehouse tables, including partitioning strategies, schema evolution, and metadata management
• Define and enforce engineering standards for pipeline reliability, performance optimization, testing, and production readiness
• Lead logical and physical data modeling for analytical domains, ensuring consistent and correct business semantics
• Partner with domain SMEs to define data semantics, stewardship expectations, and consumption contracts
• Oversee implementation of data quality rules, reconciliation checks, lineage capture, and observability
• Review designs and code to ensure alignment with architectural standards, platform guardrails, and enterprise governance requirements
• Collaborate with Platform Engineering on CI/CD adoption, deployment standardization, and operational readiness
• Own production stability for data products, including incident management, root cause analysis, backfills, and continuous reliability improvements
• Mentor and guide data engineers, driving engineering excellence through reviews, best practices, and continuous improvement

Qualifications

• Strong hands-on data engineering experience with Python, Java, and SQL
• Advanced expertise in Spark and SQL, including performance optimization and large-scale debugging
• Hands-on experience with Snowflake and Databricks as analytical data platforms
• Deep working knowledge of Apache Iceberg and open table formats
• Strong understanding of distributed data processing and hyperscale analytics
• Experience building and operating production grade data pipelines in AWS, Azure, and/or GCP.
• Solid understanding of curated analytical models and data product design
• Experience with CI/CD, automated testing, and production support practices
• Financial or enterprise data platform background preferred but not required

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement