UX Engineer, LLM Experimentation Platform

About Arize

AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. That’s where we come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. From first prototype to production scale, Arize AX unifies build, test, and run in a single workspace—so teams can ship faster with confidence.

We’re a Series C company backed by top-tier investors, with over $135M in funding and a rapidly growing customer base of 150+ leading enterprises and Fortune 500 companies. Customers like Booking.com, Uber, Siemens, and PepsiCo leverage Arize to deliver AI that works.

The Opportunity

Most engineering teams treat UX refinement as an afterthought squeezed between feature work. We're carving out a dedicated role for it because we believe the difference between "works" and "delightful" is what separates good products from great ones. You'll have the space to really care about craft.

We're a technical team building for technical users (ML engineers, researchers) who are drowning in complexity. Your job is to make that complexity manageable and maybe even enjoyable. We're looking for an engineer who obsesses over the details that make complex tools feel effortless. You'll work on our LLM evaluation and prompt experimentation platform, taking functional features and refining them into intuitive, polished experiences.

What You’ll Do

• Refine and iterate on UX for existing features - you won't build from scratch, but you'll make things significantly better

• Watch real users struggle in Fullstory, identify friction points, and fix them

• Prototype interaction alternatives rapidly (in Figma or code) to test different approaches

• Work closely with our Senior engineers who own feature architecture - they build the foundation, you perfect the interface

• Own the "feel" of the product: transitions, feedback, error handling, progressive disclosure

• Build reusable interaction patterns that the team can leverage

• Run lightweight usability tests to validate improvements

A typical week might include:

• Watching 10 user sessions, identifying 3 common friction points

• Prototyping 2 different flows for evaluator configuration in Figma

• Implementing the winner with smooth transitions and helpful inline guidance

• Pairing with Staff engineers to refactor a complex form into a multi-step wizard

• Running a quick usability test with 5 users on the new onboarding flow

You're a great fit if:

• You've made products noticeably better through interaction refinement (show us!)

• You're comfortable with modern frontend frameworks and animation libraries

• You've used session replay tools and incorporated user feedback into designs

• You can work in Figma to prototype before committing to code

• You think about edge cases, loading states, and empty states automatically

• You've worked on complex tools (dev tools, data tools, B2B SaaS) where UX really matters

• Bonus: You've built or contributed to design systems

What you DON'T need:

• Formal design training (though it's welcome)

• Full-stack experience (we have engineers for that)

• Experience with our specific tech stack (we care more about your UX sensibility)

The estimated annual salary for this role is between $175,000 - $200,000, plus a competitive equity package. Actual compensation is determined based on a variety of job-related factors that may include transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness.

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.

More About Arize

Arize’s mission is to make the world’s AI work—and work for people.
Our founders came together through a shared frustration: while investments in AI are growing rapidly across every industry, organizations face a critical challenge—understanding whether AI is performing and how to improve it at scale.

Learn more about what we're doing here:

https://techcrunch.com/2025/02/20/arize-ai-hopes-it-has-first-mover-advantage-in-ai-observability/

https://arize.com/blog/arize-ai-raises-70m-series-c-to-build-the-gold-standard-for-ai-evaluation-observability/

Diversity & Inclusion @ Arize

Our company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture

• Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI

• Culturally conscious events such as LGBTQ trivia during pride month

• We have an active Lady Arizers subgroup