Forward Deployed Engineer

About BentoML

BentoML is a leading inference platform provider that helps AI teams run large language models and other generative AI workloads at scale. With support from investors such as DCM, enterprises around the world rely on us for consistent scalability and performance in production. Our portfolio includes both open source and commercial products, and our goal is to help each team build its own competitive advantage through AI.

Role

Forward Deployed Engineers sit at the intersection of core engineering, product strategy, and customer success. You’ll partner directly with customers to understand real-world problems, then design, build, and launch production-ready AI solutions on the Bento platform. You’ll own engagements from first conversation to production rollout, while feeding insights back into our core product and engineering.

Example projects:

• https://bentoml.com/blog/comfy-pack-serving-comfyui-workflows-as-apis

• https://bentoml.com/blog/neurolabs-faster-time-to-market-and-save-cost-with-bentoml

• https://bentoml.com/blog/accelerating-ai-innovation-at-yext-with-bentoml

Responsibilities

• Own projects end-to-end. Scope, architect, and ship full-stack AI/ML systems using Python (and any language that gets the job done). You’ll collaborate closely with engineering teams, balancing speed with reliability and security.

• Build innovative solutions. Optimize and deploy state-of-the-art models, tune inference pipelines, and push the boundaries of performance, cost, and scale.

• Own customer relationships. Serve as the primary technical point-of-contact, guiding customers from prototype to production and ensuring long-term success.

• Act as a product manager in the field. Capture qualitative and quantitative feedback, synthesize themes, and translate them into clear product requirements that influence our roadmap.

• Publish and share your work. Write blog posts, open-source examples, and conference talks that expand what’s possible with AI inference.

Qualifications

• Demonstrated skill building ML pipelines, model inference, and AI agents.

• Ability to navigate ambiguity, make pragmatic technical trade-offs, and drive projects to completion with minimal oversight.

• Excellent written and verbal communication skills; you comfortably translate deep technical topics for diverse audiences.

• Entrepreneurial mindset; you thrive in fast-moving environments and enjoy wearing multiple hats.

Why join us

• Global impact. Your projects power customer products used by millions worldwide.

• Cutting-edge AI. Work daily with the latest open-source and proprietary models, shaping how they’re applied in production.

• Influence product direction. Your field insights directly steer both our open-source libraries and commercial platform.

• Remote-first culture. Work where you’re happiest, supported by asynchronous processes and quarterly in-person meet-ups.

• Showcase your expertise. We celebrate and amplify your blog posts, sample repos, and conference talks to the broader community.