AI Infrastructure Engineer

Stack Ai

San Francisco, California, United States Remote permanent

Posted: September 3, 2025

Required Skills

Job Description

About the Role

We’re hiring an AI Infrastructure Engineer to shape and scale the backend systems that power our AI platform. As a Series A company, your work will be foundational, enabling safe, efficient, and reliable AI workflows from end to end.

What You’ll Do

• Design and implement scalable backend architectures for AI workloads (inference, orchestration, monitoring).

• Own distributed job orchestration with Temporal and related systems.

• Improve data pipeline performance by designing smarter caching strategies (e.g., file deduplication, hot/cold storage, Redis caching layers) to reduce redundant compute and API calls.

• Build observability, monitoring, retries, and fault tolerance into all workflows.

• Manage infrastructure reliability, incident response, and performance.

• Develop tooling and platform infrastructure to support rapid growth.

• Partner with ML engineers to bring models to production at scale.

What We’re Looking For

• 4+ years of backend engineering (Python is a must).

• Strong background in distributed systems, job orchestration, and task queues.

• Deep knowledge of concurrency, parallelism, and multithreading—including async/await, event loops, thread pools, synchronization primitives, deadlocks, and race conditions—is a must. You should know how to design systems that maximize throughput without sacrificing correctness or safety.

• Hands-on experience with Temporal, Redis, Airflow, Celery, RabbitMQ (or similar).

• Experience with LLM serving and routing fundamentals (rate limiting, streaming, load balancing, budgets).

• Comfortable with containers & orchestration: Docker, Kubernetes.

• Familiarity with cloud platforms (AWS/GCP) and IaC (Terraform).

• Experience with multiple storage systems: S3, Postgres, MongoDB, Redis, and Elasticsearch.

• Track record scaling systems in startups or fast-paced environments.

• Understanding of deploying, monitoring, and optimizing AI/ML systems in production with strong CI/CD practices.

Why You’ll Love Working Here

• Play a foundational role at a fast-growing Series A startup that is shaping the future of AI in enterprise workflows.

• Collaborate across Product, ML, and Platform teams, being the bridge between AI logic and scalable execution.

• Build infrastructure that enables real value for large enterprises: low-code, secure, and scalable AI workflows.

• Join a company that’s scaling thoughtfully and values developer experience.

Why Apply Through MisuJob?

AI-Powered Job Matching: MisuJob uses advanced artificial intelligence to analyze your skills, experience, and career goals. Our matching algorithm compares your profile against thousands of job requirements to find positions where you have the highest chance of success. This saves you hours of manual job searching and ensures you only see relevant opportunities.

One-Click Applications: Once you create your profile, applying to jobs is effortless. Your resume and cover letter are automatically tailored to highlight the most relevant experience for each position. You can apply to multiple jobs in minutes, not hours.

Career Intelligence: Beyond job matching, MisuJob provides valuable career insights. See how your skills compare to market demands, identify skill gaps to address, and understand salary benchmarks for your experience level. Make data-driven decisions about your career path.

Frequently Asked Questions

How do I apply for this position?

Click the "Register to Apply" button above to create a free MisuJob account. Once registered, you can apply with one click and track your application status in your dashboard.

Is MisuJob free for job seekers?

Yes, MisuJob is completely free for job seekers. Create your profile, get matched with jobs, and apply without any cost. We help you find your dream job without any hidden fees.

How does AI matching work?

Our AI analyzes your resume, skills, and experience to understand your professional profile. It then compares this against job requirements using natural language processing to calculate a match percentage. Higher matches mean better fit for the role.

Can I apply to jobs in other countries?

Absolutely. MisuJob features jobs from companies worldwide, including remote positions. Filter by location or look for remote opportunities to find jobs that match your preferences.

Ready to Apply?

Join thousands of job seekers using MisuJob's AI to find and apply to their dream jobs automatically.