Platform Engineer — Core Infrastructure

About Us

100ms operates two product lines at scale: a real-time Live Video platform powering latency-sensitive, high-concurrency video experiences, and an AI Agents platform that automates complex patient access workflows in U.S. healthcare.

Both products run on a shared, robust infrastructure foundation. You'll be joining the central platform team responsible for keeping both running reliably, securely, and at scale — serving developers and healthcare operators who depend on us around the clock.

What Will You Do:
• Own and operate production infrastructure across multiple GKE clusters supporting both real-time video workloads and AI agent pipelines — with HA, autoscaling, and full observability tuned to the demands of each.

•
Manage GitOps workflows using Argo CD for automated, version-controlled, and auditable deployments across both product lines.

•
Maintain and optimize monitoring & alerting stacks using Open Source Monitoring Tools — with product-specific SLOs for low-latency video (jitter, packet loss, stream health) and AI workflow reliability (task throughput, failure rates, retry queues).

•
Implement infrastructure as code using Terraform for GCP resources and helm chart for Kubernetes manifests, with a strong bias toward repeatability and auditability.

•
Support the unique infrastructure demands of real-time video — including media server scaling, WebRTC infrastructure, low-latency networking, and high-throughput data paths.

•
Support AI agent workloads — including LLM inference infrastructure, async task queues, and integration pipelines with external healthcare systems.

•
Lead or support incident response, cluster upgrades, and disaster recovery procedures across both platforms.

•
Own the security posture of our infrastructure — enforce least-privilege access controls, manage secrets hygiene, and drive security hardening across clusters and services.

•
Implement and maintain compliance-aligned controls relevant to healthcare data environments (e.g., encryption at rest/in transit, audit logging, network segmentation).

•
Collaborate with product and engineering teams to embed security early in the development lifecycle — shift-left on vulnerability scanning, dependency audits, and policy enforcement.

Who Can Apply:
•
Computer Science / Engineering degree or equivalent practical experience.

•
Minimum 3 years of hands-on experience with Kubernetes in a production environment.

•
Strong knowledge of CI/CD pipelines and GitOps workflows using Argo CD or similar tools.

•
Proficient in infrastructure automation using Terraform and Helm.

•
Experience in managing open source monitoring and logging stacks (Prometheus, Loki, Grafana, Alertmanager etc).

•
Working knowledge of cloud security principles — IAM, network policies, pod security, RBAC, and secrets management.

•
Comfortable with Linux systems, shell scripting, and basic networking — including an understanding of UDP/TCP behaviour relevant to real-time media or distributed systems.

Good to Have:
•
Prior experience managing large-scale, multi-tenant or mixed-workload infrastructure.

•
Exposure to real-time media infrastructure — WebRTC, SFUs, TURN/STUN servers, or media server orchestration.

•
Hands-on experience with secrets management tools such as HashiCorp Vault or Sealed Secrets.

•
Familiarity with security scanning and policy tools (e.g., Trivy, OPA/Gatekeeper, Falco).

•
Experience with GCP and GKE specifically.

•
Exposure to compliance frameworks relevant to healthcare or regulated industries (HIPAA awareness is a plus).

•
Experience with AI/ML inference workloads or async pipeline infrastructure (queues, workers, orchestrators).

•
Experience with open source contributions.

•
Strong inclination to stay current with evolving infrastructure, security, and platform engineering practices — and a willingness to share ideas internally or externally.

•
Ability to communicate fluently and clearly in English, written and spoken.

Why 100ms:
•
You'll work on genuinely varied infrastructure — real-time video at scale and AI-driven healthcare automation are both hard problems with different constraints, and you'll own both.

•
You'll be part of a small, high-ownership team at a fast-growing, engineering-first startup with a meaningful mission — powering real-time experiences and helping patients access treatment faster.

•
You'll work alongside engineers with deep experience in distributed systems, real-time media, AI infrastructure, and platform engineering at scale.

•
You'll have the freedom to grow as an individual contributor or step into a team leadership role — with room to define your own goals and impact.

•
Security and infrastructure are first-class concerns here, not support functions — your work directly shapes the trust and reliability our customers depend on.

Additional Information:
•
We place a strong emphasis on in-office collaboration to maintain a tight feedback loop and a strong engineering culture.

•
Employees are expected to work from the office at least three days a week.

Website:
• https://www.100ms.ai/

• https://www.100ms.live