RL Environments Specialist

About xAI

xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All engineers are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

About the Role

We need talented engineers that will create full RL environments (UI, backend, programmatically generate tasks and validation) for training computer use agents. This means that we need you to take ownership of the entire task creation process for a given environment.

In this role, you will

• Build sandbox UIs that our agents and RL actors will interact with.

• Create tasks for built environments and programmatically validate task completion.

• Enjoys working remotely

Qualifications

• Strong professional experience with React.js (hooks, modern state management, TypeScript preferred) — required

• Strong professional experience building backend services in Python (FastAPI, Flask, or Django) — required

• Hands-on experience with containerization (Docker required; Docker Compose/Kubernetes a plus)

• Strong front-end design skills and exceptionally high taste in UI/UX, polish, and visual detail

• Proven ability to design a relational database schema in Python and populate it with large-scale, realistic mock data

• Experience creating and exposing clean, well-documented API endpoints (REST or GraphQL)

• Exceedingly high standards for code quality, readability, testing, and front-end craftsmanship

• Extensive day-to-day experience using coding agents / AI assistants as a power user (Cursor, Claude, Copilot, Grok, Aider, etc.)

• Good understanding of the Reinforcement Learning paradigm (RLHF, PPO, DPO, reward modeling, etc.)

Preferred Qualifications

• Posses strong logical reasoning skills, is detail-oriented, and thrives in a fast-paced work environment.

• Eager to teach to and learn from teammates.

• Enthusiasm to collaboratively build the best truth-seeking AI out there!

Interview Process

• Technical hands-on live coding round

• Hiring Manager / Final interview round

Compensation and Benefits

• The pay for this role may range from USD $35/hour - $100/hour.

• Your actual pay will be determined on a case-by-case basis and may vary based on the following considerations: location, job-related knowledge and skills, education, and experience.

• Top performers may be considered for MTS positions within xAI.

xAI is an equal opportunity employer.

California Consumer Privacy Act (CCPA) Notice