Senior Software Engineer with Data Skills (Remote, US)

Join Our Team as a Senior Software Engineer with Data Skills for Agentic AI Systems! 

We are looking for a Senior Software Engineer with a strong focus on Data and experience building infrastructure for LLM-powered applications and agent-based systems. In this role, you will work on RAG pipelines, agent workflows, and memory systems that allow AI agents to reason, retrieve information, and interact with complex tasks.

You will collaborate with engineers building intelligent agents and help design the data pipelines, evaluation frameworks, and orchestration workflows that support reliable and scalable AI systems.

Note: This opening is only available for candidates based in the United States of America. Applications from other locations will not be considered for the role.

What You'll Do: 

Design and maintain ETL pipelines that process and classify unstructured data for Retrieval-Augmented Generation (RAG) systems.

Support the development of agent-based architectures using reasoning and acting patterns such as ReAct.

Build and maintain agent workflows using node-based orchestration frameworks such as LangGraph.

Implement agent memory strategies, including short-term event memory and long-term memory approaches such as summarization, semantic memory, episodic memory, and user preference storage.

Develop system prompts and intent-handling prompts that support reliable agent interactions.

Create evaluation tests and performance benchmarks to measure LLM agent performance.

Build tools that allow LLM agents to interact with external systems and services.

Apply best practices around prompt security, input sanitization, and safe handling of user-generated content.

What We're Looking For: 

Experience building RAG pipelines or ETL workflows for unstructured documents.

Experience working with LLM-based systems or AI-powered applications.

Familiarity with agent architectures such as ReAct.

Experience building or maintaining workflow orchestration systems (e.g., LangGraph or similar node-based frameworks).

Experience writing system prompts or designing prompt interactions for LLM applications.

Experience evaluating or testing LLM systems.

Understanding of data pipelines and document processing for AI systems.

Familiarity with AWS environments and tools such as AWS CLI or STS.

Understanding of security considerations in LLM systems, including prompt injection and input sanitization.

Nice to have: 

Experience with LangGraph or other agent orchestration frameworks.Experience building tools for tool-enabled LLM agents.Understanding of hierarchical workflows or state-machine based orchestration.

Experience working with AI agent security concepts or agent threat models.

Experience designing evaluation datasets or LLM benchmarking frameworks.

Experience implementing agent memory systems or memory strategies.

ITX’s Compensation Philosophy  
  

Equality in compensation has been our practice since ITX started, in 1997.  

ITX believes that market-based pay ensures fair and equitable compensation for our worldwide team members and pay that is based on the market, not on who has the best negotiation skills. At ITX, you’ll never discover that someone in the same job with the same experience makes more than you, or that there are pay gaps based on race, gender, disability, or age.  
  

How do our team members experience market-based pay at ITX? We gather market data to benchmark each position in our candidates’ and team members’ locations and use these benchmarks for candidate offers and to perform regular compensation reviews for our team members. You’ll never have to worry about asking for a pay raise again. At least once a year ITX automatically adjusts pay when the benchmark is higher than our team member’s compensation. 

In Rochester, N.Y., home to ITX’s headquarters, the pay range for a Senior Software Developer with Data Skills role is $96,000 to $129,000, depending on experience, specific skills and certifications, and education. Based on your location in the United States if you are in a place where the market for your role is higher or lower, this pay range could be 13% lower or 10% higher than the Rochester, N.Y. market.

ITX has team members in many countries, and we use the same methodology for determining pay for all our teammates. For candidates outside of the United States, we use local market data to determine the benchmark range for the Senior Software Engineer with Data Skills.     

Do you have questions about ITX’s compensation practices? Let us know! We’re proud of how we do compensation at ITX and welcome the opportunity to share more.  
  

This role was posted by ITX on March 6th, 2026.