AI Solution Designer – Data & AI

Where can a tech career at KPMG take you?

To a place where opportunity, innovation and collaboration come together.

Our Mid‑Market & Private, Tech team is helping clients accelerate their digital transformation journeys. We work with major technology partners, cutting‑edge tools and real‑world industry challenges—creating meaningful careers for tech professionals who want to grow, innovate and make a difference.

KPMG is a place where you can come as you are, learn for a lifetime and thrive as part of a global community.

We are seeking an AI Solution Designer to assist with our growing AI capability within our Mid‑Market and Private Data & AI practice who can translate requirements into technical designs and carry out Enterprise-wide implementations.

The candidate blends deep engineering expertise with strong solution design acumen to design, build, and deliver enterprise-grade AI solutions. The successful candidate will design and engineer agentic systems, Retrieval-Augmented Generation (RAG) pipelines, and large-scale AI workloads on platforms such as Microsoft AI Foundry and AWS AI services, with practical experience using frontier models including Anthropic Claude. This role bridges architecture and implementation, translating business problems into production-ready AI solutions while writing code, building agents, integrating data, and designing scalable, secure, and responsible AI systems.

Location: Sydney, Melbourne, or Brisbane

Key Responsibilities 

• Design and deliver multi-agent systems and AI-driven solutions integrating LLMs, APIs, and enterprise data
• Build and implement RAG pipelines, including embeddings, vector stores, retrievers, and re-ranking strategies
• Develop solutions across Azure AI (AI Foundry, OpenAI, AI Search) and AWS (Bedrock, SageMaker, Lambda, OpenSearch/Kendra)
• Translate business requirements into high-quality technical designs and drive enterprise-wide implementation
• Define evaluation frameworks, including LLM performance metrics, guardrails, and hallucination mitigation
• Embed responsible AI principles (security, compliance, privacy, and safety) into all solutions
• Lead workshops, develop HLDs/LLDs, and present solution designs to both technical and executive audiences
• Deliver production-ready solutions, including code, CI/CD pipelines, and infrastructure-as-code

How are you extraordinary:            

• Proven experience as an AI Solution Designer or Senior Solution Designer in consulting
• Strong stakeholder engagement and workshop‑facilitation skills

Your Experience 

At KPMG, we believe that diversity of thought, background and experience strengthens relationships and delivers meaningful benefits to our people, our clients, and communities. To be considered for this opportunity, your qualifications, skills & experience should include: 

• Proven experience designing and delivering enterprise AI/ML solutions end-to-end
• Strong engineering background with hands-on coding experience (Python essential)
• Deep expertise in LLMs, RAG architectures, and agent frameworks (e.g. LangChain, Semantic Kernel)
• Experience across Azure AI and AWS AI ecosystems
• Strong understanding of MLOps/LLMOps, APIs, and scalable system design
• Ability to collaborate with stakeholders and translate complex requirements into practical solutions
• Experience working in large or regulated environments is highly regarded

• Degree in Computer Science, AI, Data Science, or related discipline (or equivalent experience)
• Azure and/or AWS certifications highly desirable

KPMG is a professional services firm with global outreach and deep sector experience. We work with clients across an array of industries to solve complex challenges, steer change and enable growth. 

Our people are what make KPMG the thriving workplace that it is and what sets us apart is that we know great minds think differently. Collaborate with a team of passionate, highly skilled professionals who’ve got your back. You’ll build relationships with unique and diverse colleagues who will provide you with the support you need to be your best and produce meaningful and impactful work in an inclusive, equitable culture.

At KPMG, you’ll take control over how you work. We’re embracing a new way of working in many ways, from offering flexible hours and locations to generous paid parental leave and career breaks. Our people enjoy a variety of exciting perks, including retail discounts, health and wellbeing initiatives, learning and growth opportunities, salary packaging options and more.

Diverse candidates have diverse needs. During your recruitment journey, information will be provided about adjustment requests. If you require additional support before submitting your application, please contact the Talent Attraction Support Team.

At KPMG every career is different, and we look forward to seeing how you grow with us.

KPMG Australia: grow with us!