Gen AI / LLM Engineer
Weekday AI
Posted: January 30, 2026
Interested in this position?
Create a free account to apply with AI-powered matching
Quick Summary
Design, develop, and deploy scalable LLM-driven applications powered by modern frameworks, cloud platforms, and best practices in responsible AI.
Required Skills
Job Description
This role is for one of the Weekday's clients
Salary range: Rs 800000 - Rs 2000000 (ie INR 8-20 LPA)
Min Experience: 5 years
Location: Remote (India)
JobType: full-time
We are seeking a highly skilled Gen AI / LLM Engineer with hands-on experience in designing, building, and deploying applications powered by Large Language Models. This role focuses on end-to-end development of scalable GenAI solutions using modern frameworks, cloud platforms, and best practices in responsible AI.
Requirements:
Key Responsibilities
• Design, develop, and deploy LLM-driven applications such as chatbots, copilots, autonomous agents, and Retrieval-Augmented Generation (RAG) systems.
• Work with state-of-the-art models including OpenAI, Azure OpenAI, Anthropic, LLaMA, Mistral, or equivalent open-source and commercial LLMs.
• Implement prompt engineering, prompt optimization, and systematic evaluation techniques to improve output quality.
• Build and manage RAG pipelines using vector databases for efficient information retrieval.
• Integrate LLM-based solutions with backend services, APIs, and existing systems.
• Fine-tune and optimize models to improve accuracy, latency, and cost efficiency.
• Ensure data security, compliance, and adoption of responsible AI practices.
• Collaborate closely with product, data, and engineering teams to deliver production-ready AI solutions.
Required Skills & Experience
• Strong proficiency in Python for AI and backend development.
• Practical experience working with LLMs and Generative AI concepts.
• Hands-on experience with frameworks such as LangChain, LlamaIndex, or Semantic Kernel.
• Knowledge of vector databases including Pinecone, FAISS, Chroma, Weaviate, or Milvus.
• Experience deploying solutions on cloud platforms such as AWS, Azure, or GCP.
• Solid understanding of REST APIs and microservices architecture.
• Familiarity with containerization and orchestration tools like Docker and Kubernetes (preferred).
Good to Have
• Experience with model fine-tuning techniques such as LoRA and PEFT.
• Exposure to MLflow, monitoring, and LLM evaluation frameworks.
• Experience building or working with multi-agent systems.
• Frontend integration experience using tools such as React, Streamlit, or Gradio.
Why Join
• Opportunity to work on cutting-edge Gen AI and LLM technologies.
• Hands-on involvement in building scalable, real-world AI solutions.
Skills
• Gen AI / LLM
• MLOps
• Python
• AWS / Azure
• SQL
• LangChain
• Retrieval-Augmented Generation (RAG)