Toptal: Python Backend Development Talent with RAG and Agentic AI Experience

<p> <strong>Headquarters:</strong> </p> <p>Summary:</p><p>We are seeking an experienced Python Backend Developer to design, build, and deploy scalable AI-powered applications using Retrieval-Augmented Generation, large language models, and agentic AI frameworks. The role will focus on delivering a production-grade RAG system and AI chatbot that can securely integrate with enterprise data, APIs, databases, and cloud services.</p><p>General information:</p><p>The organization is developing an AI-powered platform and requires an experienced individual contributor to build its RAG architecture and conversational AI capabilities. The developer will work closely with a distributed team and should be available for several hours of overlap with US working hours.</p><p>The project involves designing AI systems that go beyond basic prompt engineering, including multi-step workflows, autonomous agents, vector search, knowledge retrieval, memory management, and tool integration. The solution must be scalable, secure, observable, and suitable for production use.</p><p>The technology environment includes Python, FastAPI, large language models, LangGraph, LangChain, vector databases, Azure AI services, AWS, Docker, Kubernetes, and microservice-based architectures.</p><p>Task and deliverables:</p><ul><li>Design the end-to-end architecture for a scalable RAG system and AI chatbot.</li><li>Develop Python backend services, REST APIs, and microservices using FastAPI or similar frameworks.</li><li>Build document ingestion, chunking, embedding, indexing, retrieval, and reranking pipelines.</li><li>Implement vector search solutions using Azure AI Search or comparable vector databases.</li><li>Design autonomous AI agents capable of planning, reasoning, tool usage, and decision-making.</li><li>Develop multi-step AI workflows using LangGraph, LangChain, CrewAI, AutoGen, or similar orchestration frameworks.</li><li>Integrate commercial and open-source LLMs, including Azure OpenAI, OpenAI, Anthropic Claude, Gemini, and comparable models.</li><li>Implement conversation memory, session management, context management, and agent collaboration patterns.</li><li>Connect AI workflows with APIs, databases, enterprise systems, and external tools.</li><li>Develop asynchronous, high-performance services capable of handling concurrent AI workloads.</li><li>Implement prompt management, structured outputs, guardrails, fallback logic, and model evaluation processes.</li><li>Establish logging, monitoring, tracing, observability, security, and error-handling standards.</li><li>Containerize and deploy AI services using Docker, Kubernetes, Azure, or AWS.</li><li>Translate business requirements into technical designs, delivery milestones, and production-ready AI solutions.</li><li>Collaborate with the wider team while independently owning architecture and implementation decisions.</li></ul><p>Required experience:</p><ul><li>Required: 8 or more years of professional Python backend development experience.</li><li>Required: Strong experience designing REST APIs, microservices, asynchronous services, and distributed backend systems.</li><li>Required: Hands-on experience building production-grade RAG applications.</li><li>Required: Strong understanding of embeddings, document chunking, semantic search, vector indexing, retrieval strategies, and reranking.</li><li>Required: Hands-on experience developing AI agents and multi-step LLM workflows.</li><li>Required: Experience with agentic AI frameworks such as LangGraph, LangChain, CrewAI, AutoGen, or comparable platforms.</li><li>Required: Experience integrating LLMs through OpenAI, Azure OpenAI, Anthropic Claude, Gemini, or open-source model APIs.</li><li>Required: Ability to design AI architecture beyond basic prompt engineering.</li><li>Required: Experience integrating AI applications with APIs, databases, data pipelines, and enterprise systems.</li><li>Required: Experience implementing security, monitoring, logging, tracing, and observability for production services.</li><li>Required: Experience deploying containerized applications using Docker and cloud platforms such as Azure or AWS.</li><li>Required: Ability to independently translate business requirements into scalable technical solutions.</li><li>Required: Strong communication and collaboration skills in a distributed working environment.</li><li>Required: Availability for several hours of overlap with US working hours.</li></ul><p><br></p> <p><strong>To apply:</strong> <a href="https://weworkremotely.com/remote-jobs/toptal-python-backend-development-talent-with-rag-and-agentic-ai-experience">https://weworkremotely.com/remote-jobs/toptal-python-backend-development-talent-with-rag-and-agentic-ai-experience</a></p>