Experience : 5+ years
We are seeking an experienced Senior Python Engineer – Generative AI to design, develop, and deploy large-scale AI-driven applications. The ideal candidate will bring strong expertise in Python development, LLM integration, and knowledge-augmented architectures (RAG/KAG), along with hands-on experience in building robust APIs, AI workflows, and scalable agentic systems. This role requires a solid understanding of modern data processing pipelines, distributed systems, caching strategies, and containerized deployments.
Key Responsibilities:
- Develop and maintain large-scale Python applications leveraging Generative AI technologies.
- Integrate and utilize pre-trained LLMs via APIs (OpenAI, Anthropic, Hugging Face, etc.).
- Design and implement Retrieval-Augmented Generation (RAG) and Knowledge-Augmented Generation (KAG) pipelines.
- Build document processing and text extraction workflows for search, indexing, retrieval, and document intelligence.
- Develop robust REST APIs using FastAPI or Flask.
- Create and orchestrate workflows with n8n.
- Integrate and build agentic AI systems using Langchain, vLLM, Langraph, Agno, and (optionally) Foundry agents.
- Develop and optimize complex agentic pipelines for decision-making and automation.
- Implement distributed task queues using Celery and RabbitMQ.
- Design and implement various caching mechanisms: semantic caching, in-memory caching (Redis, Memcached), distributed caching (Redis Cluster), etc.
- Work with RDBMS, NoSQL, and Vector Databases (Pinecone, Qdrant, Milvus, Chroma DB, Elasticsearch).
- Containerize applications using Docker for scalable deployment.
- Ensure code quality and reliability through unit testing (PyTest).
- Monitor application health and performance using Prometheus and Grafana.
- Leverage Microsoft Azure services such as Durable Functions, Service Bus, and Document Intelligence for cloud-native solutions.
- Collaborate with cross-functional teams to define requirements and deliver solutions.
- Maintain comprehensive documentation and adhere to best coding practices.