AI Development Platform Engineer

This role is for a senior platform engineer who will help build a firmwide AI Development Platform and drive adoption of AI capabilities throughout the enterprise. The ideal candidate will have strong hands-on experience of building software platforms on Kubernetes, API based development, REST framework, data engineering, and large-scale API Gateway environments etc. Knowledge of AIML and hands-on experience implementing solutions using Generative AI are also preferable. The candidate will have a strong passion for using AI to increase productivity as well as help generate new ideas for product & technical improvements.

Primary Responsibilities :

• Develop tooling and self-service capabilities for deploying AI solutions for the firm. Collaborate with other developers to enhance the developer experience when building and deploying AI applications.
• Have a platform mindset and build common, reusable solutions to scale Generative AI use cases using pre-trained models as well as fine-tuned models.
• Leverage Kubernetes/OpenShift to develop modern containerized workloads.
• Leverage container registries like JFrog artifactory, container packaging/configuration management technologies like Helm & Kustomize, and GitOps deployment methods to orchestrate, manage and deploy these workloads.
• Integrate with capabilities such as large-scale vector stores for embeddings.
• Author best practices on the Generative AI ecosystem, when to use which tools, available models such as GPT, Llama, Hugging Face etc. and libraries such as Langchain.
• Analyze, investigate, and implement GenAI solutions focusing on Agentic Orchestration and Agent Builder frameworks.
• Contribute to major design decisions and product selection for building Generative AI solutions. Inclusive of app authentication, service communication, state externalization, container layering strategy and immutability.

Required Skills :

• Strong hands-on Application Development background in at least one prominent programming language, preferably Python Flask or FAST Api.
• Broad understanding of data engineering (SQL, NoSQL, Big Data, Kafka, Redis), data governance, data privacy and security.
• Experience in development, management, and deployment of Kubernetes workloads, preferably on OpenShift.
• Experience with designing, developing, and managing RESTful services for large-scale enterprise solutions.
• Hands-on experience with multiprocessing, multithreading, asynchronous I/O, performance profiling in at least one prominent programming language, preferably python.
• Practitioner of unit testing, performance testing and BDD/acceptance testing.
• Understanding of OAuth 2.0 protocol for secure authorization.
• Proficiency with Open Telemetry tools including Grafana, Loki, Prometheus, and Cortex.
• Demonstrated experience in DevOps, understanding of CI/CD (Jenkins) and GitOps.
• Understanding of deep learning , understanding of Machine Learning frameworks such as TensorFlow or PyTorch.
• Experience in building cloud and container native applications.
• Knowledge of DevOps and Agile practices.

Qualifications:

• Bachelor’s or Master’s degree in Computer Science or related field, or equivalent job experience
• 10+ years of experience in software engineering, design and development