AI Development Solution Engineer

This role is for a senior engineer who will help build a firmwide AI Development Platform that will aid the adoption of AI capabilities throughout the enterprise. The ideal candidate will have strong hands-on experience of building software platforms, data engineering, API based development, REST framework etc. Knowledge of AIML and hands-on experience implementing solutions using Generative AI are also preferable. The candidate will have a strong passion for using AI to increase productivity as well as help generate new ideas for product improvements.

This role requires a strong combination of both development and infrastructure knowledge and experience. The successful candidate must be able to demonstrate technical leadership with a track record of developing and driving innovative solutions.

Primary responsibilities

• Build POC’s and example code through which developers can access Gen AI models via standard APIs.
• Develop tooling and self-service capabilities for deploying AI solutions. Collaborate with developers to enhance the developer experience when building and deploying AI applications.
• Integrate with capabilities such as large-scale vector stores for embeddings.
• Author best practices on the Generative AI ecosystem, when to use which tools, available models such as GPT, Llama, Hugging Face etc. and libraries such as Langchain, and Sematic Kernel.
• Have an application developer mindset and build common, reusable solutions to scale Generative AI use cases using pre-trained models as well as fine-tuned models.
• Contribute to major design decisions and product selection for building Generative AI solutions.

Required Skills

• 9+ Years of experience in software engineering, design, and development
• Strong hands-on Application Development background in at least one prominent programming language, preferably Python
• Broad understanding of data engineering (SQL, NoSQL, Big Data), data governance, data privacy and security
• Demonstrated experience in DevOps, understanding of CI/ CD.
• Hands on experience with managing code in code repositories such as Bit Bucket and GitHub.
• Experience deploying resources to the cloud and using terraform to do so.
• Understanding of how deep learning works, understanding of Machine Learning frameworks such as TensorFlow or PyTorch
• Understanding of Information Security, Secure coding practices

Desired Skills

• Experience working with cloud providers, preferably Azure, but also AWS, GCP
• Experience building applications using AI development services on prominent cloud platforms such as Azure Open AI, Azure AI Foundry, Azure Search, Azure Cognitive Services, AWS Bedrock, AWS Sagemaker, Google Vertex AI
• Experience working in a large, regulated industry such as Financial Services, Insurance etc.
• Experience building AI applications, preferably Generative AI and LLM based apps.
• Experience working with Generative AI development, embeddings, fine tuning of Generative AI models.
• Understanding of Model Ops/ ML Ops/ LLM Ops