Senior LLM/RAG Engineer (Legacy Modernization)

The LLM/RAG Engineer will play a pivotal role in a high-profile modernization project, transitioning a legacy RPG/IBM i-based Dealer Management System (DMS) into a modern, cloud-native Java architecture.

In this Proof of Concept (POC) phase, you will specialize in CodeRAG (Retrieval-Augmented Generation for code) and Abstract Syntax Tree (AST) techniques. Your primary objective is to automate the parsing, transformation, and migration of legacy business logic into modern microservices. You will work at the intersection of Generative AI and legacy system modernization, ensuring that automated code generation remains accurate, performant, and aligned with architectural specifications.

Essential functions

• Code Transformation Analysis: Utilize AST techniques to parse legacy RPG code and transform it into structured formats suitable for automated migration.
• RAG Implementation: Design and maintain RAG pipelines using AWS Bedrock and Vector Databases to provide LLMs with high-fidelity context from legacy documentation and code analysis.
• Data Preprocessing: Clean, structure, and enrich metadata from legacy systems, potentially involving the creation of knowledge graphs or embeddings to improve LLM accuracy.
• Iterative Validation: Perform rigorous validation and correction of AI-generated code assets to ensure they meet modern Java standards and functional parity with the legacy system.
• Legacy Integration: Collaborate with specialized code analysis tools (such as PKS eXplain) to extract business logic and code flows from IBM i environments.
• Collaboration Documentation: Work closely with cross-functional teams in India and Germany, documenting complex business logic and ensuring tight feedback loops during the POC.
• Quality Assurance: Adhere to strict architectural specifications and collaborate on testing strategies to validate the migrated solution.

Qualifications

• Total Work Experience: Minimum of 48 years of experience in software engineering, with a significant focus on AI/ML or Backend development.
• AI LLM Expertise: Proven experience working with advanced LLMs (e.g., Claude 3.5/3.7/4) and building RAG pipelines.
• Technical Proficiency: Languages: Strong proficiency in Python.
• Cloud: Hands-on experience with AWS Bedrock.
• Databases: Experience with Vector Databases such as Milvus or Pinecone.
• Code Transformation Skills: Deep understanding of Abstract Syntax Trees (AST) and experience in parsing or transforming code programmatically.
• Modernization Knowledge: Familiarity with code migration processes, microservices architecture, and cloud-native design patterns.
• Tools Version Control: Expert-level knowledge of Git for managing generated code and collaborative development.
• Soft Skills: A proactive nature with strong communication skills, essential for navigating the ambiguity of a POC environment and working with distributed global teams.