LLM Application Engineer

Software Guidance & Assistance, Inc., (SGA), is searching for an LLM Application Engineer for a Remote Full Time assignment with one of our premier Technology clients.

Responsibilities :

• Design, develop, and deploy applications powered by large language models and intelligent workflow automation.
• Create agent-based systems that support reasoning, planning, memory management, tool integration, and multi-step task execution.
• Build orchestration frameworks that transform AI-generated outputs into dependable, observable, and secure business processes.
• Integrate AI solutions with APIs, databases, search platforms, internal services, and third-party systems.
• Implement prompt engineering, context management, structured responses, and tool-calling techniques to improve model performance.
• Develop evaluation methodologies, benchmarks, and datasets to monitor quality, accuracy, and regression risks.
• Troubleshoot issues across the AI stack, including model behavior, orchestration layers, backend systems, and user experience components.
• Optimize solutions for performance, scalability, response times, and operational cost.
• Partner with product and engineering stakeholders to convert business requirements into practical AI-driven solutions.
• Establish best practices for monitoring, experimentation, traceability, and continuous improvement of production AI systems.

Required Skills :

• Strong software engineering background with experience building production-grade AI applications.
• Hands-on experience with large language models, generative AI technologies, or autonomous agent architectures.
• Proficiency in Python development.
• Experience designing prompts, workflows, evaluation frameworks, and AI behavior optimization strategies.
• Knowledge of LLM platforms, model APIs, and open-source model ecosystems.
• Ability to develop clean, maintainable, and scalable production code.
• Experience working across multiple layers of AI solutions, including models, systems, and end-user applications.
• Strong analytical and problem-solving capabilities in fast-paced and evolving environments.

Preferred Skills :

• Experience with AI orchestration frameworks and agent development platforms.
• Knowledge of vector databases, retrieval systems, and semantic search technologies.
• Experience building backend services, APIs, and distributed systems.
• Familiarity with machine learning frameworks such as PyTorch or JAX.
• Demonstrated success in iterative product development and continuous improvement initiatives.

Tech Stack

• Python
• LLM APIs and model providers, including OpenAI-compatible APIs and open-weight models
• Agent frameworks and orchestration systems
• Vector databases and retrieval systems
• Backend services, APIs, and distributed systems
• PyTorch / JAX

By applying for a job with SGA, you agree to allow SGA to process your application for this and future opportunities in accordance with our Privacy Policy. Also, to ensure timely processing, you agree to be contacted by our AI recruiter via email, text, or phone. Message frequency varies and data rates may apply, but you can reply STOP to any SMS message to opt-out of texts and may contact SGA at [email protected] to opt-out of AI communications. The choice not to engage with AI will not adversely impact your consideration for placement. AI is not used to make any hiring determinations.

SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at https://sgainc.com/.

SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.