Operations Manager (m/f/d) AI Services

Job ID: 744000142561930

Operations Manager (m/f/d) AI Services

Budapest, Debrecen, Pécs, Szeged

Professional

Regular

Deutsche Telekom TSI Hungary Kft.

Your Task

We are looking for an ambitious and experienced specialist who speaks English and German with confidence to join the team in this dynamically developing business in Hungary. The aim of our project is to provide a high quality digital customer experience and to develop modern infrastructures, providing the necessary professional knowledge. You will be involved in building a central, enterprise-level LLM service that provides secure, reliable and cost-effective access to Large Language Models for development teams and business applications. You will be instrumental in how LLMs are assessed, approved, secured and operated within your organisation — from the initial manual processes to a scalable, increasingly automated service.

Responsibilities

• Assess incoming AI use cases and help teams choose the right LLM model
• Balance technical quality, security, compliance, availability and cost
• Manage the LLM catalogue: service requests, approvals, access, credentials, quotas and onboarding processes
• Establish operational controls for monitoring, logging, security and governance
• Develop transparent consumption and cost models and prepare for automation of provisioning and reporting processes
• Provide a fast and practical route to approved LLM access for staff
• Contribute to the transformation of manual workflows into standardized and automated services

Your Profile

We are seeking an ambitious and experienced LLM Platform Specialist with strong technical expertise in platform operations, cloud services, and Large Language Models, combined with excellent stakeholder communication skills and proficiency in both German and English languages.

Must Have Skills

• Years of experience in platform or cloud operations
• Years of experience in software engineering, technical product management, or IT service management
• Practical knowledge of Large Language Models (LLMs)
• Practical knowledge of APIs
• Practical knowledge of authentication
• Practical knowledge of observability
• Practical knowledge of production service operations
• Ability to evaluate technical solutions based on quality
• Ability to evaluate technical solutions based on safety
• Ability to evaluate technical solutions based on compliance
• Ability to evaluate technical solutions based on reliability
• Ability to evaluate technical solutions based on cost
• Strong stakeholder communication skills
• Proficiency in German at least at B2 level
• Proficiency in English at C1 level

Nice to Have Skills

• Experience with LLMOps platforms
• Experience with AI gateways
• Experience with model evaluation
• Experience with AI observability
• Knowledge of FinOps
• Knowledge of provider management
• Knowledge of usage-based cloud services
• Experience with MCP (Model Context Protocol)
• Experience with AI agents
• Experience with ITIL based service management
• Experience in a regulated environment
• Experience in a security-critical environment
• Experience in an enterprise-sized environment

About Us

The most attractive employer in Hungary in 2025 (according to a representative survey by Randstad) is Deutsche Telekom IT Solutions, a subsidiary of the Deutsche Telekom Group. With more than 5,300 employees, the company provides a wide range of IT and telecommunications services. It has hundreds of large corporate clients in Germany and other European countries.

DT-ITS was awarded the HIPA "Best Educational Collaboration" award in 2019, as well as the "Most Ethical Multinational Company" in the same year.

The company is constantly developing its sites in Budapest, Debrecen, Pécs and Szeged and is looking for qualified IT professionals to join its team.

Benefits

• A decisive role in building an enterprise-level AI service
• Modern, rapidly evolving LLM technologies
• High autonomy in the design of processes and controls
• Strategic insight into how AI works in an organization
• International working environment in English and German

Company Policies

• Remote working possibility is only available within Hungary due to European taxation regulation

Job Benefits

Office Perks

International working environment in English and German

Professional Development

• Decisive role in building an enterprise-level AI service
• Modern, rapidly evolving LLM technologies
• High autonomy in the design of processes and controls
• Strategic insight into how AI works in an organization

Work-Life Balance

Remote working possibility within Hungary