T-Mobile

<p>Job ID: 3571734</p>
<p>AIOps Engineer (m/f/d) AI Infrastructure &amp; Orchestration</p>
<p>Warsaw</p>
<p>Professional</p>
<p>Application deadline: 31.10.2026</p>
<p>Regular (Part Time Possible)</p>
<p>T-Hub Polska</p>
<h3><strong>Your Task</strong></h3>
<ul>
<li>Design, deploy, and maintain vLLM inference services on OpenShift/Kubernetes running on bare-metal GPU infrastructure.</li>
<li>Manage NVIDIA GPU resources, including GPU partitioning and allocation, to maximize utilization across multiple models and tenants.</li>
<li>Automate model lifecycle management, including model onboarding, versioning, deployment, hot-swapping, and rollback from private registries such as Hugging Face Enterprise and S3.</li>
<li>Implement and manage Horizontal Pod Autoscaling (HPA) based on workload demand, queue depth, and GPU resource utilization.Optimize vLLM configurations and serving parameters to maximize performance, throughput, and resource efficiency.</li>
<li>Build and maintain observability and monitoring solutions for AI inference services, including metrics collection, logging, and tracing.</li>
<li>Instrument vLLM endpoints to expose metrics related to token consumption, latency, throughput, and error rates.</li>
<li>Develop usage tracking mechanisms to monitor token consumption by API key, user, team, or department, supporting quota management and chargeback/showback requirements.</li>
<li>Create and maintain Grafana dashboards covering infrastructure health, GPU utilization, inference performance, service availability, and business consumption metrics.</li>
<li>Configure proactive monitoring and alerting using Prometheus and Alertmanager to detect infrastructure failures, performance degradation, and unusual consumption patterns.</li>
<li>Implement and maintain API Gateway solutions to provide authentication, authorization, rate limiting, and intelligent routing to inference services.</li>
<li>Ensure secure operation of AI services through network segmentation, ingress and egress controls, and adherence to security best practices.</li>
<li>Maintain audit logging capabilities to support compliance, security investigations, and operational governance.</li>
<li>Collaborate with AI Engineering, Platform Engineering, Security, and Infrastructure teams to deliver reliable, scalable, and secure AI services.</li>
<li>Participate in troubleshooting, incident response, root cause analysis, and continuous platform improvement initiatives.</li>
</ul>
<h3><strong>Your Profile</strong></h3>
<ul>
<li>5+ years of experience in DevOps, Site Reliability Engineering (SRE), Platform Engineering, or Infrastructure Operations.</li>
<li>At least 2 years of hands-on experience supporting MLOps, AI Infrastructure, or Large Language Model (LLM) platforms.</li>
<li>Strong experience with Kubernetes and OpenShift administration in production environments.</li>
<li>Proven experience deploying and operating vLLM-based inference platforms in production.</li>
<li>Strong understanding of LLM serving concepts, including Paged Attention, continuous batching, and inference optimization techniques.</li>
<li>Deep knowledge of NVIDIA GPU technologies, CUDA drivers, NVIDIA Container Toolkit, and GPU troubleshooting.Hands-on experience with Prometheus, Grafana, OpenTelemetry, and ELK Stack.</li>
<li>Experience building observability solutions, including custom metrics, exporters, dashboards, and alerting mechanisms.</li>
<li>Strong Python programming skills with experience developing automation and operational tooling.</li>
<li>Experience with Bash scripting and Linux systems administration.</li>
<li>Familiarity with GitLab CI, Jenkins, ArgoCD, and Infrastructure-as-Code practices.</li>
<li>Strong analytical and problem-solving skills with the ability to work in complex, distributed environments.Excellent communication and collaboration skills.</li>
</ul>
<h3><strong>About Us</strong></h3>
<p>Working at T Hub will offer you an unique and highly rewarding experience on IT market. As a leader in the telecommunications industry, we do not only provide a platform to hone your technical skills but also empower you to be a catalyst for innovation.</p>
<p>You'll have the opportunity to work at the forefront of modern technologies, from 5G to IoT and AI, shaping the future of connectivity.</p>
<p><strong>Form of Employment:</strong> Contract of Employment</p>
<p>**Location: Warsaw/**Remote/Hybrid work model</p>
<p>Have you ever asked yourself whether you'd rather work in a big-tech, software house or startup? At home or in the office? In international teams or polish? At <strong>T Hub</strong>, there's one answer - <strong>YES!</strong></p>
<p><strong>T Hub Poland</strong> is a dynamic, forward-thinking division in T-Mobile Poland, where technology matters! It’s a place where best talents converge to ideate, prototype, and implement cutting-edge solutions in international projects held in Deutsche Telekom Group.</p>
<p>Job Benefits</p>
<h3>Financial</h3>
<p>Contract of Employment</p>
<h3>Work-Life Balance</h3>
<ul>
<li>Remote work options</li>
<li>Hybrid work model</li>
</ul>


AIOps Engineer (m/f/d) AI Infrastructure & Orchestration

AIOps Engineer (m/f/d) AI Infrastructure & Orchestration

This job is no longer available

Talents

Recruiters

About