Senior Data Engineer

Job Type

Full-time

Experience Level

Professional / Experienced

Job Summary

You will play a critical role in ensuring the stability and continuity of OT data operations by managing data pipelines from windfarm SCADA systems to the Polaris cloud data lake. Your day will involve designing and optimizing data pipelines, maintaining CI/CD processes, and driving system reliability. You will act as a technical leader, guiding architectural decisions, resolving complex issues, mentoring team members, and collaborating with stakeholders to deliver secure, high-quality data solutions aligned with cybersecurity requirements.

Responsibilities

• Design, develop, and maintain scalable, reliable data pipelines to ingest OT data into the Polaris cloud data lake
• Optimize and troubleshoot dataflows to ensure high performance, stability, and data integrity for digital services
• Implement secure data transmission solutions, including MQTT for air-gapped and cybersecurity-sensitive environments
• Collaborate with stakeholders to translate business data requirements into technical solutions
• Integrate, optimize, and manage multiple data sources for analytics and reporting readiness
• Troubleshoot and resolve complex data infrastructure issues to ensure availability and reliability
• Manage and enhance CI/CD pipelines for efficient and reliable deployment of data solutions
• Implement DevOps best practices including infrastructure-as-code, automated testing, and configuration management
• Monitor pipelines, identify bottlenecks, and drive improvements to development velocity and quality
• Act as SME for OT data collection and complex dataflows, ensuring knowledge retention
• Mentor junior engineers and review deliverables to maintain high standards
• Lead resolution of critical production issues and ensure minimal business disruption

Qualifications

• Bachelor s degree in Computer Science, Engineering, IT, or related field
• 12+ years of experience in data engineering, specifically in cloud-based data platforms
• Proven experience in senior/lead roles with ability to independently manage complex systems and mentor teams
• Data Engineering Architecture: SQL, Data Integration, SSIS, Azure Data Factory, Databricks, Python, Data Lakes, MQTT
• Cloud DevOps: Microsoft Azure, CI/CD, DevOps, Git
• Problem Solving: Troubleshooting, Agile methodology
• Strong ownership and accountability
• Team player with mentoring capabilities
• Growth mindset and positive attitude
• Microsoft Certified: Azure Data Engineer Associate
• AWS Certified Data Analytics - Specialty
• Databricks Certified Data Engineer Professional

About the Team

The Data Operations team focuses on maintaining stable and secure OT data pipelines that power remote digital services. The team collaborates closely to ensure system reliability, knowledge sharing, and continuous improvement while handling complex, high-volume data environments.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.