Lead Software / Platform Engineer II

Job Details

• Location: Hyderabad, Telangana
• Working Schedule: Full-Time
• Work Arrangement: Hybrid

Job Summary

Azure Platform Architecture Administration

Responsibilities

Azure Platform Architecture Administration

• Design and manage a secure, scalable Azure-based data platform to support marketing and customer analytics.
• Administer and optimize Azure services including Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Synapse Analytics, and Key Vault.
• Implement robust monitoring, alerting, and cost optimization for the Azure data environment.
• Ensure platform availability, data pipeline reliability, and high performance for downstream consumption.
• Establish and manage Azure Data Lake Storage (ADLS) structures, security models, and performance optimization strategies.
• Monitor platform health, performance, and cost usage; implement automation to improve efficiency and reliability.

Data Engineering ETL/ELT Pipelines

• Architect and implement ETL/ELT pipelines using Databricks (PySpark, SQL, Delta Lake) and Azure Data Factory.
• Optimize data ingestion, transformation, and storage for big data workloads and real-time streaming.
• Work with stakeholders to design data models, schemas, and APIs supporting analytics and operational needs.
• Ensure data quality, lineage, and governance through integration with tools such as Purview or equivalent.
• Build robust data transformations and aggregations to support marketing dashboards and customer 360 views.
• Optimize Python jobs, SQL queries, and data flows for performance and scalability.

Integration with Marketing Platforms

• Integrate marketing data from platforms such as Salesforce, Adobe Experience Platform, Adobe Analytics, Facebook Ads, HubSpot, and CRM systems.
• Work with MarTech and Marketing Ops teams to ensure clean, timely data feeds for campaigns.
• Build APIs, REST connectors, or use tools such as Azure Logic Apps, Azure Functions, and API Management.

Power BI Support and Semantic Layer Design

• Provide data models and optimized datasets to support Power BI dashboards for marketing.
• Collaborate with BI developers on semantic models using Synapse SQL Serverless or Power BI Datasets.
• Ensure data freshness and efficient refresh cycles for marketing reports.

Data Governance, Security Compliance

• Implement data access controls, encryption, and auditing using Azure RBAC, Purview, and Private Endpoints.
• Ensure compliance with GDPR, CCPA, and internal policies.
• Define and manage metadata, data dictionaries, and quality processes.

Agile Project Delivery Stakeholder Engagement

• Work in Agile teams providing estimates and delivery timelines for marketing use cases.
• Collaborate with marketing analytics, Martech, and Marketing data platform teams to prioritize backlog items.
• Translate marketing needs into platform capabilities and deliverables.

DevOps Infrastructure as Code (IaC)

• Establish DevOps practices for CI/CD pipeline development, deployment, and testing for data workflows using Azure DevOps or GitHub Actions.
• Manage source control, release management, and environment configuration for data engineering components (ADF, Databricks, Synapse).
• Automate deployment of data pipelines and related resources with rollback strategies and deployment validations.
• Set up monitoring and alerting for CI/CD pipelines and infrastructure health using tools like Azure Monitor, Log Analytics, or Application Insights.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.