Data Scientist II

Key Responsibilities

1. Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF)
2. Configure and manage Linked Services, Datasets, and Pipelines in ADF
3. Develop and optimize data transformation workflows using Azure Databricks (PySpark)
4. Work across Lakehouse architecture layers (Bronze/Silver/Gold), storage accounts, Unity Catalog, and support metadata\u2011driven design (control tables, mappings).
5. Strong technical expertise across Power BI, SQL, Power Platform tools, and Azure services
6. Build and manage dbt models for data transformation, testing, and documentation
7. Implement real-time data ingestion using Azure Event Hub
8. Integrate data from multiple sources (databases, APIs, cloud storage, on-prem systems)
9. Ensure data quality by implementing dbt tests and validations
10. Monitor, troubleshoot, and optimize data workflows
11. Collaborate with cross-functional teams to understand business data requirements
12. Maintain data governance, security, and performance standards
13. Strong understanding of data warehousing concepts and ELT methodologies
14. Experience working with Azure Data Lake Storage (ADLS) or similar storage solutions
15. Knowledge of version control (Git) and CI/CD processes
16. Willing to work in production support