Senior Data Engineer

Job Requirements

• 5 to 8 + Years of experience using Python.
• Develop and implement Data pipelines and algorithms using Python programming language, jointly with knowledge about Pandas, NumPy, Pyspark, SQL and similar libraries.
• Should have working knowledge in devops and should be well versed in databricks to solve real-world problems.
• Should have working knowledge in Azure cloud data lake storage and azure services.
• Utilize SQL for data Extraction, Transformation, and Loading (ETL) processes.

Key Responsibilities*

Work closely with engineers, researchers, and data scientists to gather requirements, perform data analysis, and develop end-to-end pipelines.
Independently develop, code or modify, test, and debug application programs of varying degree of complexity
Conduct experiments and perform data analysis to ensure the robustness, scalability, and accuracy of provided solutions
Optimize and fine-tune for performance and efficiency.

Soft Skills

• Excellent communication
• Team collaboration
• Documentation and knowledge sharing

Certifications
Microsoft Azure Certified Developer / Azure Databricks Data Engineer

Skills: Digital : Python~Digital : PySpark