Senior Data Engineer

• Minimum seven plus years of experience in data analytics field
• Experience with Azure/AWS Databricks
• Experience in building and optimizing data pipelines, architectures and data sets
• Excellent experience in Scala or Python, PySpark and SQL
• Ability to troubleshoot and optimize complex queries on the Spark platform
• Knowledgeable on structured and unstructured data design / modelling, data access and data storage techniques
• Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS
• Hands on experience in performance tuning and optimizing code running in Databricks environment
• Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment
• Bachelor s degree in IT, Computer Science, Software Engineering, Business Analytics or equivalent.
• Technical :
• Azure/AWS Databricks
• Python / Scala / Spark / PySpark
• HIVE / HBase / Impala / Parquet
• Sqoop, Kafka, Flume
• SQL and RDBMS
• Airflow
• Jenkins / Bamboo
• Github / Bitbucket
• Nexus

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.