Data Engineer

Data Engineer Job Description

Job Title: Data Engineer

Job Summary:
We are seeking a skilled and detail-oriented Data Engineer to design, develop, and maintain scalable data pipelines and data infrastructure. The ideal candidate will work closely with data analysts, data scientists, and business stakeholders to ensure reliable, high-quality data is available for reporting, analytics, and machine learning initiatives.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Build and optimize data integration solutions from multiple internal and external data sources.
• Develop and maintain data warehouses, data lakes, and data marts.
• Ensure data quality, integrity, security, and governance across enterprise systems.
• Monitor, troubleshoot, and optimize data pipeline performance.
• Collaborate with business analysts, data scientists, and software engineers to understand data requirements.
• Implement data models that support reporting, analytics, and operational systems.
• Automate data workflows and deployment using CI/CD best practices.
• Create technical documentation for data architecture, pipelines, and processes.
• Stay current with emerging data engineering technologies and recommend improvements.

Required Qualifications

• Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field.
• 3+ years of experience in data engineering or a similar role.
• Strong proficiency in SQL and database design.
• Experience with Python, Scala, or Java.
• Hands-on experience with ETL/ELT tools and data integration frameworks.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
• Knowledge of data warehousing concepts and dimensional modeling.
• Experience with version control systems such as Git.
• Strong analytical, problem-solving, and communication skills.

Preferred Qualifications

• Experience with SSIS Apache Spark, Kafka, Airflow, or Databricks.
• Experience with Snowflake, Redshift, BigQuery, or Synapse.
• Familiarity with DevOps and Infrastructure as Code (Terraform, Docker, Kubernetes).
• Experience working in Agile/Scrum environments.
• Cloud certifications (AWS, Azure, or GCP) are a plus.

Technical Skills

• SQL
• SSIS
• Python
• Apache Spark
• Apache Kafka
• Apache Airflow
• Snowflake
• Git
• CI/CD

Soft Skills

• Strong problem-solving and analytical thinking
• Excellent communication and collaboration
• Attention to detail
• Time management and organizational skills
• Ability to work independently and within cross-functional teams

Preferred Experience

• Experience designing enterprise-scale data platforms.
• Experience building real-time and batch data pipelines.
• Knowledge of data governance, security, and compliance standards.
• Experience supporting business intelligence and analytics solutions.