Data Engineer-Composer, Big, Professional Data Engineer (PDE)

Data Engineer-Composer, Big Query, Professional Data Engineer (PDE)BigQuery, Dataflow, looker, Python, Cloud composer, ETL, Data plex ,GCP

• Design, develop, and optimize data pipelines using Google BigQuery
• Execute and support Teradata to BigQuery migration projects
• Develop and manage data ingestion using BigQuery Data Transfer Service (BQ DTS)
• Build and maintain ETL/ELT pipelines using Python
• Automate workflows using Cloud Composer (Apache Airflow)
• Deploy scalable data processing services using Cloud Run
• Manage data storage in Google Cloud Storage (GCS)
• Ensure data quality, governance, and performance tuning
• Collaborate with cross-functional teams
• Monitor and troubleshoot data workflows

Required Skills

• Strong experience with Google BigQuery
• Hands-on with BigQuery Data Transfer Service (BQ DTS)
• Experience in Teradata to BigQuery migration
• Proficiency in Python
• Experience with Cloud Composer (Airflow)
• Knowledge of Cloud Run
• Experience with Google Cloud Storage (GCS)
• Strong SQL skills
• Experience in automation

Good to Have

• CI/CD pipelines in GCP
• Knowledge of Dataflow / Pub-Sub
• Terraform or Infrastructure as Code
• Data modeling and warehousing concepts

Educational Qualification

Bachelors/Masters degree in Computer Science, IT, or related field

Key Competencies

• Problem-solving skills .
• Ability to work in fast-paced environments .
• Good communication skills.