Senior Data Engineer

Job Title: Data Engineer
Location: Kochi (Hybrid)
Job Type: Full Time
Experience: 4+ Years

Key Responsibilities Design, build, and optimize data ingestion and transformation pipelines using AWS-native tools (Glue, Lambda, Step Functions, EMR, etc.). Develop and manage data lakes and data warehouses using Amazon S3, Redshift, and Athena. Implement ETL/ELT workflows for structured, semi-structured, and unstructured data at scale. Create and maintain data models and schemas that support analytics and ML workflows. Work with AWS Glue Catalog, Lake Formation, and AWS DataBrew for data cataloging, cleaning, and governance. Collaborate with data scientists to prepare feature-ready datasets for model training and inference. Implement data quality, validation, and monitoring mechanisms to ensure accuracy and reliability. Optimize data performance and costs through partitioning, compression, and indexing strategies. Automate deployment and orchestration of data workflows using AWS CodePipeline, Docker, and CI/CD best practices. Ensure compliance, data security, and access control in alignment with AWS IAM and governance standards.

Required Skills • 3+ years of hands-on experience in Data Engineering, with at least 3 years in AWS environments. • Proficiency in Python (pandas, PySpark, boto3) and SQL for data transformation and orchestration. • Expert-level knowledge of AWS data services: o AWS Glue, AWS Lambda, Amazon S3, Amazon Redshift, Athena, Kinesis, and Step Functions. • Strong understanding of data lake and data warehouse architectures. • Experience designing and maintaining end-to-end data pipelines in production environments. • Familiarity with event-driven and batch data processing workflows. • Strong background in data modeling, schema design, and query optimization. • Experience integrating data pipelines with ML/AI environments (e.g., SageMaker or Bedrock). • Excellent problem-solving and debugging skills in distributed data systems.

Pay: ₹1,000,000.00 - ₹1,500,000.00 per year

Work Location: In person