Big Data Architect (Databricks + AWS)

About The Role In this role, you will design and help implement scalable data platforms and data processing solutions on AWS. You will work across batch and real-time architectures, contributing to data ingestion, modeling, and analytics capabilities. As part of a collaborative engineering environment, you will partner with technical and business stakeholders to deliver reliable and production-ready solutions.

Responsibilities

• Design and implement scalable data pipelines and data platform components on AWS, ensuring reliability, performance, and maintainability
• Own end-to-end delivery of data processing solutions, improving data quality, availability, and time-to-insight across use cases
• Collaborate closely with engineers, architects, and business stakeholders to translate requirements into robust technical designs
• Build and maintain batch and streaming data processing architectures using modern big data frameworks
• Develop and manage data ingestion processes, including source-to-target mappings and onboarding new data sources
• Orchestrate workflows using Apache Airflow or MWAA, ensuring efficient scheduling, monitoring, and error handling
• Implement real-time data solutions using Apache Kafka, Amazon MSK, or Kinesis to support streaming use cases
• Contribute to data warehousing and analytics solutions using Snowflake or Amazon Redshift, and maintain documentation and data models

Requirements

• Strong experience designing and building scalable data platforms and pipelines
• Proven hands-on expertise with AWS services for data engineering and analytics workloads
• Proficiency in Python, Scala, or Java, with strong SQL skills for data manipulation and querying
• Experience with big data technologies such as Apache Spark, Databricks, or Flink
• Practical knowledge of orchestration tools like Apache Airflow or MWAA
• Experience working with streaming technologies such as Apache Kafka, Amazon MSK, or Kinesis
• Familiarity with data warehousing solutions including Snowflake or Amazon Redshift
• Analytical mindset with the ability to translate business needs into technical solutions
• Upper-intermediate or higher level of English, with effective communication skills in a global environment

SoftServe is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment regardless of race, color, religion, age, sex, nationality, disability, sexual orientation, gender identity and expression, veteran status, and other protected characteristics under applicable law. Let’s put your talents and experience in motion with SoftServe.