Big Data Engineer

Job Responsibilities: Analyzes, designs, develops, codes and implements programs and applications in one or more programming languages, for Big Data Applications. Supports applications with an understanding of system integration, test planning, scripting, and troubleshooting. Assesses the health and performance of software applications and databases. Establishes, participates, and maintains relationships with business units, customers and subject matter experts in order to remain apprised of direction, project status, architectural and technology trends, risks, and functional/integration issues. Analyzes program and application performance using various programming languages, tools and techniques. Proactively identify opportunities to optimize implementations for cost and execution efficiencies and show ownership and bias for action

Required Qualifications: Bachelor s degree in Computer Science or related field or equivalent experience. 3+ years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra, , Python, Hadoop, HDFS, Spark, MapReduce framework Good AWS experience (Batch and API microservices) using EMR/EC2/ECS/S3/Airflow/Step Functions, AWS API Gateway Good Batch Application performance tuning (Spark/Hadoop/EMR, Java, python)

Preferred Qualifications: Good Scala, Pyspark, Java coding experience for REST API and SOAP webservices Good Linux experience (Shell scripting/Python) Good to have DevOps experience (GIT, GitHub, Bit Bucket, GitLab, IntelliJ IDEA, PyCharm) Good to have experience creating CI/CD pipelines - Maven, Gradle, Jenkins, Artifactory, AWSCodeCommit / Cloudformation

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.