ADAPT Engineer

Purpose

        Independently Design and build/configure Big data pipelines as per the design

        Able to identify and solve big data problems independently.

        Work closely with Sr. Big data developer to report any issues in build

        Work on defect fixes during QA & UAT.

        Work through the life cycle of the code from low-level design to production and Postproductions support.

Experience

        8-15 yrs. of IT experience with more than 4 yrs. of big data implementation experience. 

Capabilities

        Strong technical and analytic skills to solve complex big data problems.

        Experienced with Spark software stack, Prior experience in working on Spark using Python or Scala or Java and PySpark based big data implementations.

        Have strong knowledge and hands-on few of HDFS, Map reduce Hive, Impala, Tej, Sqoop, Pig, Oozie, HBase, Cassandra, Mongo DB, Kafka, Spark, Storm, Knox, Ranger, Flume, NiFi, Falcon, Kerberos, Sentry, Cloudera Manager, Cloudera Navigator and Ambari.

Enterprise Competencies

        Independent High level design and developer

        Strong communicator

        Ability to manage stakeholders' expectations.

Technical Competencies

        Big Data Stack (Spark, Hive, Hbase, Apache Pheonix, Pig), Python , Scala, Kafka, Spark Streaming, Atlas, Pig, Java ,SQL, Impala, Tej, Sqoop, Pig, Oozie, HBase, Cassandra, Mongo DB,

        Kafka, Spark, Storm, Knox, Ranger, Flume, Nifi, Falcon, Kerberos,  Sentry, Cloudera Manager, Cloudera Navigator and Ambari.

        Good Handson Experience in AWS Glue

        Good Experience in CICD & DevOps concepts

        Good experience working in any cloud environment (Azure / AWS Glue/ GCP) using Agile methodology