Associate Technical Lead - Data Engineering

Responsibilities

• Review and understand business requirements ensuring that development tasks are completed within the timeline provided and that issues are fully tested with minimal defects Partner with a software development team to implement best practices and optimize the performance of Data applications to ensure that client needs are met at all times
• Collaborate across the company and interact with our customers to understand, translate, define, and design their business challenges and concerns into innovative solutions Research on new Big Data technologies, assessing maturity and alignment of technology to business and technology strategy Work in a rapid and agile development process to enable increased speed to market while maintaining appropriate controls

Requirements

• BE/B.Tech/MCA with At least 6+ years of total IT experience with 4+ years of experience in design and development using Hadoop technology stack and programming languages Preferred hands-on experience in 2 or more areas: Hadoop, HDFS, MR Spark Streaming, Spark SQL, Spark ML Kafka/Flume Apache NiFi Worked with Hortonworks Data Platform Hive / Pig / Sqoop NoSQL Databases HBase/Cassandra/Neo4j/MongoDB Visualization Reporting frameworks like D3.js, Zeppelin, Grafana, Kibana Tableau, Pentaho Scrapy for crawling websites Elastic Search Google Analytics data streaming Data security (Kerberos/Open LDAP/Knox/Ranger)
• Good knowledge of the current technology landscape and ability to visualize industry trends Working knowledge of Big Data integration with third-party or in-house built Metadata Management, Data Quality, Master Data Management solutions, structured/unstructured data Active community involvement in terms of articles, blogs or speaking engagements at conferences

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.