Manager / Data Engineer-Data Architect

Job highlights

• The ultimate aim is to provide clean,usable data to whoever may require it. Technical Skills Required: . Statistical analysis and modeling

• 15 years working as a Data Architect Manager / Senior Big Data Engineer / Senior Data Engineer with relevant experience in the above skill set in a reputed Big Database Data Science is driven software product development startup. .

• Big Data Architect Solutions, Data Design, Data construction, installation, test and maintain highly scalable data management systems.

• Ensure systems meet business requirements and industry practices

• Build high-performance algorithms, prototypes, predictive models, and proof of concepts

• Research opportunities for data acquisition and new uses for existing data

• Develop data set processes for data modeling, mining, and production

• Integrate new data management technologies and software engineering tools into existing structures

• Create custom software components (e.g. specialized UDFs) and analytics applications

• Employ a variety of languages and tools (e.g. scripting languages) to marry systems together

• Install and update disaster recovery procedures

• Recommend ways to improve data reliability, efficiency, and quality

• Collaborate with data architects and IT team members on project goals.

• Data engineers will be work closely with the data architects (to determine what data management systems are appropriate) and data scientists (to determine which data are needed for analysis).

• Managing complex problems associated with database integration and messy, unstructured data sets.

• The ultimate aim is to provide clean, usable data to whoever may require it.

Technical Skills Required:

• Statistical analysis and modeling.
• Database architectures.
• Hadoop-based technologies (e.g. MapReduce, Hive, and Pig) and Big data technologies such as Spark to forecast and recommend improvements based on how the data is consumed.
• Hadoop map-reduce, Postgre SQL, MySQL, SQL, NoSQL DB: MongoDB Cassandra Redisneo4J, Scala /Python /Spark /Cassandra Hbase, Enterprise architecture, Visio-Data API, Data Ingest, ETL Tools, Unstructured, Semi-Structured, Structured Data modeling and management, Data warehousing.
• Collect,manage,analyse & Visualise Data.
• Build, and deploy Data Infrastructure & Data Architecture.
• Data Road map, Data Analysis, Data Deployment, and Integration.
• SQL-based technologies (e.g. PostgreSQL and MySQL)
• NoSQL technologies (e.g. Cassandra and MongoDB)
• Data modeling tools (e.g. Er Win, Enterprise Architect, and Visio)
• Python, C/C++ Java, Perl.

Experience :

3-15 years working as a Data Architect Manager / Senior Big Data Engineer / Senior Data Engineer with relevant experience in the above skill set in a reputed Big Database Data Science is driven software product development startup.