Big Data Engineer (BI-EIABA)

Interested candidates can share their resume to [email protected]

Skills Required

• 5+ years of relevant work experience
• Strong with programming in Python to perform,
• Batch data engineering on Apache Spark and populate downstream batch data stores (such as data mart) for BI use cases & to generate downstream feeds (ie., flat & wide tables or compressed files) for Data Science use cases
• Strong with SQL Server & Hadoop based implementations
• Strong SQL skills
• Good hands-on experience with at least one of the job scheduling tools like Autosys (Preferred), Control-M etc.,
• Experience of working in a Linux environment and can write Python/Shell scripts
• Strong data analytics skills
• Strong oral and written communication skills
• Excellent interpersonal skills and professional approach
• Strong analytical and problem-solving skills
• Ability to learn quickly and pick up new techniques and/or technologies
• Experience in building & maintaining data solutions for BI & Data Science

Skills Desired

• Experience in data architecture and modeling experience. Especially, in dimensional modeling for data mart design and development to support BI use cases
• Real-time service integration to process business events off Kafka and persist in operational MS SQL/MongoDB and/or Neo4j Graph data stores for fraud investigation
• Near real-time stream processing to derive features for ML model inference.
• Experience in Azure (Databricks, Data Factory, Synapse, Azure Data Lake) and/or AWS (AWS S3, AWS Athena, AWS Glue) Data ecosystem & Snowflake Data Cloud
• Experience in MongoDB and Neo4j Graph databases
• Experience in building virtual data access layer using TIBCO Data Virtualization to support BI & Data Science use cases