Data Architect

Project Role: Big Data Architect

Work Experience: 10 to 15 Years

Work location: Bangalore

Work Mode: Hybrid

Must Have Skills: Solution Architect/ Data Architect, Databricks, Spark , Hadoop , Hive , DBT, (NoSQL/Cassandra/MongoDB ), (Jenkins /GitLab/ CI/CD/DevOps)

IT Architect JD:
Purpose

The Solution Architect will be a key member of the US Business Unit team, driving the delivery of Big Data Factory and other strategic initiatives to meet local BU requirements. This role is central to our enterprise transformation journey evolving from a traditional data warehouse (3 Petabytes of data) into a modern big data ecosystem.

We are seeking a dynamic professional with a strong foundation in traditional databases and data warehouses, combined with enthusiasm for cuttingedge technologies. If platforms such as Databricks, DBT, Spark, Kafka, Apache Beam, Airflow, Hadoop, Hive, Kibana, and StackStorm excite you, this role offers the opportunity to shape enterprisescale data solutions.

Key Responsibilities

• Architect and manage largescale data streams using Hadoop, Spark, Kafka, Hive, HBase, and Impala.
• Define and implement migration strategies, designing frameworks for seamless data ingestion into the Data Lake.
• Deliver endtoend technical expertise in NoSQL architecture, design, and development.
• Communicate complex technical concepts effectively across all organizational levels.
• Lead application design and contribute to software development (70%), including handson troubleshooting, optimization, and performance tuning.
• Partner with offerings development teams to build new capabilities leveraging BDF components aligned to business objectives.
• Demonstrate handson expertise with Databricks, DBT, Hadoop, Hive, Spark, including integration of disparate datasets.
• Perform data preprocessing using Hive, Spark, and DBT.
• Apply strong experience with the Azure Portal for resource management, monitoring, and workload optimization.
• Leverage knowledge of AI technology stacks; experience in Machine Learning and Agent development is a plus.
• Ensure adherence to the Software Development Life Cycle, including CI/CD with Jenkins, GitlLab, JIRA, and Agile practices.
• Operate independently on emergent tasks, exercising judgment to escalate when necessary.
• Exhibit patience, organization, and attention to detail in all deliverables.

Minimum Education and Experience

• 12+ years of IT experience.
• Bachelors or Masters degree in Computer Science, Software Engineering, or a related discipline.

Physical Requirements

• Extensive use of telephone and facetoface communication requiring accurate speech perception.
• Willingness to work in the UK time zone.
• Frequent keyboard use requiring repetitive finger motion.
• Regular sitting for extended periods.
• Occasional travel as required.

Educational Qualification:

• BTech/BCA/BSc/MTech/MCA/MSc