Data Engineer

The Data Engineer will be responsible for the end-to-end design, development, deployment, and maintenance of the Metadata Registry Platform for the State Data Authority (SDA) of Uttar Pradesh. The role is positioned at the DataHub at Bharti Institute of Public Policy, Mohali, to work closely with the SDA implementation team at a BIPP and the State Transformation Commission Lucknow.

The Metadata Registry is one of the initial goals in the roadmap of SDA development. This is a platform that enables departments of the Government of Uttar Pradesh to discover, classify, and govern their data assets in line with the state s vision 2030.

The successful candidate will oversee the data pipelines, and backend development, oversee UAT, ensure deployment on the UPSDC servers, and build the monitoring dashboard.

Job Outline:

The Data Engineer will carry out the following key activities:

• Platform Architecture Design: Design the Registry s system architecture, database schema, and API layer in alignment with BIPP s technical blueprint. Ensure the architecture is modular, open-source, and deployable on the UP State Data Centre (UPSDC) infrastructure.
• Backend Development: Build RESTful APIs and backend services using Python/Node.js; develop data ingestion pipelines for dataset metadata; implement role-based access control (RBAC) for Data Owners, Stewards, and administrators.
• Compliance Dashboard: Build a real-time compliance dashboard tracking dataset registration status, classification completeness, and DPDP Act alignment across onboarded departments.
• UAT Deployment: Lead User Acceptance Testing with STC IT team and pilot departments; resolve bugs; deploy the applications to the UPSDC-compatible production environment.
• Junior DE Supervision: Mentor and technically supervise two Junior Data Engineers; review code, assign tasks, and ensure delivery quality.
• Frontend Development: Although, there will be Full Stack developers working along in the team, but the candidate is required have some knowledge of frontend frameworks to oversee and align the development work.

Job Specifications

• Bachelor s or Master s degree in Computer Science, Software Engineering, Information Technology, or related field
• Understanding of data governance frameworks and open data standards is an advantage

Specific Skills:

• Strong proficiency in Python and for backend development. Node.js experience is also welcome

• Experience with RESTful API design and development

• Frontend development using React or equivalent JavaScript framework

• Relational and NoSQL databases (PostgreSQL, MongoDB)

• Containerisation and deployment (Docker, Linux server environments)

• Familiarity with RBAC, data security, and access control patterns

• 3 6 years of experience in software development, with at least 2 years in data focused work

• Prior experience working on government or public sector digital platforms is strongly preferred

• Experience with data catalogues, metadata management, or open data portals is an advantage

• Exposure to DPDP Act, data classification, or data governance contexts is desirable

Job Interface/Relationships BIPP Project Lead; Junior Data Engineers; Data Governance Lead; Data Analyst STC IT Department; NIC / UPSDC Infrastructure team; Key Responsibilities Platform Architecture, Backend API Development Frontend Development UI/UX UAT, Deployment Production Support Junior DE Mentoring Team Coordination Total Time Spent How to Apply

All applications must be submitted exclusively through the JotForm link provided below. Applicants are required to upload their CV and cover letter directly within the form at the designated sections.

Applications will be reviewed until the position is filled. You will be contacted only in case you are shortlisted for an interview.

Indian School of Business

Gachibowli, Hyderabad - 500111

Timings : Monday- Friday, 08:00 AM IST to 06:00 PM IST

Sector 81, SAS Nagar ,Mohali - 140 306

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.