Data Engineer + Full stack Development

Job Title: Data Engineer + Full stack development
Experience Required: 3 -6 Years
Location: Bangalore - On-site(5 days)
Job Type: Full-Time

Key Responsibilities:

Data Engineering: Design, build and optimize large-scale ETL/data pipelines using Databricks, PySpark and SQL to ingest, transform and persist structured data into cloud data catalogs/lakehouses.

Pipeline Optimization: Tune Spark jobs using adaptive query execution, caching, partitioning and join optimizations to handle high-volume datasets efficiently.

Data Warehouse & SQL Development: Develop and maintain complex T-SQL stored procedures and queries for pre-computing business metrics, aggregations and derived datasets in SQL Server.

AI & LLM Applications: Build and deploy LLM-powered chatbots and AI automation using Azure OpenAI and Claude/GPT models to enable natural-language querying and automated report generation.

Automated Reporting: Develop AI-driven weekly report generators and change-detection notification systems that summarize data changes and send automated email alerts to stakeholders.

Backend Development: Design and implement RESTful APIs using .NET Core / ASP.NET with clean architecture patterns (Controllers, Services, Repositories, Models).

Frontend Development: Build responsive, data-intensive Vue.js 3 + Vuetify web applications with advanced filters, editable grids, pivot tables and real-time data interactions.

End-to-End Delivery: Own the full data flow from source databases through ETL pipelines, APIs and frontend dashboards for planning and analytics applications.

Integration & Configuration: Manage secure integrations with cloud services, key vaults, SMTP, JDBC and OpenAI APIs for production notebooks and web apps