Azure Data Engineer

Role : Data Engineer

Location - Pune/Bangalore
Experience - 5 - 10 years

Key Responsibilities

Job Description

Key Responsibilities

• Develop and maintain scalable data pipelines and integrations.
• Build automated data discovery, metadata extraction, and lineage solutions.
• Create queries and frameworks for data analysis, profiling, and reporting.
• Implement AI-powered capabilities such as schema mapping, NL-to-SQL, anomaly detection, and data quality monitoring.
• Integrate data from databases, Datalake, APIs, files, messaging systems, and cloud platforms.
• Collaborate with data engineers, architects, and AI teams to deliver modern data solutions.
• Establish data governance, cataloguing, monitoring, and observability practices.
• Support automation initiatives using AI agents and intelligent workflows.

Required Skills

• Strong SQL and data modelling expertise.
• Experience with ETL/ELT (Databricks), data pipelines, and orchestration platforms.
• Proficiency in Python (preferred), Scala, SQL
• Experience with cloud data platforms (Azure, AWS, GCP, Databricks, Snowflake, Fabric, etc.).
• Knowledge of APIs, event-driven architectures, and data governance.
• Familiarity with AI/LLM technologies, AI agents, Vector databases and knowledge graph concepts and query automation.

Nice to Have

• Neo4j, Knowledge Graphs, and graph-based data discovery.
• Azure AI Foundry, OpenAI, Claude, Codex or similar AI platforms.
• Experience with enterprise integration technologies, Kafka, and API management.

Email your updated profiles on [email protected]