Databricks Specialist

About Cognida.ai Our Purpose is to boost your competitive advantage using AI and Analytics.

We Deliver tangible business impact with data-driven insights powered by AI. Drive revenue growth, increase profitability and improve operational efficiencies.

We Are technologists with keen business acumen - Forever curious, always on the front lines of technological advancements. Applying our latest learnings, and tools to solve your everyday business challenges.

We Believe the power of AI should not be the exclusive preserve of the few. Every business, regardless of its size or sector deserves the opportunity to harness the power of AI to make better decisions and drive business value.

We See a world where our AI and Analytics solutions democratise decision intelligence for all businesses. With Cognida.ai, our motto is ‘No enterprise left behind’.

Job Title: Databricks Specialist

Location: Hyderabad/Hybrid

Employment Type: Full-Time

Job Description

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• 6-10 years of experience in Data Engineering with deep expertise in Databricks
• Strong core Python programming skills.
• Experience in scripting and programming using Python, SQL, Spark SQL, or PySpark.
• Experience with Azure services such as Azure Functions, ADF Data Flows, Logic Apps, and FAST/REST APIs.
• Work with key data engineering technologies such as ADLS, ADF, Azure Databricks, Azure SQL, applying your big‑data experience to deliver scalable solutions.
• Experience with big data technologies such as Kafka, Hadoop, and Spark, with familiarity in stream‑processing systems .
• Experience using data pipeline and workflow orchestration tools like Azkaban, Luigi, or Airflow .