Data Engineer-Conversational Analytics

My responsibilities:

• Provide trusted data for conversational analytics, including a semantic layer, metric definitions, and a business glossary that text-to-SQL questions can use
• Maintain, develop, and optimize the data layer of AI us cases in the global data lake environment, ensuring high data quality, reliability, and overall performance
• Design and implement high-performance data processing pipelines and workflows utilizing Python, Spark, and Databricks
• Manage scalable and efficient data integration and processing solutions using Databricks
• Establish robust data management processes and execute advanced data querying and quality control with SQL and big data technologies
• Automate operational tasks and support infrastructure maintenance by leveraging shell scripting and foundational UNIX knowledge
• Support data modelling initiatives for coherent structure design and document all technical processes to ensure operational continuity

The knowledge I own:

• Strong background and understanding of database data management (general SQL knowledge, data querying, data quality control)
• Strong programming knowledge in Python (pyspark)
• Advanced level Big Data / data lake framework (Spark, Databricks)
• Strong cloud knowledge and handling of Databricks
• Basic familiarity with UNIX operating system, especially shell scripting
• Basic understanding of network level problems and connectivity requirements
• Basic understanding of data modelling principles and semantic layers (metric definitions, business glossaries) for conversational analytics
• Data-centric mindset
• Structured, analytical thinking
• Strong communication skills
• Well-organized

The offer that would convince me:

• A constantly growing organization and increasing opportunities
• Secure, long-term job opportunity
• Varied and engaging job responsibilities
• The chance to build data products used by colleagues across the international organization
• Outstanding salary
• Flexible work arrangements
• Home office possibility