Data Engineer-Conversational Analytics

My responsibilities:

Provide trusted data for conversational analytics, including a semantic layer, metric definitions, and a business glossary that text-to-SQL questions can use
Maintain, develop, and optimize the data layer of AI us cases in the global data lake environment, ensuring high data quality, reliability, and overall performance
Design and implement high-performance data processing pipelines and workflows utilizing Python, Spark, and Databricks
Manage scalable and efficient data integration and processing solutions using Databricks
Establish robust data management processes and execute advanced data querying and quality control with SQL and big data technologies
Automate operational tasks and support infrastructure maintenance by leveraging shell scripting and foundational UNIX knowledge
Support data modelling initiatives for coherent structure design and document all technical processes to ensure operational continuity

Strong background and understanding of database data management (general SQL knowledge, data querying, data quality control)
Strong programming knowledge in Python (pyspark)
Advanced level Big Data / data lake framework (Spark, Databricks)
Strong cloud knowledge and handling of Databricks
Basic familiarity with UNIX operating system, especially shell scripting
Basic understanding of network level problems and connectivity requirements
Basic understanding of data modelling principles and semantic layers (metric definitions, business glossaries) for conversational analytics
Data-centric mindset
Structured, analytical thinking
Strong communication skills
Well-organized

A constantly growing organization and increasing opportunities
Secure, long-term job opportunity
Varied and engaging job responsibilities
The chance to build data products used by colleagues across the international organization
Outstanding salary
Flexible work arrangements
Home office possibility

Please use our online application and attach your resume.