Azure Databricks Engineer

Responsibilities
Develop and maintain scalable data pipelines within Azure Databricks
Design and implement data modeling, data warehousing, and data lakes using Azure services
Utilize PowerBI for creating insightful dashboards and interactive reports
Write SQL queries and scripts for data manipulation and retrieval
Ensure data quality and consistency across Ziosk and other data sources
Optimize data processing performance within Azure Databricks
Collaborate with cross-functional teams to gather and understand data requirements 
Qualifications
Proficiency in PowerBI
Proficiency in DAX (Data Analysis Expressions)
Skilled in PowerQuery for data transformation
Experience in creating robust dashboards and reports
Strong background in data visualization techniques and tools
In-depth knowledge of SQL, including Data Query Language (DQL), Data Manipulation Language (DML), and Data Definition Language (DDL)
Experience with SQL Server database management
Proficient with PySpark
Knowledge of Apache Spark and its core components
Ability to write and optimize Spark SQL queries
Experience with Spark DataFrame and Spark Streaming
Familiarity with Databricks Unity Catalog
Experience with Azure DevOps