Data Engineer

About the job
Job Description

We are seeking a skilled Azure Databricks Developer with proficiency in PySpark and Azure Data Factory to join our team. The ideal candidate will have a strong background in big data processing, ETL (Extract, Transform, Load) processes, and cloud technologies.

Key Responsibilities:
Data Engineering and Development:
Design and develop data pipelines using Azure Databricks and PySpark.
Implement data transformation logic using PySpark to process large datasets efficiently.
Create, configure, and monitor Apache Spark clusters within Azure Databricks.