About the job
Primary Skill (Top 3 mandatory skills) - Azure databricks, Pyspark, ADF
Job Description:
As a Data Engineer specializing in Azure Databricks, PySpark, and Azure Data Factory, you will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions. You will collaborate with data scientists, analysts, and other stakeholders to support data-driven decision-making across the organization.
Key Responsibilities:
Develop and maintain ETL processes using Azure Data Factory and Azure Databricks.
Write efficient PySpark scripts for data transformation and processing.
Design and implement data models, data pipelines, and data integration workflows.
Collaborate with data scientists to support data analytics and machine learning initiatives.
Monitor and optimize data processing performance and cost efficiency in Azure.
Any Graduate