Azure Data Engineer

Job Description

· Proficient in Python and PySpark.

· Strong knowledge of SQL.

· Experience in building and optimizing complex data pipelines in Azure.

· Hand on experience on Azure Databricks.

· Strong working knowledge on Azure components and services such as Storage Account, Azure Data Factory, Active Directory, Sy napse, Key Vault, VMSS, Function apps, web apps, Log analytics workspace , Service principal, managed identity , ACR and container instances etc.

· Should possesses knowledge about Azure networking services.

· Knowledge on Azure infrastructure creation using ARM templates.

· Well versed with GitLab and Azure DevOps.