Azure Databricks

Primary Skills: Azure ADF, Databricks with Pyspark, PythonData Engineer with Pyspark, Databricks skillset

8+ years of experience Data Engineering with min 5+ years hands on experience in Pyspark for data transformations.
Sound Knowledge on - Azure Data Bricks, Azure Data Lake.
Sound knowledge in Data Bricks & Logic AppsDelta Lake, Azure SQL and Azure blob storage, Azure logic apps, Azure Functions and Azure Synapse, Azure Purview.
Extensive knowledge on big data concepts like Hive, and spark framework.
Should be able to write complex SQL queries. Sound understanding of DWH concepts.
Strong hands-on experience on Python or Scala.
Hands on experience on Azure Data Factory.
Should be able to coordinate independently with business stake holders and understand the business requirements.
Knowledge on DevOps and Agile methodologies-based projects, implement the requirements using ADF/Data Brick
Knowledge of version control tool such as Git/Bitbucket.
Should have basic understanding on Batch Account configuration, various control and monitoring options.