Data Engineer

Primary Skill Set

5-7 years of experience as a Spark & Databricks developer.
Experience in Azure components like Azure Data Bricks, ADLS Storage, Key Vault, Azure SQL.
Able to understand Optimizations on Spark, and SQL
Work experience in Python and Good knowledge in at least one popular Python framework (like Django, Flask, or Pyramid)
Writing scalable code using Python programming language.
Experience with Active Directory Authentication Excellent analytical problem solving and debugging skills Familiar with Visual Studio Code
Familiarity with testing tools.(Unit, Functional and Load testing)
Ability to collaborate on projects and work independently when required.
Good to have delta lake and unity catalog knowledge.
Azure Git working experience.
Secondary Skill Set

Good understanding over Azure Devops and should be able to understand Azure Arm template script and make changes whenever it’s required.
Work experience with pandas
API debugging skills