Bs/ Ms in CS / Software / electrical engineering / OTHER with 3+ years experience in data engineering / software development / business intelligence and with manipulating, processing and extracting value from datasets
Experience working with large data sets with Databricks, Spark / PySpark, SQL building and maintaining applications at scale for end to end implementation in Azure Services
Knowledge with Cloud platform Azure
Data expertise to manipulate and integrate big data and different data types such as text, tables and Documents using Python and PySpark communication skills with the ability to oversee solutions to Data scientists, Reporting teams and business audiences.
Knowledge on Artifactory / VersionOne/Jira/Confluence
Must have:
Proficient in Python & PySpark coding experience
Proficient in ETL, Databricks, SQL, Azure Services