Mandatory Skills: Terraform, Databricks, Unity Catalog, Governance and Security for the databricks platform, Azure (platform), Integration/configuration experience of databricks with Github, Jenkins and reporting tools such as Tableau
• A proven track record of administration, engineering, and operationalizing the Databricks platform in a production mode at scale for Data Engineering, Data Science or MLOps use cases.
• Experience working in Azure.
• Strong experience with infrastructure as code technologies (eg Terraform).
• Strong experience with Python.
• Experience with integrating other platforms like Snowflake, Tableau, MongoDB with Databricks.
• Experience with streaming use cases and Databricks streaming technologies including Delta Live Tables.
• The ability to leverage new technologies to test, build, and optimize data platform processes, pipelines, transformations, architectures, and data sets.
• Expert level SQL knowledge in a variety of data engines (for example, Snowflake, MySQL, CosmosDB, SQL Server) is a big plus.
Any Graduate