Azure Databricks

Job Description

Azure data bricks (Core), Azure Admin and platform services, Python, SQL, SSIS, ETL

Roles and responsibilities

Propose good and optimized solutions and architecture for new/existing projects

Solutions should primarily focus on saving latency and costs in batch and streaming environment

Create cost reports for existing sources in databricks

Monitor current Azure/Databricks resources + Cost used and suggest best resources/configurations for new/existing projects

Work on databricks core projects (this can be moving sources to databricks/configuration changes etc.)

Collect requirements from customer and lead the offshore team to deliver the projects assigned