Databricks

Job Description

Azure databricks (Core), Azure services (Admin), Cosmos DB, Pyspark, Python, SQL, SSIS, ETL

Streaming and batch data processing in Hadoop and Cloud Databricks environment.

Roles And Responsibilities

Propose good and optimized solutions and architecture for new/existing projects

Solutions should primarily focus on saving latency and costs in batch and streaming environment

Create cost reports for existing sources in databricks

Monitor current Azure/Databricks resources + Cost used and suggest best resources/configurations for new/existing projects

Work on databricks core projects (this can be moving sources to databricks/configuration changes etc.)