Description

Pyspark
Unity Catalog
Delta Lake
Data Lake
Databricks Medallion Architecture
Clouds (Azure/AWS/GC)
Delta Live Table
Structured Streaming
Spark SQL (Expert)
Delta Sharing, Cleanroom, Databricks Market Place.
Python Programming (Panda)
Data Ingestion (Airflow/Kafka/ ADF/Glue/Bigquery)
Tuning and Optimization (liquid clustering,  photon acceleration, data skew(salting, skew hint, broadcast variable, adaptive query execution) , optimize, Z-order, data skipping, Vacuum and explain plan)
Pytest

Education

Bachelor's degree in Computer Science