Pyspark
Unity Catalog
Delta Lake
Data Lake
Databricks Medallion Architecture
Clouds (Azure/AWS/GC)
Delta Live Table
Structured Streaming
Spark SQL (Expert)
Delta Sharing, Cleanroom, Databricks Market Place.
Python Programming (Panda)
Data Ingestion (Airflow/Kafka/ ADF/Glue/Bigquery)
Tuning and Optimization (liquid clustering, photon acceleration, data skew(salting, skew hint, broadcast variable, adaptive query execution) , optimize, Z-order, data skipping, Vacuum and explain plan)
Pytest
Bachelor's degree in Computer Science