python data reconciliation validation pandas numpy pyspark

Big Data solution Cloud platform AWS GCP Azure Pyhon Pyspark Hadoop

Java PySpark Scala

data pipelines Databricks Python SQL Spark

python pyspark JSON SQL databricks

Python PySpark T-SQL / SQL Apache Spark Apache Airflow

DWH Data Warehousing Extract Jenkins Microsoft SQL Server

Python Scala Pyspark SQL/PLSQL Datamodelling

data warehousing DW/BI ETL Azure Data Factory Databricks

Python SQL PySpark Docker AWS

AWS Glue Step functions IAM Cloudwatch Cloudformation

Python / Pyspark notebooks Spark SQL Data Management Design and Development

Apache Kafka Apache Spark Hadoop NoSQL PySpark

Python C# Java SQL Git

Python DataBricks PySpark AWS SQL