Python Spark AWS Big Data design

Hadoop Spark Hive Trino Splunk

Python Py spark scikit-learn lightGBM Tensorflow

C# / .NET Logic App Kafka MQ Azure Event Hub

AWS Python Spark Glue S3

Splunk Flink Jupyter Notebook Apache Airflow Hadoop

Splunk Flink Jupyter Notebook Apache Airflow Hadoop

T-SQL / SQL Python Apache Spark Apache Airflow Microsoft SQL Server

Java Python Docker Kubernetes Pub/Sub

Python Azure Databricks Apache Spark

Python Spark SQL Azure Data Platform

Pyspark Python Datawarehouse shell scripts Spark

Scala Python Apache Spark Azure Synapse Azure Data bricks

Jira Confluence Docker Spark Bitbucket

Python SDK Python/R Scala Java