Python Scala SQL Spark SQL DataFrame API

Spark Kafka AWS SQL Databricks / AWS

MapReduce HDFS Spark Presto HBase

Python Spark Hadoop

(MapReduce Yarn HDFS Hive Spark

Java design implementation Spark Drill

(MySQL PostgreSQL SqlServer Oracle (MapReduce

Apache Spark Automation Big Data Hive Java

Azure Synapse Azure Data Bricks Data Factory ADLS SQL

Hive HDFS Apache Spark PySpark Python

Spark Spark engine Scala PySpark Pig

ETL YARN Spark Hive Hadoop

Java Scala Python Iceberg Delta

Hadoop Hive Pig Oozie Map Reduce

Python efficient SQLs Apache Spark