Spark SQL Spark streaming AWS GCP Azure

aws kafka Azure GCP Spark Streaming

Spark Code Spark SQL Data frames Spark Streaming Spark MLiB

Scala HDFS Hive Spark Streaming