Jenkins Travis CircleCI Azure Pipelines AWS Code Build

Spark Hadoop MR Kafka Java Scala

Python Node Golang Spark Scala

Azure Data Factory Databricks Agile ADO Ansible

Java Scala Python Java8+ Kafka

Hadoop Hive Pig Spark Python

Azure ADLS Gen2 Databricks Azure Data Factory SQL NoSQL

Snowflake Architect Snowflake data migration Snow SQL Performance tuning Talend

Python PySpark Scala Java Spark

Azure ADF Databricks with Pyspark Azure Data Bricks Azure Data Lake SQL

Azure ADF Databricks Pyspark Azure Data Bricks Azure Data Lake

Python Java/Scala/Ruby

Python Scala Azure Data Factory SQL Databricks

AWS AWS Sagemaker Python R Scala

Delta Lake Azure SQL Python Scala Azure Data Factory