SDLC AWS Step Functions AWS MWAA DocumentDB DynamoDB

SQL Spark Hadoop

Scala java Spark Java Framework's: Spring Spring Boot

AI/ML Spark

AI/ML Spark Airflow Python TensorFlow/PyTorch

Agile Azure DevOps Azure Data Factory (ADF) Azure Data Brick Python

Azure Data Engineering RDBMS Airflow ADF API

Python Spark SQL PySpark Azure Synapse Azure SQL

SQL Python Databricks pySpark

AWS Lamdba API Gateway Kinesis Python

Spark Scala

Scala Spark

Spark SQL Hadoop Hive

Azure Data Factory (ADF) Azure Databricks Python PySpark Azure SQL

Python PySpark Azure SQL Azure Synapse