aws kafka Azure GCP Spark Streaming

java Oracle PostgreSQL PL

rest apis rest api etl pipelines pipeline

Python PySpark v SQL

Python PySpark SQL

Snowflake Elt Data Migration Devops Tools Agile

SPARK Java/Scala SQL Kafka Airflow

Azure Data platform DataBricks Datafactory pyspark

SPARK Java/Scala SQL Kafka Airflow

Java Angular GCP SQL Elastic

Apache Spark Hive Yarn Java Scala

Terraform BigQuery BigTable GCP Python

Java/Scala BigQuery DataProc Kafka SQL

Apache Beam Data Flow Python Gcp REST/SOAP

Sql Api Unit Testing Integration Testing Test Cases