CI/CD AWS GCP Azure Kafka

Dataflow BigQuery AWS Azure Kafka

Python Shell scripting PySpark BigQuery DataProc

pub/sub dataflow cloud functions cloud composer big query

Cloud SQL BigQuery Dataflow Bigtable Dataform

Kafka RabbitMQA Redis Spark Amazon Kinesis

Google Cloud Composer DataFlow DataProc clusters Apache beam Hadoop

BigQuery Dataflow Dataproc Scala Python

SQL GCP Oracle MySQL Cloud Datastore

Google Big Query. SQL Dataflow DataStream Google Cloud Functions

Docker Kubernetes BigQuery Dataflow Cloud Storage

Github SQL Spanner PostgreSQL GCP

Big Query Big Table Google Cloud Storage PubSub Data Fusion

Python Java Scala SQL BigQuery

Java Python Docker Kubernetes Pub/Sub