Apache Beam

·        In-depth understanding of Google's product technology and underlying architectures

·        Google Cloud SQL

·        JAVA GCP

·        AIGEE

·        Big Query

·        Google Cloud Platform

·        DataFlow (Apache Beam) – reusable Flex templates/ data processing frameworks using Java for both batch and stream needs.

·        Pub/Sub, Kafka, Confluent Kafka – Real time streaming of database changes or events.

·        Experience of designing, building, and deploying production-level data pipelines using Kafka; Strong experience working on Event Driven Architecture

·        Strong knowledge of the Kafka Connect framework, with experience using several connector types HTTP REST proxy, JMS, File, SFTP, JDBC etc.

·        Experience in handling huge volumes of streaming messages from Kafka

·        Knowledge on BigTable

·        Cloud SQL, Compute Engine, Cloud Function, Cloud Run and App Engine, Cloud Storage

·        Experience with open-source distributed storage and processing utilities in the Apache Hadoop family