Description

Job Description :
Must have 5 + years of experience as GCP Data Engineer.
The Data Engineer will be responsible for developing and supporting database applications to drive automated data collection, storage, visualization, and transformation as per business needs.
Understand the existing IBM streams pipelines
Able to write Custom templates in Apache Data flow (Apache Beam)
Migrate the Stream pipelines to Data Flow
Able to handle Billions of records/day volume in real-time streaming systems and write the pipelines in Flink / Dataflow over GCP
Able to perform the Quality check on the data (Data validation)
Work experience over the CICD like Jenkins and constructing them over the cloud Database design, Data Modelling and Mining.
Consolidate data across multiple sources and databases to make it easier to locate and access.
Implement automated data collection and data storage systems.
Write complex SQL queries and stored procedures.
Work with multiple data systems and large relational databases.

Education

Any gradudate