GCP Data Engineer

Job Description
Must be willing to have some overlap hours with the India based data engineering team
Must be willing and able to work in a global project environment across multiple time zones
Project is very fast paced with tight deadlines
10+ years of experience in designing and implementing large scale data processing/data storage/data distribution systems
Extensive experience working with large data sets with hands-on technology skills to design and build robust Big Data solutions using Spark framework, GCP Big data services and industry standard frameworks
Ability to work with a multi-technology/cross-functional teams and key stakeholders to guide/manage a full life-cycle solution
Extensive experience in Relational and MPP database platforms like (GCP Bigquery/Hive/Cloud SQL etc)
Open source Hadoop stack/Spark framework
Strong understanding of Big Data Analytics platforms and ETL in the context of Big Data
Excellent problem solving, hands-on engineering skills and communication skills
Broad understanding and experience of real-time analytics
Participate in full Software Development Life Cycle (SDLC) of the Big Data Solution

Technical Skills Required
Any combination of below technical skills
Hadoop : HDFS, MapReduce, Hive, Airflow
DW : Bigquery, Hive
Languages : Python, PySpark, Shell Scripting, SQL Scripting
Cloud : GCP Big data native services
Any RDBMS/DWBI technologies
Spark(Mandatory): Spark on GCP Dataproc

Roles & Responsibilities
Position Activities and Tasks
Extensive design and development complex and high performance Data architecture development experiences
Participating and leading key engagements, in developing plans and strategies of data management processes and IT programs for the business, providing hands on assistance in data modeling, technical implementation of big data solutions
Facilitating, guiding, and influencing the clients and teams towards right information technology architecture and becoming interface between Business leadership, Tech leadership and the delivery teams
Leading and mentoring other developers within the team
Identify the performance bottle-necks and resolve the same
Ability to produce high quality work products under pressure and within deadlines
To coordinate with developers / other architects / other stakeholders and cross functional teams from organization