GBQ Developer

Job Description:

Professional experience in Data Engineering using Google Big Query (GBQ) and Google Cloud Platform (GCP) data sets and building data pipelines.

• Hands on and deep experience working with Google Data Products (e.g. BigQuery, Dataflow, Dataproc, Dataprep, Cloud Composer, Airflow, DAG etc.).

• Python Programming Expert PySpark, Pandas

• Experience in Airflow (Create DAG, Configure the variables in Airflow, Scheduling)

• Big Data technologies and solutions (Spark, Hadoop, Hive, MapReduce) and multiple scripting and languages (YAML, Python).

• Experience in DBT to create the lineage in GCP.