Description

Experience: 4 to 8 Years

 

Technical Stack: Python Algorithms, Panda/pyspark, Apache Kafka, DevOps(Ci/CD) & Git, SQL

 

What you'll do

  • You will be responsible for ensuring a high-quality deliverable within the Data Engineering Team. You will be:
  • Adding new reports
  • Writing tests
  • Building deployment pipeline
  • Analyse and design technical solutions
  • Actively participate in the team's scrum life.

 

What you’ll need for this role

You will be someone who can demonstrate the following:

  • Deep knowledge of Python
  • Knowledge in data processing (pandas/pyspark)
  • Good knowledge of SQL
  • Understanding development life-cycle (CI/CD, git, conda)
  • Unit testing

 

It would be great if you have experience on:

  • Cloud (preferred GCP)
  • Apache Kafka
  • Apache Spark
  • Message formats AVRO/Parquet/ORC/Json
  • Terraform

Education

Any Graduate