Experience: 4 to 8 Years
Technical Stack: Python Algorithms, Panda/pyspark, Apache Kafka, DevOps(Ci/CD) & Git, SQL
What you'll do
- You will be responsible for ensuring a high-quality deliverable within the Data Engineering Team. You will be:
- Adding new reports
- Writing tests
- Building deployment pipeline
- Analyse and design technical solutions
- Actively participate in the team's scrum life.
What you’ll need for this role
You will be someone who can demonstrate the following:
- Deep knowledge of Python
- Knowledge in data processing (pandas/pyspark)
- Good knowledge of SQL
- Understanding development life-cycle (CI/CD, git, conda)
- Unit testing
It would be great if you have experience on:
- Cloud (preferred GCP)
- Apache Kafka
- Apache Spark
- Message formats AVRO/Parquet/ORC/Json
- Terraform