Description

Sr Data Engineer

Remote Job |   2022-05-25 10:23:14

Apply Now

Share Job 

Job Code : Hash054

Role : Data Engineer

Location: Remote

Duration: 6+ Month 

Python Data Engineers with Data Governance/ MDM

Primary Skills : 

Python, MDM, Data Governance , Kafka, Air flow 

 

Job Descriptions:

 

  • Experience in MDM or Data Governance in a data stewardship or engineer role
  • Data Pipelines: Experience implementing, testing, debugging and deploying data governance pipelines using 2+ of the following tools: Airflow, Kafka, Spark.
  • Access Control: Experience with implementing and managing Role Based Access Control using Spark, Presto, S3 and Apache ranger.
  • Data Lineage: Experience with the implementation and administration of data observability, discovery, and lineage solutions using open-source tooling like Apache Atlas.
  • Development: Experience with Python for backend and/or data pipeline development
  • Cloud: Experience with cloud operations management/configuration using tools like Terraform and/or Cloud formation.
  • Proficient with SQL for analytical querying and data processing

Education

Any Graduate