Description

Sr. Data Engineer

Remote Job |   2022-05-27 13:20:00

Apply Now

Share Job 

Job Code : HashMap055

Hi 

Role: Sr. Data Engineer

Location: Remote

Duration: 6+ Month

 

Python Data Engineers with Data Governance/ MDM

 

Python, AWS, Kafka, Airflow, Presto, Terraform, Apache Atlas, MDM, Data governance

 

 

Job Descriptions:

 

  • Experience in MDM or Data Governance in a data stewardship or engineer role
  • Data Pipelines: Experience implementing, testing, debugging and deploying data governance pipelines using 2+ of the following tools: Airflow, Kafka, Spark.
  • Access Control: Experience with implementing and managing Role Based Access Control using Spark, Presto, S3 and Apache ranger.
  • Data Lineage: Experience with the implementation and administration of data observability, discovery, and lineage solutions using open-source tooling like Apache Atlas.
  • Development: Experience with Python for backend and/or data pipeline development
  • Cloud: Experience with cloud operations management/configuration using tools like Terraform and/or Cloud formation.
  • Proficient with SQL for analytical querying and data processing.

Key Skills
Education

Any Graduate

Back To Jobs