Dataops / Devops Engineer

Responsibilities:

🚀 Design, develop, and implement data pipelines using cutting-edge tools such as Apache Airflow.
⚙️ Monitor and optimize ELT data pipelines for peak performance, reliability, and scalability.
🔍 Troubleshoot and resolve issues related to data pipelines, ensuring data integrity and quality.
💡 Utilize dbt for data transformation, optimizing its usage and operations while establishing standards and best practices.
🌐 Implement and maintain data governance practices, including data lineage and metadata management.
👥 Collaborate closely with the DevOps team to ensure seamless integration and deployment of data pipelines using GitLab.
📰 Stay up-to-date with industry trends and best practices in data engineering and orchestration.

Requirements:

🎓 Proven experience as a DataOps Engineer or in a similar role with a minimum of 10 years of hands-on experience.
🚀 Strong proficiency in data orchestration tools, particularly Apache Airflow.
💡 Solid understanding of data engineering concepts and best practices.
💻 Proficiency in Git, Python, and SQL.
🔄 Experience with data transformation tools, especially dbt.
☁️ Experience with AWS cloud platform (Redshift, MWAA, Glue, Lambda, S3).
📊 Familiarity with data quality and data observability tools.
🛠 Familiarity with DevOps tools (e.g., GitLab) and concepts (CI/CD, containerization).
🤖 Strong problem-solving and troubleshooting skills.
🗣 Excellent communication and collaboration abilities