Must have Skills: Azure DevOps (Expert), Terraform (Strong)
Experience Range: 8-14 yrs expr.
Experience of working with: DWHA tooling (DBT, DVB) and Snowflake
CI/CD Pipeline Development & Maintenance: Design, implement, and maintain Azure-based CI/CD pipelines for data platforms to automate and streamline data engineering processes.
Infrastructure as Code (IaC): Utilize scripting languages like Terraform, Python, and other automation tools to define and manage infrastructure.
Platform Enablement: Enable DevOps best practices by optimizing development platforms and tools for data engineering teams.
Project Ownership: Work independently on brownfield implementations, ensuring smooth integration and modernization of existing systems.
Collaboration & Support: Collaborate with cross-functional teams to troubleshoot, enhance platform efficiency, and support the transition to mesh architecture.
Monitoring & Optimization: Continuously monitor pipelines and infrastructure for performance, scalability, and security, making improvements as necessary.
Good to have: Data Mesh Architecture: Enable and support Data Mesh architecture by establishing decentralized data infrastructure, promoting domain-oriented data ownership.