We're having an urgent position for a Azure DevOps/DataOps Architect – With Data Engineering projects
Location: Remote
Experience:12+ Years
We need candidates with DevOps experience with a data engineering background in 1 or 2 Data Engineering projects. Consultant must have implemented using Azure stack of data engineering tools like ADF, ADB, ARM templates, and other Azure security and networking configuration. Experienced, hands-on DevOps Architect with experience establishing a DevOps for data platform and process for an Azure cloud Data warehouse and data pipeline platform. Looking for someone who has Implemented Azure Devops on at least 2 projects. DevOps in the data area (Azure Data Factory, Databricks, etc.). Good communication skills
Experienced, hands-on DevOps Architect with experience establishing a DevOps for data platform and process for an Azure cloud Data warehouse and data pipeline platform.
Building and optimizing data pipelines to facilitate the extraction of data from multiple sources and load it into data warehouses.
Understanding of extract, load, transform (ELT) and extract, transform, load (ETL) tools. Using automation to streamline data processing to reduce development time and increase data reliability.
Hands-on experience to automate manual processes, such as data extraction and testing.
Hands-on experience managing the production of data pipelines.
Communicate and collaborate with other data and BI team members to enhance the quality of data products.
Hands-on experience with Design, Develop and Executing automated testing at every stage of a pipeline to increase productivity while reducing errors. This includes unit tests (testing separate components of a data pipeline) as well as performance tests (testing the responsiveness) and end-to-end tests (testing the whole pipeline).
Hands-on experience with testing and adopting solutions and tools that adhere to the DataOps best practices.
Hands-on skills on IaC Automation to improve development and deployment processes.
Implement DevOps for data process for the pilot scope including code repository folder structure and Branching Strategy
Deploy DevOps for data pipelines, SQL Artifacts, and all components for the Pilot Scope
Work with Infrastructure Engineer for IaC design and development of static and dynamic components including KMS, Secrets Roles, Policies, Clusters, Pipelines, DDL/DML, etc.
Migrate dev code to QA using the DevOps Framework
Integration testing of DevOps for data framework in the QA environment
Update DevOps for data Track documentation as necessary
Any Graduate