Azure Data Engineer

Position Overview: We are seeking a skilled Azure Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in data engineering, working with Azure cloud services, and designing and implementing scalable data solutions. You will play a crucial role in developing, optimizing, and maintaining data pipelines and architectures, ensuring data quality and availability across various platforms.

Key Responsibilities:

Design, develop, and maintain data pipelines and ETL processes using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics

Build and optimize data storage solutions using Azure Data Lake, Azure SQL Database, and Azure Cosmos DB

Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions

Implement data quality checks, data governance, and security best practices across data platforms

Monitor, troubleshoot, and optimize data workflows for performance and scalability

Develop and maintain data models, data cataloging, and metadata management

Automate data integration and transformation processes using Azure DevOps and CI/CD pipelines

Stay up-to-date with emerging Azure technologies and data engineering trends

Qualifications:

Bachelor’s degree in Computer Science, Information Technology, or a related field

6+ years of experience in data engineering with a focus on Azure cloud services

Proficiencyin Azre Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure SQL Database

Strong experience with SQL, Python, or other scripting languages

Familiarity with data modeling, ETL design, and big data tools such as Hadoop or Spark

Experience with data warehousing concepts, data lakes, and data pipelines

Understanding of data governance, data quality, and security best practices

Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment

Azure certification (e.g., Microsoft Certified: Azure Data Engineer Associate) is a plus

Experience with Azure Logic Apps, Azure Functions, and API Management

Knowledge of Power BI, Tableau, or other data visualization tools