Azure Data Engineer

Job Description

Summary: The Azure Data Engineer will be responsible for designing, developing, and maintaining data pipelines, data models, and data storage solutions using Azure services. The candidate will work closely with cross-functional teams to ensure successful delivery of projects and support business objectives. The ideal candidate should have a strong technical background in managing data platforms and architecture using Azure services and experience in data warehousing, data integration, and ETL tools. This is a 6-month contract position in a HYBRID work environment. The on-site location is 1385 Canal St SE, Washington, DC 20003 

Responsibilities

Design, develop, and maintain data pipelines using Azure Data Factory to ingest data from various sources such as SQL Server, MongoDB, and Blob Storage into Azure SQL Database and Azure Cosmos DB and Kafka

Build data transformation logic using Databricks and Spark for data processing and analytics. Experience in tuning Databricks environments

Design / implement data models for data warehousing on Azure SQL DB

Configure and manage Hadoop and Spark clusters in Azure HDInsight for big data processing

Configure and manage Hadoop and Spark clusters in Azure HDInsight for big data processing

Implement data governance an

d security measures to protect sensitive data

Collaborate with cross-functional teams to ensure successful delivery of projects and support business objectives

Mentor junior data engineers and developers and stay up-to-date with emerging technologies and trends in Azure data engineering