Azure Data Engineer

 Responsible to create and maintain optimal data pipeline architecture,

Assemble large, complex data sets that meet functional / non-functional business requirements.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure ‘big data’ technologies.

Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.

Proven track record in troubleshooting Azure cloud services and addressing production issues like performance tuning and enhancement.

Requirements :

Hands on experience working on Azure building required Data Pipelines and transformation.

Ability to read and write back to snowflake as our cloud DB is snowflake.

Strong experience in building and managing pipelines using Azure DataFactory, Databricks, Azure Datalake.

Strong analytical skills and good understanding of data structures and algorithms