Azure Data Engineer

equired Experience And Skills

Develop batch/real-time analytical solutions leveraging transformational technologies.
Create and maintain optimal data pipeline architecture.
Creates data engineering strategies that use business analytics and data platforms.
Codes, tests, and documents new or modified data systems to create robust and scalable data platform for data analytics.
Creates and maintains data catalog, interprets data results to business stakeholders and develops standards and processes for integration initiatives.
Designs key and indexing schemes and designs partitioning, constructs and implements operational data stores and data marts.

Competencies

Bachelor's in computer science, computer engineering, or equivalent work experience
Typically requires over 8 years of data engineering hands-on experience preferable in Azure platform.
Experience in Azure Data Lake, Data Factory, Data Bricks and Logic Apps.
Strong SLQ skills
Experience using Big Data batch and streaming tools.
Managing code repository in a large-scale data engineering platform.
Strong understanding of business process, design solution and deliveries

Technical Skills

Designed (or) worked-on solutions on Azure platform using Azure data factory, Azure Data Lake, Azure Data Bricks, Azure Synapse Analytics, Azure SQL, Power shell, Azure logic apps, Azure automation, Blob storage and T-SQL.
Should have done at least 1 greenfield Data Lake, Delta Lake(or) Data warehousing project in Azure landscape.
Design, build and maintain Azure Data Analytics solution.
Should be well familiarized with CI/CD in Azure DevOps platform.
Analyze, design, implement and test medium to complex mappings independently.
Strong experience in transforming large datasets as per business needs.
Should be able to write scripts in Python or any other scripting language.
Understanding of Self-Service BI/Analytics, User Security, Mobility, and other BI
Participate in design/discovery sessions and workshops with end users.
A flexible approach to dealing with ad-hoc queries.
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Proficient in Structure and semi structure data process.