Data Engineer – Azure Data Solutions

Responsibilities

Experience: Demonstrated experience in successfully delivering multiple end-to-end data analytics projects on Azure, following the complete software development life cycle (SDLC). Proven track record of building data pipelines for streaming, near-real time, and batch data processing, utilizing the various technologies available in Azure. Hands-on experience in developing comprehensive end-to-end solutions, with the ability to understand the big picture and contribute to and guide the team in successfully delivering projects within specified timeframes and budgets.

Data Analysis. Able to participate in business discussions and assist an Architect with gathering data requirements. Good analytical and problem-solving skills to help address data challenges.

Advanced SQL Skills. Proficiency in writing complex SQL queries for data extraction, transformation, and analysis. Knowledge of SQL functions, joins, subqueries, and performance tuning. Able to navigate source systems with minimal guidance to understand how data is related and use like data profiling to gain a better understanding of the data.

Azure Data Factory. Experience in creating and managing data pipelines using Azure Data Factory. Understanding of data integration, transformation, and workflow orchestration in Azure environments.

Azure Databricks. Knowledge of data engineering workflows and best practices in Databricks. Able to understand existing templates and patterns for development.

Python (Desired). Programming skills in Python, particularly for data manipulation and analysis.

Version Control and Collaboration. Proficiency in using Git for version control and collaboration in data projects. Ability to work effectively in a team environment, especially in agile or collaborative settings.

Automation: Experience developing solutions to automate data validations tasks using SQL/Python scripts.

Communication and Documentation. Clear and effective communication skills to articulate findings and recommendations for other team members. Ability to document processes, workflows, and data analysis results effectively.

Continuous Learning and Adaptability. Willingness to learn new tools

Requirements

MUST have experience in designing and implementing Azure Data solutions using services such as:
Azure Data Factory
Azure Databricks
MUST have working knowledge of advanced SQL queries for data extraction.
Strong communication and collaboration skills
Strong analytical thinking and problem-solving skills
Be customer-service oriented
Be able to work in a fast-paced, changing environment
MUST be proficient in spoken and written English
Formal training and/or certification on related technologies is highly valued
Minimum of three (3) years working in a similar role