Data Engineer

Key Responsibilities:

Design, develop, and maintain data pipelines using Azure Data Factory (ADF) to facilitate the movement and transformation of data.
Implement ETL/ELT processes to extract, transform, and load data from various sources into data warehouses and data lakes.
Develop and optimize SQL queries and scripts to ensure efficient data retrieval and transformation.
Work with Microsoft SQL Server (MSS) and PostgreSQL databases, including database design, performance tuning, and data modeling.
Collaborate with data architects and analysts to design and implement data warehousing solutions that support business intelligence and analytics needs.
Utilize dbt (data build tool) to manage data transformation workflows and ensure data quality and consistency.
Apply knowledge of .NET or Python to develop custom data processing solutions and automation scripts.
Monitor and maintain data pipelines to ensure data accuracy, reliability, and performance.
Collaborate with cross-functional teams to understand data requirements and deliver scalable data solutions.
Implement data governance and security best practices to protect sensitive information.
Qualifications:

Bachelor's degree in Computer Science, Information Technology, or a related field. A Master's degree is a plus.
Proven experience as a Data Engineer, with a strong focus on Azure Data Factory (ADF) and cloud-based data solutions.
Proficiency in SQL, with experience in writing complex queries, optimizing performance, and database design.
Experience with Microsoft SQL Server (MSS) and PostgreSQL databases.
Strong understanding of ETL/ELT processes and data warehousing concepts.
Experience with dbt (data build tool) for managing data transformation workflows.
Proficiency in .NET or Python for custom data processing and automation.
Knowledge of data governance, data security, and compliance best practices.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills, with the ability to work effectively in a team environment.
Preferred Qualifications:

Azure certifications related to data engineering, such as Microsoft Certified: Azure Data Engineer Associate.
Experience with other data integration tools and technologies.
Familiarity with big data technologies and frameworks.