Data Engineer with MDM

Job Description:

Note - Candidate Must have Health Care experience and MDM(Master Data Management) Experience

1. Data Ingestion and Integration:

o Develop and implement data integration processes using Azure Data Factory (ADF) to extract, transform, and load (ETL) data from various sources into data warehouses or data lakes.

o Ensure efficient data cleaning, conversion, and loading.

2. Master Data Management (MDM):

o Collaborate with data governance teams to define and enforce MDM policies, procedures, and standards.

o Implement MDM solutions using tools (like Semarchy) to ensure data accuracy, completeness, and consistency across the organization.

o Oversee the development and maintenance of master data hierarchies, taxonomies, and models.

3. Data Storage and Management:

o Design and maintain data storage solutions using Azure services such as:

§ Azure SQL Database

§ Azure Data Lake Storage

§ Azure Cosmos DB

§ Azure Blob Storage

o Scale and optimize data storage systems to meet organizational requirements.

4. Big Data and Analytics:

o Utilize big data technologies like Azure Databricks and Apache Spark to handle and analyze large volumes of healthcare data.

o Create data processing workflows and pipelines to support data analytics, machine learning, and other data-driven applications.

5. Collaboration and Communication:

o Work closely with data scientists, analysts, and business stakeholders to understand data requirements and create effective data workflows.

o Collaborate with cross-functional teams to ensure data-driven decision-making within the healthcare organization.

Qualifications:

To excel in this role, you should possess the following qualifications:

· Bachelor’s degree in Computer Science, Information Technology, or a related field.

· Certifications in Azure Data Engineering (e.g., Microsoft Certified: Azure Data Engineer Associate) are a plus.

· Experience in designing, implementing, and managing data solutions on the Microsoft Azure cloud platform.

· Proficiency in the following core skills:

o Azure Databricks

o Azure Data Factory (ADF)

o Python

o PySpark

o Spark SQL

· Understanding of Master Data Management (MDM) concepts and tools.

· Healthcare/Radiology background preferred

· Knowledge of State and Federal, including HIPAA, laws and regulations pertaining to confidentiality of protected health information preferred

· Experience of working with global and offshore teams