Description

Azure Data Lake (ADL), ADB, Py spark, Python, MySQL
Job Responsibilities:
Develop and maintain scalable data pipelines using Azure and PySpark. Extract, load, and transform data from various sources into cloud data warehouses. Format and distribute custom data extracts through APIs, SFTPs, and other mediums. Design and optimize data storage solutions based on business needs. Assist in database structure design, schema design, and database testing. Define company data assets, data models, and data quality protocols. Troubleshoot database issues and improve data retrieval times using SQL. Collaborate with technical and non-technical stakeholders across various business units. Facilitate and troubleshoot database connectivity between internal and external resources. Implement and enforce enterprise reference architecture, data governance, and security guidelines.
Qualification Requirements:
Bachelor's degree in Information Systems, Software Engineering, Computer Science, Data Engineering, or related field (Master s preferred).
Experience with Azure Stack (Data Lake, Blob Storage, Azure Data Factory, Databricks) and on-premises Microsoft SQL Server. Proficiency in ETLELT processes, ingesting data into cloud-native data warehouses. Experience with Python, PySpark. Strong verbal and written communication skills.
Preferred experience with DataRobot, Domino Data Labs, Salesforce MC, Veeva CRM. Familiarity with Snowflake Warehouse and statistical concepts (e.g., regression analyses, hypothesis testing, Client modeling).Experience with healthcare marketing analytics, healthcare data claims, and medical coding sets (ICD, HCPCs, NPIs).
(1.) To be responsible for providing technical guidance to a team of developers, enhancing their technical capabilities and increasing productivity. (2.) To conduct comprehensive code reviews, establish and oversee quality assurance processes, performance optimization , implementation of best practices and coding standards to ensure successful delivery of complex projects. (3.) To ensure process compliance in the assigned module, and participate in technical discussionsorreview as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations). (4.) To collaborate with stakeholders to define project scope, objectives, deliverables and accordingly prepare and submit status reports for minimizing exposure and closure of escalations.

Education

Any Graduate