Data Engineer

JD:

• Design and build a greenfield commercial analytics platform on Microsoft Azure
• Design cloud architecture and patterns
• Ingest structured data for analytic consumption from a wide range of sources with Azure Data Factory
• Design data lake patterns with Azure Data Lake Storage gen 2
• Build an extensible analytics compute environment with Azure Databricks that can used directly by the end user as well as integrated with additional components like Power BI
• Prioritize modularity. reusability. and componentization of solutions
• Enable ease of use with documentation. templates. scripts. and wrapper APIs that allow a data analyst to get up and running with their preferred data sources and compute as quickly as possible
• Work collaboratively with a distributed cross org team of engineers. architects. and data analysts
• Manage pipelines for CI. CD and Release Management workflows. Github Jenkins integration.
• Must have experience and understanding of modern Identity and Access Management concepts and best practices Required Qualifications
• Excellent written and verbal communication skills and ability to work independently as well as with a team
• 5 years experience with Microsoft Azure
• 3 years experience with Databricks on Azure
• 3 years experience with Azure Data Factory (ADF)
• 3 years experience with Azure Logic Apps
• 3 years experience with Azure Data Lake Storage gen 2 (ADLS2)
• 3 years experience with Terraform
• 3 years experience with API. systems. and cloud architecture design
• 3 years experience doing analytics platform. infrastructure work
• 3 year with a relevant langauge (Java. Scala. Python or Go)
• Experience of working on Azure key vault. Kubernetes secrets. Hashicorp vault
• Experience of working on Azure. on premises AD. authentication. and authorization with OIDC and OAuth2 methods
• Cloud monitoring Experience with Azure Monitor. Azure Application Insights. and Log Analytics Workspace or other open source tools Preferred Qualifications
• Experience with Azure Power BI
• Experience with Azure Synapse
• Experience with Azure Cosmos DB
• Experience with SQL Server
• Experience with AI and ML (esp. in Azure)
• Experience doing analytics platform. infrastructure work in the healthcare space
• Experience integrating with disparate data sources (EPIC. Hadoop. Oracle. etc.)
• Experience with Tableau
• Experience writing Spark jobs (Scala).
• Azure Certification
• Experience working in the healthcare industry with PHI. PII