JD:
· will be responsible for providing technical expertise in deploying applications on Azure Databricks platform.
· The Databricks Administrator must be self-motivated and apply knowledge of Azure to drive solutions, support the development team, and create documentation to support and describe technical solutions.
· An ideal candidate will have technical Azure platform expertise and demonstrate high standards of accountability, customer focus, and quality.
You will:
· Work with key stakeholders in the WM Strats, Algo and Modeling teams in the design, development and implementation of large Databricks environments
· Work closely with members of WM Strats, Alog and Modeling team to facilitate Machine learning models using Spark/PySpark/Pytorch etc.,
· Manage Databricks environments in line with security guidelines o Develop Infrastructure as Code(IaC) to automate databricks environment deployments.
· Develop a library of scripts to automate databricks MLOps environments.
· Perform Production deployment and model monitoring to ensure stable performance and adherence to standards
QUALIFICATIONS:
· Professional experience with 5-7 years of experience developing and implementing models in Cloud ecosystem, i.e., AWS/Azure/GCP, Databricks, SageMaker, or any other similar distributed computing technology
· Proficiency with any one of Databricks, SageMaker, DataIku or similar tools
· Partnered with Cloud solution architect and development team to fully understand product requirements and configure the a Machine learning platform which meet these requirements
· Good written and verbal communication skills
You might also have:
· Good to understand a multitude of Azure resources and services such as containers, virtual machines, storage, log analytics, alerting, metrics, Azure AD, Key Vaults, Azure Backup
Bachelor's degree