SRE with Cloud Platform

Job responsibilities-

Setup and maintain production scale Databricks environment on Microsoft Azure

Setup and maintain production scale ADLS for multiple tenant teams using our Data Platform

Study Hadoop Platform workloads, understand the data relationship, and prepare them for migration to Databricks on Azure cloud

Develop tools, operational improvements, and automated solutions that enable self-service configuration changes, speed deployments, and improve monitoring and alerting solutions such as Splunk, PagerDuty, Prometheus for workloads running on Databricks on Azure

Assure security compliance and implement Adobe Security & Compliance solutions to lock down data used by Databricks

Implement onboarding automation for tenants on Databricks on Azure

Troubleshoot Linux production environments and collaborate with other Infrastructure teams on discussions about Security, Infrastructure, networking, Storage topics.

Build CI/CD tooling using: Jenkins, Spinnaker, Salt, Azure DevOps, etc.

Work with 3rd party vendor for troubleshooting and support on Databricks on Azure

What you need to succeed:

Experience managing and working with Apache Hadoop and related technology like Yarn, Hive, Oozie, HDFS, etc.

5+ years of experience working with large data sets using open-source technologies such as Spark, Hadoop, Kafka on one of the major cloud vendors such as AWS, Azure, and Google Cloud

2+ years of experience working with Databricks on Cloud

Security oriented mind, always on the lookout for ways to secure large set of data

Automation skills, eager to automate anything with the use of any scripting language or tool

Understands the business need as well as the technical need of using a monitoring framework

Experience with on-prem Hadoop migration to Azure

Great communication, interpersonal skills to work with internal/external customers.

Ability to work autonomously, be results-oriented and a strong team leader

Preferred Qualifications:

Bachelor’s or master’s degree with equivalent experience in Computer Science or equivalent technical fields

4+ years of commercial software development and/or technical operations experience, and experience handling large-scale cloud-based applications through standard software engineering methodologies.

Best way to Reach me through the mail
THANK YOU,