Azure Databricks Architect

Job Title: Azure Databricks Architect

Location: Raritan, NJ (Onsite)

Long Term Project

Job Responsibility:

"experience in databricks architecture

Hands on experience in deploying Production grade Databricks cluster

• Hands on experience in Shell scripting/Perl/Python/Hive/SQL

• Sound UNIX abilities involving user management, security & permissions

• Sound knowledge about the Hardware (CPU, memory, disk, network, Firewalls etc.)

• Sound knowledge about the clustered deployment Architecture

• Exposure to cloud AWS/Azure/GCP

• Ability to set up VMs for environment set up

• Hands on experience on databricks monitoring & ability to deploy, create plug[1]ins for custom monitoring stats

• Excellent analytical and problem solving skills are mandatory

• Very good knowledge of Delta Lake and its structure

• Create and configure DB clusters and SQL warehouses

• Control access to clusters and SQL warehouses

• Understanding of Databricks networking

• Databricks Integration and Connectivity with other systems

• Configure workspace settings

• Employ access control to secure workspace assets

• Overall should initiate cloud automation and operations

• Knowledge of Security implementation and data governance

• Secure access to external storage

• Experience of Continuous integration & delivery"