Job Description:
• Strong Experience in databricks architecture
• Hands on experience in deploying Production grade Databricks cluster
• Hands on experience in Shell scripting/Perl/Python/Hive/SQL
• Sound UNIX abilities involving user management, security & permissions
• Sound knowledge about the Hardware (CPU, memory, disk, network, Firewalls etc.)
• Sound knowledge about the clustered deployment Architecture
• Exposure to cloud AWS/Azure/GCP
• Ability to set up VMs for environment set up
• Hands on experience on databricks monitoring & ability to deploy, create plug[1]ins for custom monitoring stats
• Excellent analytical and problem solving skills are mandatory
• Very good knowledge of Delta Lake and its structure
• Create and configure DB clusters and SQL warehouses
• Control access to clusters and SQL warehouses
• Understanding of Databricks networking
• Databricks Integration and Connectivity with other systems
• Configure workspace settings
• Employ access control to secure workspace assets
• Overall should initiate cloud automation and operations
• Knowledge of Security implementation and data governance
• Secure access to external storage
• Experience of Continuous integration & delivery
Any Graduate