HADOOP to Databricks Migration : Lead the planning, execution, and monitoring of migration process from HADOOP Cloudera to Databricks, ensuring a smooth transition of data and workloads.
Infrastructure Design : Collaborate with cross-functional teams to design and architect the Databricks environment, optimizing it for performance , scalability and cost-efficiency.
Data Engineering : Develop and maintain ETL processes, data pipelines and data integration solutions within the Databricks platform.
Performance Optimization : Monitor and optimize Databricks clusters and workloads for efficient data processing and analysis.
Security and Compliance : Implement security best practices and ensure data compliance within Databricks environment.
Training and Support : Provide training and support to data engineering and data science teams in utilizing Databricks effectively.
Troubleshooting : Troubleshoot and resolve any technical issues that arise during the migration and subsequent
Any Graduate