Databricks Architect

Job Description

12-15+ years relevant experience in building data strategy on various data management tools.
Extensive experience in Databrick (8-10 years)
Integrate and transform data from various sources, ensuring data quality and consistency.
Write and optimize Apache Spark code in Scala, Python, or other supported languages.
Analyze business requirements and design efficient and scalable data processing solutions using Databricks.
Collaborate with data scientists, analysts, and business stakeholders to understand data needs and requirements.
Strong SQL skills for querying and manipulating data in various data storage systems.
Proficiency in at least one programming language, such as Scala or Python, for implementing data processing logic.
Knowledge of ETL (Extract, Transform, Load) tools and methodologies.
Experience designing and implementing data pipelines for efficient data movement and transformation.
Understand the Databricks Unified Analytics Platform and its components.
Proficiency in using Databricks Notebooks for interactive data exploration and development.