AWS – Databricks Architect

Lead and manage a team of engineers and Sr engineers by providing guidance, mentorship, and fostering a collaborative work environment.

Establish and maintain positive relationships with client stack holders

Consult with client on project status, proposals, and technical issues and provide post-implementation support to them

Facilitates communication and collaboration between onshore and offshore teams, and ensure the successful design, development and execution of the product\project\deliverables on time

Experience in POC development, Capacity sizing, Tool Evaluation

MUST Have

Possess excellent written and verbal communication skills.

Ability to run ETL jobs in Databricks

Unity catalog with delta, MongoDB, regular s3 based parquet files

Delta format based S3

Ability to articulate pros and cons of delta format

Ability to run Databricks with AWS glue catalog

Monitoring of Databricks jobs

Operations related experience of Databricks jobs

Best practices of setting up nested ETL jobs

Scheduling of jobs in Databricks

Passing runtime parameters to ETL jobs

Handling experience in AWS in data engineering project

Ability to coordinate/work with team in India

Good to Have

Experience in client facing role