Data Engineer with Azure Databricks and Python

Job Description:

Requirements

Candidate must be proficient in Databricks with minimum 4 yrs development experience

Understands where to obtain information needed to make the appropriate decisions

Demonstrates ability to break down a problem to manageable pieces and implement effective  timely solutions

Identifies the problem versus the symptoms

Manages problems that require involvement of others to solve

Reaches sound decisions quickly

Develops solutions to meet business needs that reflect a clear understanding of the

objectives  practices and procedures of the corporation  department and business unit

Roles  Responsibilities

Provides innovative and cost effective solution using databricks

Optimizes the use of all available resources

Develops solutions to meet business needs that reflect a clear understanding of the objectives  practices and procedures of the corporation  department and business unit

Learn adapt quickly to new Technologies as per the business need

Develop a team of Operations Excellence  building tools and capabilities that the

Development teams leverage to maintain high levels of performance  scalability  security and availability

Skills

The Candidate must have 8 yrs of experience in ETL with atleast 4 yrs experience in databricks

Hands on experience on Azure

Experience on Python scripting

Relevant experience with ETL methods and with retrieving data from dimensional data models and data warehouses

Strong experience with relational databases and data access methods  especially SQL Knowledge of Azure architecture and design