Data Engineer

5+ years of experience in a Data Engineer role, with a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.

·       Very good knowledge in 

• SQL (7+ out of 10)
• Databricks on Azure (7+ out of 10)
• PySpark (7+ out of 10)
• SparkSQL (7+ out of 10)
• Azure/ADLS  (7+ out of 10)

·       Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.

·       Great numerical and analytical skills

·       Data engineering certifications/Azure is a plus

·       Create and maintain optimal data pipeline architecture

·       Analyze and organize raw data 

·       Write pseudo code

·       Combine raw information from different sources

·       Explore ways to enhance data quality and reliability

·       Working with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues

·       Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

·       Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

·       Experience supporting and working with cross-functional teams in a dynamic environment.

·       Build processes supporting data transformation, data structures, metadata, dependency, and workload management