Data Engineer

Job Description:

•       5+ years of experience in a Data Engineer role, with a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.

•       Very good knowledge in 

• SQL (7+ out of 10)
• Databricks on Azure (7+ out of 10)
• PySpark (7+ out of 10)
• SparkSQL (7+ out of 10)
• Azure/ADLS  (7+ out of 10)

•       Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.

•       Great numerical and analytical skills

•       Data engineering certifications/Azure is a plus

•       Create and maintain optimal data pipeline architecture

•       Analyze and organize raw data 

•       Write pseudo code

•       Combine raw information from different sources

•       Explore ways to enhance data quality and reliability

•       Working with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues

•       Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

•       Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

•       Experience supporting and working with cross-functional teams in a dynamic environment.

•       Build processes supporting data transformation, data structures, metadata, dependency, and workload management