Senior Data Engineer

About the job

Job Description:

Required:

• A relevant technical BS Degree in Information Technology

• 5+ years writing SQL queries against any RDBMS with query optimization.

• 5 years of data engineering experience leveraging technologies such as Snowflake, Azure Data Factory, ADLS Gen 2, Logic Apps, Azure Functions, Databricks, Apache Spark, Scala, Synapse, SQL Server

• Experience with scripting tools such as Power Shell, Python, Scala, Java and XML

• Understanding the pros and cons, and best practices of implementing Data Lake, using Microsoft Azure Data Lake Storage

• Experience structuring Data Lake for the reliability, security and performance.

• Experience implementing ETL for Data Warehouse and Business intelligence solutions.

• Skills to read and write effective, modular, dynamic, parameterized and robust code, establish and follow already established code standards, and ETL framework.

• Strong analytical, problem solving, and troubleshooting abilities.

• Good understanding of unit testing, software change management, and software release management

• Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as Code fundamentals

• Experience performing root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement.

• Experience working within an agile team.

• Excellent communication skills