Data Operations Engineer

Job Overview

The Data Operations Engineer shall apply specialized knowledge in writing high-performance SQL queries and data engineering solutions that moves, cleans, and loads data to differing systems. The person will interact with team members within IT to gain understanding of the business environment, technical context, and strategic direction. This person will also be responsible for generating documentation as needed; conform to security and quality standards; and stay current on emerging trends. Teams supported include: Application Engineering, Data Platform Engineering, Data Engineering, and Business Analytics

To be a successful candidate for this position, you must:

Be comfortable with researching data questions, identify root causes, and interact closely with business users and technical resources on various data related decisions

Proactively identify and assist in solving recurring data quality or data availability issues.

Have experience in monitoring, troubleshooting, and resolving ETL issues.

Be able to develop high performance data queries, stored procedures and/or functional code for data related ad-hoc reporting and/or ETL batch triage.

Understand how to profile code, queries, programming objects and optimize performance

Aspire to be efficient, thorough, and proactive

Responsibilities and Duties

Monitors, supports, triages data pipelines and ETL tasks that ingest, move, transform, and integrate data in a secure and performant manner.

Prepares necessary SQL scripts to perform data manipulation in key systems to address data related application and reporting needs.

Document requirements and translate into proper system requirements specifications using high-maturity methods, processes, and tools.

Designs, prepares, and executes unit tests.

Participates in cross-functional teams.

Represents team to clients.

Contributes to strategic direction for teams.

Consults with team members and other organizations, clients, and vendors on complex issues.

Work on Special projects as requested

Performs other duties as assigned

Qualifications

Bachelor’s degree in IT preferred. Equivalent combination of education and experience may be substituted in lieu of degree.

2+ years of Microsoft SSIS package development experience including experience with Microsoft Visual Studio

2+ years of experience working with enterprise data warehouses

4+ years of experience in SQL and be able to write complex logic using SQL as part of ETL, and use SQL effectively to perform complex data analysis and discovery.

Exposure to Azure and Azure Data Factory

Exposure to an Enterprise Data Lake

Demonstrate strong organization skills and detail-oriented

Experience with CMD shell and PowerShell

Experience with large-scale, complex data environments

Ability to self-motivate and meet deadlines

Intense desire to learn

Ability to analyze data to figure out issues/patterns

Ability to express complex technical concepts effectively, both verbally and in writing

Ability to multi-task in a fast-paced, changing environment

Ability to maintain confidentiality