Job Responsibilities
Technical Leadership -Lead data integration across the enterprise thru design, build and implementation of large scale, high-volume, high-performance data pipelines for both on-prem and cloud data lake and data warehouses. Lead the development and documentation of technical best practices for ELT/ETL activities. Also, oversee a program inception to build a new product if needed.
Solution Design - Lead the design of technical solution including code, scripts, data pipelines, processes/procedures for integration of data lake and data warehouse solutions in an operative IT environment.
Code Development - Ensures data engineering activities are aligned with scope, schedule, priority and business objectives. Oversees code development, unit and performance testing activities. Responsible to code and lead the team to implement the solution.
Testing - Leads validation efforts by verifying the data at various middle stages that are being used between source and destination and assisting others in validating the solution performs as expected. Meets or exceeds all operational readiness requirements (e.g., operations engineering, performance, and risk management).
Ensure compliance with applicable federal, state and local laws and regulations. Complete all required compliance training. Maintain knowledge of and adhere to company's internal compliance policies and procedures. Take responsibility to keep up to date with changing regulations and policies.
Requirements:
DataStage ETL development
IICS ETL development
Snowflake development experiences
Snow pipe hands on experiences
Creating GitHub workflows
Strong PL SQL experiences
Tidal, Jira, Power BI, Python, SQL experiences
Working on large data experiences
Bachelor's degree