Data engineer - Snowflake

Data engineer - Snowflake

Franklin,United States

Contract

Skills

data modeling

Snowflake

Snowpipe

ETL

AWS

sql

show less

Data engineer - Snowflake

Location :- Franklin TN (Day 1 onsite)

Responsibilities:

Design, implement, and manage Snowpipe to automate and streamline the ingestion of data files from Amazon S3 into Snowflake.

Ensure the reliability and timeliness of data ingestion processes, and monitor their performance.

Utilize Snowflake Streams to capture and manage changes in data.

Write and maintain stored procedures to process, transform, and move data between different layers within Snowflake.

Optimize Snowflake performance through query tuning and managing storage costs.

Collaborate with data architects, data analysts, and other team members to understand data requirements and align with project goals.

Coordinate with stakeholders to identify and resolve data-related issues or improvements.

Diagnose and resolve issues related to data ingestion, transformation, and Snowflake operations.

Provide support for ongoing maintenance and enhancement of Snowflake data solutions.

Develop and maintain comprehensive documentation for Snowflake architecture, data pipelines, transformation processes, and best practices.

Required Skills:

Minimum of 10+ years of experience in IT, including at least 4 years of hands-on experience with Snowflake.

Proven experience with Snowflake’s Snowpipe for data ingestion, Snowflake Streams for change data capture, and stored procedures for data processing and transformation.

In-depth knowledge of Snowflake’s architecture, features, and best practices.

Strong understanding of integrating Snowflake with Amazon S3 for data ingestion and management.

Advanced SQL skills, including the ability to write complex queries, perform data manipulation, and optimize query performance.

Comprehensive knowledge of data warehousing concepts, data modeling, ETL processes, and data governance.

Strong analytical skills for troubleshooting and resolving complex data issues and performance problems.

Excellent communication skills to convey technical information clearly to non-technical stakeholders.

Ability to work collaboratively with team members and stakeholders across different departments.

Basic experience with AWS services, including fundamental understanding and use of services such as Amazon S3.

Preferred Skills:

Snowflake certification(s) is a plus.

Experience with programming languages such as Python or JavaScript

Education:

Bachelor’s degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus.