Sr. Cloud Data Engineer (Python, Snowflake, AWS)
Remote Job | 2022-02-18 10:30:26
Share Job
Job Code : 2022-HMP0004
Sr. Cloud Data Engineer (Python - 70%, Snowflake - 30%, AWS)
Remote
12+ months Contract
Job Descriptions:
We are looking for a savvy Senior Cloud Data Engineer to join our growing team of data professionals. The hire will be responsible for optimized data pipelines. The ideal candidate is an experienced data pipeline builder and data engineer who enjoys optimizing data systems and building them from the ground up. The candidate will support our software engineers, developers, data architects, data analysts, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be quick learners, self-directed and comfortable supporting the data needs of multiple teams, systems, and products.
Major Duties & Responsibilities:
• Develop, construct, test and maintain ETL/ELT architectures
• Align architecture with business requirements
• Data acquisition and ingestion for data at rest or streaming data
• Develop data set processes
• Use programming language and tools
• Identify ways to improve data reliability, efficiency and quality
• Conduct research for industry and business questions
• Use large data sets to address business issues
• Possibly deploy sophisticated analytics programs, machine learning and statistical methods
• Prepare data for predictive and prescriptive modeling
• Find hidden patterns using data
• Use data to discover tasks that can be automated
• Deliver updates to stakeholders based on analytics
Technical Skill Sets (Mandatory):
• Advanced Experience with implementing cloud data warehouses – Snowflake, AWS Redshift, Azure SQL Data Warehouse, or Google BigQuery experience considered
• Advanced Experience with building data pipelines - using a variety of different technologies; Azure Data Factory, Matillion, DBT, Python & Spark
• Candidates must have direct work experience developing and deploying at least one project where they implemented the full cloud data pipeline documented on their resume
• Advanced understanding of SQL (at least 4 years)
• Need to be well versed in Software engineering principles around Object Oriented Programming & SOLID principles.
• Excellent development experience with Python (3-4 Years)
• Strong ability to gather and track requirements
• Must have experience with DevOPS i.e., (Git+CI/CD+IaC)
• Experience with Docker containers, including containerizing services and deploying containers in a cloud environment
Any Graduate