Airflow-Snowflake Data Engineer

Job Description:

• Senior data engineer with over 5 years’ experience performing ETL work using stored procedures. Candidate must have 6 or more years of experience working on services S3, Lambda, Airflow (MWAA), Secrets Manager, Cloud Watch Exp. on other services such as AWS, IAM, Cloud Formation, CI\CD etc. is preferable.
• Snowflake or SQL expertise - 3 or more years of experience working on Data Ingestion/Transformation/Loading. Strong understanding of relational database concepts & technology – data modeling (dimensional/snowflake), SQL, query optimization, data warehouse architecture.
• 2 or more years of Hands-on experience on coding languages Python, Unix
• Responsible for monitoring the data loads for multiple applications, ensuring failures are addressed, perform RCA and remediation steps.
• Logical thinking and problem-solving skills along with an ability to collaborate.
• Work with offshore team on a day-to-day basis for daily status and mentor them.
• Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
• Knowledge on snowflake and ability to tune the queries, address the data issues, automation of manual activities.
• Managing the cloud environment from a holistic point of view, ensuring it meets all the company\\'s requirements.
• Carrying out deployment, maintenance, monitoring, and management tasks within this implemented cloud structure.
• Completing the integration of new applications into the cloud environment.
• Offering training and guidance to all whose roles bring them into contact with the cloud structure.
• Working with business clients to understand their needs and to implement the strategies designed to meet those needs.
• Conducting migration, where necessary, to bring tools and other elements into the cloud.
• Ability to work with clients to identify business challenges and contribute to client deliverables by refining, analyzing, and structuring relevant data.
• Govern the application handover, ensure the defined documentation and checklist has been followed for seamless transition.
• Performs data and code analysis required to troubleshoot data related issues and assist in the resolution of data issues