Lead data Engineer

Job Description

• Experienced Data management specialist responsible for developing, overseeing, organizing, storing, and analyzing data and data systems
• Participate in all aspects of the software development lifecycle for Snowflake solutions, including planning, requirements, development, testing, and quality assurance
• Work in tandem with our engineering team to identify and implement the most optimal solutions
• Ensure platform performance, uptime, and scale, maintaining high standards for code quality and thoughtful design
• Troubleshoot incidents, identify root causes, fix and document problems, and implement preventive measures
• Able to manage deliverables in fast paced environments

Areas of Expertise

• At least 8-10 years of experience designing and development of data solutions in enterprise environment
• At least 5+ years' experience on Snowflake Platform
• Strong hands-on SQL and Python development
• Experience with designing and development data warehouses in Snowflake
• A minimum of three years' experience in developing production-ready data ingestion and processing pipelines using Spark, Scala
• Strong hands-on experience with Orchestration Tools e.g. Airflow, Informatica, Automic
• Good understanding on Metadata and data lineage
• Hands on knowledge on SQL Analytical functions
• Strong knowledge and hands-on experience in Shell scripting, Java Scripting
• Able to demonstrate experience with software engineering practices including CI/CD, Automated testing, and Performance Engineering.
• Good understanding and exposure to Git, Confluence and Jira
• Good problem solving and troubleshooting skills.
• Team player, collaborative approach, and excellent communication skills