Senior Data Engineer

Overview: We are on the hunt for a skilled Senior Data Engineer to enhance our Engineering team. This role focuses on developing, optimizing, and overseeing our data and data pipeline architecture to support comprehensive data analysis and the creation of innovative products. Ideal candidates are experts in data pipeline construction, passionate about refining data systems, and capable of designing them from scratch.
Key Responsibilities:

• Design and maintain scalable data pipelines, ensuring reliable data collection and processing.
• Work collaboratively with data analysts and scientists, enhancing data delivery and architecture across projects.
• Develop and optimize our data architecture to support new products and data initiatives.
• Manage raw data transformation into analyzable formats for Business Intelligence analysis.
• Implement improvements in data reliability, efficiency, and security.
• Engage in continuous research and problem-solving to enhance data storage and management systems.
• Contribute to the creation of a modern, cloud-based Data and Analytics platform for the US market.

Tech Requirements:

• Proficiency in AWS Cloud and Snowflake.
• Expertise in DBT and Astro/Airflow ETL for data pipeline management.

Education and Experience:

• BS in Computer Science, Data Science, or a related field.
• At least 7 years of experience in software development or data engineering.
• A minimum of 5 years working with DBT and Airflow.
• Strong foundation in SQL, data modeling, and various datastores (relational, columnar, document stores).
• Demonstrated ability to build and optimize 'big data' pipelines and architectures.
• Experience in ETL pipeline design, tooling, and execution.
• Proven analytical skills for unstructured datasets and process improvement.