Data Engineer

Responsibilities

Collaborate with engineers, product managers and data scientists to understand data needs, representing key data insights in a meaningful way. 
Communication with internal team members and stakeholders in other time zones for the purpose of requirements clarification and progress reporting. 
Develop solutions to manage core master data and quality. 
Independently design, build and launch new data extraction, transformation and loading processes in production, mentoring others around efficient queries. 
Deep experience building data management. 
Data safety and a keen understanding of data management life cycle is critical for this role. 
Crisp communication and the ability to influence decisions is also important. 
Program Management capabilities will be needed to successfully deliver in this role.

Qualifications

5+ years of experience with SQL, ETL, data modelling, and at least one programming language (e.g., Python, C++, C#, Scala, etc.). 
Hands-on experience with data quality management capabilities and analysis. 
Experience with the data pipeline and workflow management tools: Airflow, etc. 
Experience with stream-processing systems: Spark-Streaming, Kafka etc. 
Nice to have: Experience in implementing industry leading MDM solution capabilities for Entity Management, Hierarchy Management, Data Cleansing, Match and Merge, etc. 
Nice to have: Experience building and optimizing ‘big data’ data pipelines, architectures and data sets