Lead Data Engineer

About the job
Looking for a 6+ yrs experienced Data Engineer

Responsibilities

1. Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities

2. Understand requirements and business process knowledge in order to transform the data in a way that’s geared towards the needs of end users

3. Ensure that the data architecture is scalable and maintainable

4. Work with the business in designing and delivering correct, high quality data solution

5. Investigate data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions

6. Prepare documentation for further reference

7. Help team in data migration work

Skills

1. Experience of at least ETL tool (AWS Glue,Step Functions, Lambda) a. Experience of Python and Flash API

2. Knowledge of API development

3. SQL knowledge (query performance tuning, index maintenance, etc.) as well as an understanding of database structure

4. Knowledge of data modeling principles

5. Organizational skills: time management and planning

6. High attention to detail

7. Passionate about complex data structures and problem solving

8. Expertise in scripting languages (Python, Bash, Perl, etc.)

9. Handling DMS activity for data migration work