Job Description
The role is of Cloud data engineer who has hands-on experience AWS DMS, Glue and Athena. The candidate must be familiar at least in one Data ware housing concepts such as ODS/Marts and must have done at least one end to end data processing pipeline designing. Nice to have familiarity with AutoSys (job scheduler) and MDM (master data management). He/she should be capable of handling the ETL design and implementation solely and would work towards creating a positive and innovation friendly environment. The incumbent would be responsible to create new capabilities.
Roles & Responsibilities
- Collaboration & coordination with multiple business partners.
- Develop pipelines to ingest data from different sources such as Database, delimited files etc, do complex transformation and loading data into the S3.
- Develop Glue mapping and create Glue data catalogue.
- Implementation of Athena.
- Can optimize Informatica for performance improvements.
- SQLs capability for data analysis.
- Able to handle the end-to-end ETL or ELT pipeline solely.
- Ensuring the work is delivered on time and with quality.
Requirements
- Extensive practical experience in Information Technology and software development projects of with at least 5+ years of experience in developing data warehouse systems.
- Extensive experience in on cloud data technologies – in particular on AWS.
- Strong understanding of ETL and data warehouse concepts processes and best practices.
- Good understanding of Big data and cloud technologies
- Possess a combination of solid business knowledge and technical expertise with strong communication skills.
- Demonstrate excellent analytical and logical thinking.
- Good verbal & written communication skills and ability to work independently as well as in a team environment providing structure in ambiguous situation.
Good to have
- Understanding of Insurance Domain
- Good understanding of Master Data Management and Data Governance.
- Basic understanding of data visualization tools like SAS VA, Tableau
- Good understanding of implementing & architecture data solutions using the AWS components