Description

Job Code : EWC - 1568


Specifically we are looking for individuals who can show they have at least 8+ year of experience in AWS Data Engineering role and be in a position to be a source of knowledge for our existing data engineers. Experience with below tech is must have:
• AWS Tech Stack – Min 10 years exp
o AWS Lakeformation – Min 7+ years exp
o AWS EMR – Min 5+ years
o Apache Hudi – Min 5+ years
o Flink – 3+ years
o Aurora – 2+years
o PostgreSQL
o AWS Glue (Glue Catalog, Glue ETL and Crawler)
o AWS Athena
o Redshift – Min 5+ years
o Sagemaker/ML – Min 5+ years
o AWS Lambda
o DynamoDB
o RDS (Relational Database Services).
• AWS S3: Strong foundational concepts like object data store vs block data store, encryption/decryption, storage tiers etc.
• Implementation and tuning experience in Streaming use cased and Big Data Ecosystem (such as EMR, Hadoop, Spark, Hudi, Kafka/Kinesis etc.)
• Should be able to build scalable data infrastructure and understand distributed systems concepts from a data storage and compute perspective.
• Have a good understanding of Data Lake concepts and Data Warehouse concepts. Should be familiar with concepts on Modern Data Architecture.
• Ability to define Standards and guidelines with understanding of various Compliance and Auditing needs.
• Be proficient in Python to handle large volume data processing – atleast 10+ years
• Terraform Enterprise – Mandatory , atleast 8+ years
• Kafka
• Qlik Replicate

Additional helpful experience would include:
• AWS Services CloudTrail, SNS, SQS, CloudWatch, Step Functions
• Experience with Secrets Management Platform like Vault and AWS Secrets manager
• Experience with DevOps pipeline (CI/CD) - Bitbucket; Concourse
• Experience with RDBMS platforms and Strong proficiency with SQL
• Knowledge of IAM roles and Policies
• Experience with Event Driven Architecture
• Experience with native AWS technologies for data and analytics such as Kinesis, OpenSearch
• Databases - Document DB, Mongo DB
• Hadoop platform (Hive; HBase; Druid)
• Java, Scala, Node JS

Core Responsibilities
• Provides technical direction, guides the team on key technical aspects and responsible for product tech delivery
• Lead the Design, Build, Test and Deployment of components in collaboration with Lead Developers (Data Engineer, Software Engineer, Data Scientist, Technical Test Lead)
• Understand requirements / use case to outline technical scope and lead delivery of technical solution
• Works closely with the Product Owner to align on delivery goals and timing
• Collaborates with Data and Solution architects on key technical decisions
• Lead design and implementation of data quality check methods
• Ensures Test Driven development
• Strong skills with business stakeholder interactions
• Ensure data security and permissions solutions, including data encryption, user access controls and logging

Education

ANY GRADUATE