Data Engineer

3+ Years of Development / Data Engineering Experience
• 2+ Years Developing with AWS Cloud solutions
• 2+ Years Developing in Spark/PySpark
• 2+ Years Developing AWS Glue ETL
• 2 + Years AWS Storage models (S3 and DynamoDB)
• Some hands-on developing with on-prem ETL tooling (Ab Initio preferred, Informatica)
Additional Skills:
• Strong experience in AWS GLUE, EMR, Hudi, experience extracting data from multiple sources & loading data into Data Lakes, AWS Redshift
• Experience working with AWS Elastic search, RDS, PostgreSQL preferred
• Experience w/ AWS services such as Lambda, EMR, SNS/SQS, EventBridge, LakeFormation & Athena
• Experience in Requirements Analysis, Data Analysis, Application Design, Application Development & Integration Testing
• Working knowledge of on-prem Extraction, Transformation, Cleansing and Loading methodology and principles
• Experience implementing and adding to DevOps principles (GitLab, maintaining CI/CD pipelines)
• Experience in Java svcs is nice to have
 

Desired Skills and Experience

AWS