Sr. Data Engineer - Scala, Spark, Python, Big Data

Mandatory Skills

Scala, Spark, Python and Big Data.

Job Description:

10+ Years of Overall IT experience.
3+ Years experience - Scala
5+ Years of experience - AWS (all services needed for Big Data pipelines like S3 , EMR , SNS/SQS , Event bridge, Lambda , CloudWatch , MSK , Glue , Container services etc.) . Spark . Scala, Hadoop
3+ Years of experience - Python . Shell scripting, Orchestration (Airflow or MWAA preferred) . SQL . CI/CD (Git preferred and experience with Deployment pipelines) , Devops (including supporting production stack and working with SRE teams)
3+ Years of experience - Architecture and Design of cloud based Big Data pipelines.
2+ Years of experience - Infrastructure as code (Terraform preferred)
2+ Years of experience - Spark streaming, Healthcare Domain & Data Standards.
Scrum team leadership experience
Nice to Have - Azure , Big Data and/or Cloud certifications.