Description

Job Description:

Mandatory Skill: Hadoop and Scala, Hands on coding experience in Spark and Scala, SQL a must

Desired Skills: strong in spark with good knowledge on Hadoop

Job Description• Create Scala/Spark jobs for data transformation and aggregation.

• Produce unit tests for Spark transformations and helper methods

• Write Scala doc-style documentation with all code

• Design data processing pipelines