Job Description:
Mandatory Skill: Hadoop and Scala, Hands on coding experience in Spark and Scala, SQL a must
Desired Skills: strong in spark with good knowledge on Hadoop
Job Description• Create Scala/Spark jobs for data transformation and aggregation.
• Produce unit tests for Spark transformations and helper methods
• Write Scala doc-style documentation with all code
• Design data processing pipelines