Data Engineer

Description

It is with Client Loyalty. They are building out a scoring engine for their merchants. Very similar to Rewards for issuers.

Data Engineer (2)

Downtown San Francisco - Three days in office. T/Th mandatory.

12 Month Contract

Experience dealing with large volumes of data, from various sources, both structured and unstructured.

Ability to triage and talk through performance / scaling issues of dealing with data at scale.

Good understanding of how data will be read (file formats, partitioning, bucketing).

Extensive experience writing testable jobs using Spark (or equivalent) framework.

Programming & Scripting Languages: Java EE, Scala, Spark, SQL, Bash.

Software Architectures (micro-services, event driven, peer-to-peer).

Application Security.

Asynchronous Pub-Sub and Point to Point Messaging Systems.

Streaming within the Hadoop ecosystem is a plus