Data Engineer

What you’ll do:

● Manage data analysis to develop fact-based recommendations for in house projects.

● Profile big data and develop in depth analytics on the impact of new rules for Entity

Resolution

● Collaborate with Technology, Security, Data Privacy, Data Governance, and IT Operation

teams to support the movement, scanning and analyzing of data assets migrated to GCP

● Conceptualize, analyze, and develop actionable recommendations for strategic challenges.

● 5+ years’ experience working with Data Schemas and Data formats such as JSON, Parquet,

AVRO etc

● Present results and recommendations to internal and external customers

What experience you need:

● GCP preffered (Associate Cloud Engineer) / AWS / Azure certification or readiness to obtain cloud certification before your start day

● Bachelor’s degree in Computer Science, Statistics, or other engineering fields

● Minimum of 5 years professional experience (that must include 3 years experience in Data

Engineer, Data Wrangler, and/or similar positions).

● Minimum of 2 years of experience performing analysis using Google BigQuery, BigTable, and

other Google Cloud Platform technologies, Google DataFlow, DataStream, Scala+ Spark or

PySpark is a plus.

● Minimum of 2 years of experience in virtualized or public cloud platforms, ideally Google Cloud

Platform, Amazon Web Services or Microsoft Azure.

● Experience with Change Data Capture

● Excellent problem solving skills with the ability to design algorithms (this experience may

include data cleaning, data mining, data clustering and pattern recognition methodologies)

● Expertise in relational databases, NoSQL (or related technologies), SQL

● At least one general purpose programming such as Python, Scala, is required.

● Agile development including Scrum and other lean techniques is a plus.

What could set you apart:

● Master’s degree (preferred) in Computer Science, Data Science, Analytics or Statistics or

other engineering fields

● Strong knowledge of credit bureau data

● Experience in Entity Resolution concepts, prototype or hand-on project.

● Graph database, AI/ML tools usage to solve large scale business problems

● Experience in Data Visualization and storytelling