Data Engineer

Job Description

Sr. Data Engineer

Summary

Qualifications

Minimum Qualifications

Bachelor's Degree in Engineering, Computer Science, CIS, or related field (or equivalent work experience in a related field)

6 years of progressive experience in Data, Software Engineering (preferably started with Software Engineering and transitioned to Data)

Preferred Qualifications

Master's Degree in Computer Science, CIS, or related field

6-8 years of experience in Hadoop, NO-SQL(at least 5 years exp), RDBMS or any Cloud Big Data components

3 years of experience in systems analysis, including defining technical requirements and performing high level design for complex solutions

3 years of experience writing technical documentation in a software development environment

5 years of experience working with source code control systems

Experience working with Continuous Integration/Continuous Deployment tools

Expertise in Java/Scala, SQL, Scripting, Hadoop (Sqoop, Hive, Pig, Map Reduce), Spark (SQL, Spark Streaming, MLib), equivalent Cloud Big Data components

Experience in Streaming integration of Kafka using Kafka client/connectors (using Spring boot or similar)

Experience in building restful API's(Microservices) to expose Data using frameworks like Spring boot.