Hadoop Engineer

About the job
Location: Summit, New Jersey (Hybrid - 3 days onsite, 2 days remote)

Candidate Preference: Local candidates or those willing to relocate to Summit, NJ

Work Authorization: W2 Candidates Only

Years of Experience: 6+ years

Must-Have Skills

Programming: Proficiency in Scala, Python, or Java
Big Data: Experience with Spark, Hadoop, or MapR-based middleware services programming

Preferred Skills

Cloud Computing: Exposure to cloud platforms (AWS, Azure, GCP, etc.)
Containerization: Familiarity with Docker and Kubernetes
Automation: Experience with Python-based automation

Description

We are seeking a skilled Hadoop Engineer to join our team. In this role, you will leverage your programming expertise in Scala, Python, or Java to develop and maintain middleware services on Spark, Hadoop, or MapR platforms. You will also contribute to the design and implementation of data processing pipelines, ensuring efficient and scalable solutions.

Responsibilities

Design, develop, and maintain middleware services using Spark, Hadoop, or MapR.
Write and optimize code in Scala, Python, or Java.
Implement data processing pipelines and workflows.
Collaborate with cross-functional teams to gather requirements and deliver solutions.
Troubleshoot and resolve issues related to data processing and middleware services.
Stay updated on the latest Big Data technologies and best practices.

Qualifications

4+ years of Software Engineering experience or equivalent demonstrated through one or a combination of the following: work experience, consulting experience, training, military experience, or education.
Strong programming skills in Scala, Python, or Java.
Hands-on experience with Spark, Hadoop, or MapR.
Understanding of cloud computing concepts and technologies.
Familiarity with Docker and Kubernetes is a plus.
Experience with Python-based automation is a plus.
Excellent communication and collaboration skills.