Description

Role Summary:

We are seeking an experienced Database Engineer specialist to join our team in Summit, NJ. This position is part of a pilot program and supports oversight and surveillance within the EFT CLARPILOT/VMOCRST line of business. The candidate will be responsible for data acquisition and data processing engineering, primarily focusing on two new application setups and strategic implementation for a legacy application over the next few years.

 

Key Responsibilities:

  • Develop and maintain Big Data Hadoop and Spark ETL processes
  • Design and model databases to support new and existing applications
  • Perform SQL performance tuning to ensure optimal database performance
  • Write and maintain Unix Shell scripts and manage job scheduling with Autosys
  • Participate in Agile methodologies, including daily stand-ups and JIRA task management
  • Provide risk updates and communicate effectively during team calls
  • Collaborate with an 8-person team to support data for multiple systems

 

Skills Required:

  • 5 years of data engineering experience
  • Proficiency with Spark, Hive, and Scala
  • Strong understanding of Agile methodologies and experience with JIRA
  • Solid experience in data modeling and database design
  • Expertise in SQL performance tuning
  • Competence in Unix Shell scripting and Autosys

 


 

Education

Bachelor's Degree