Role Summary:
We are seeking an experienced Database Engineer specialist to join our team in Summit, NJ. This position is part of a pilot program and supports oversight and surveillance within the EFT CLARPILOT/VMOCRST line of business. The candidate will be responsible for data acquisition and data processing engineering, primarily focusing on two new application setups and strategic implementation for a legacy application over the next few years.
Key Responsibilities:
- Develop and maintain Big Data Hadoop and Spark ETL processes
- Design and model databases to support new and existing applications
- Perform SQL performance tuning to ensure optimal database performance
- Write and maintain Unix Shell scripts and manage job scheduling with Autosys
- Participate in Agile methodologies, including daily stand-ups and JIRA task management
- Provide risk updates and communicate effectively during team calls
- Collaborate with an 8-person team to support data for multiple systems
Skills Required:
- 5 years of data engineering experience
- Proficiency with Spark, Hive, and Scala
- Strong understanding of Agile methodologies and experience with JIRA
- Solid experience in data modeling and database design
- Expertise in SQL performance tuning
- Competence in Unix Shell scripting and Autosys