BIG DATA ENGINEER

Job Description:

Key Job Responsibilities

Analyze data needs and objectives within the broader journey

Source, analyze and organize raw data, prepare data for transformation and consumption.

Develop analytical tools and content.

Identify ways to improve data governance, reliability, efficiency, and quality.

Build applications ensuring that the code follows latest coding practices and industry standards. Build using modern design patterns and architectural principles. Ensure developed solutions remain compliant with all applicable Prudential standards. Solve complex problems and provides new perspective on existing problems. Develop through collaboration and deliver application component solutions.

Develop high quality, well documented, and efficient code supporting testing and automation.

Support product owner in defining future stories and tech lead in defining technical designs.

Participate in design conversations and develop the business logic and backend systems of the MVP experience. Participates in the design conversations; conveys ideas within train and to groups outside of train.

Competencies – Knowledge, Skills, Abilities

Candidate with 5+ years of experience in a Data Engineer role who has attained a degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.  Should have experience using following software/tools:

 Build processes supporting data transformation, data structure, metadata, dependency, and workload management.

Successful history of manipulating, processing, and extracting value from large, disconnected structured and unstructured datasets.

Advanced working SQL knowledge and experience working with relational databases.

Experience building and optimizing data pipelines, architecture, and data sets.

Working knowledge of message queuing, stream processing, and highly scalable data stores.

Strong project management and organization skills.

Experience supporting and working with agile cross functional teams in a dynamic environment

Background in financial services functions strongly desirable.

Top 5 Skills Required:

• Big data tools
• Relational and NoSQL databases
• Data pipeline and workflow management tools
• AWS cloud services
• Stream processing systems
• Object oriented and scripting language