Kafka Developer

Position Description:

Join Our High-Performing Investment Banking Capital Markets IT Team as a Java Developer!

We are seeking a talented Kafka Developer with Java to be part of our dynamic Investment Banking Capital Markets IT team. In this role, you will work with cutting-edge technology to address complex business challenges. Our team operates within an Agile
framework, promoting a fast-paced environment that is ready to deliver impactful solutions.

This position is based in Jersey City and follows a hybrid model, requiring you to be in the office three days a week (please note, fully remote options are not available).

Your future duties and responsibilities:

Develop backend Big Data services architecture using Kafka Framework(Kafka Connect/Kafka streams

Develop Kafka consumers to read and process messages from Kafka topics for downstream systems or applications.

Optimize the performance of Kafka producers, consumers, and clusters, tuning configurations for memory, throughput, and latency.

Develop the underlying framework to rewrite the enterprise services using the newly developed architecture

Plan for Kafkas scalability, ensuring the infrastructure can handle increased message throughput as the system grow

Work with client engineering and DevOps teams to develop the required technical environments to implement the new architecture

Create detailed forward-looking technical roadmaps and architectural designs.

Drive the delivery of new and innovative technology solutions.

Partner with product managers to ensure the product meets customer expectations.

Mentor and train other developers on coding practices and standards.

Maintain a process-oriented culture leading the team in developing software products using agile methodologies.

Required qualifications to be successful in this role:

Consultants with 8-10 years of experience in Big Data development environment.

Expert working knowledge in Kafka messaging stream processing technology framework.

Experience in design and building high performance, high availability, scalable, distributed applications capable of supporting straight through processing of large amount of data.

Deep knowledge of Microservices architecture, REST APIs. Produce Microservice designs and develop them into fully working systems.

Experience with web services development using SpringBoot/Container/Batch framework.

Working knowledge of architectures using Distributed caching using EhCache / Gigaspaces or similar engines.

Development experience using Java and Python

Experience in PL-SQL/StoredProc with database like Oracle, Sybase, etc.

Working Knowledge of in memory data stores: Ignite or Redis and distributed processing frameworks like Apache Flink