Kafka Engineer

About the job

Job title: Kafka Engineer

Job Location: Richardson , TX or Buffalo Grove , IL - Onsite

Job Type: Fulltime

Job Description:

· Lead and work as Architect on Kafka Capacity planning, installation, administration/Platform management, performance optimization of Kafka partitioning and Kafka brokers.

· Lead on Kafka Cluster, Partitions, Security, Disaster recovery, Data pipeline, Data replication.

· Lead on Operational management of the Confluent Kafka platform.

· Lead on tuning Kafka partitioning. Performance optimization with Kafka brokers.

· Lead and Architect Self-Managed Kafka connectors

· Lead on deploying confluent Kafka cluster which includes Installation, Configuration, Deployment, Securing, Monitoring and Troubleshooting

· Work on administrating confluent Kafka

· Lead on optimization of Kafka cluster using performance tuning at different levels (Producer, broker, and consumer).

· Design and automate the daily operations of the Event Streaming Environments, as well as architecting additional tools for integrating with the Event Streaming environment.

· Analyze current information technology environments to identify and assess critical capabilities and recommend solutions

· Provide research and development activities for architecture

· Collaborate with engineering and development teams to evaluate and identify optimal cloud solutions for confluent connectivity.

· Collaborate with Project Managers and technical leads to provision estimates, develop overall implementation solution plan, and serve as a lead as required. Provide lab and vendor support

· Provide guidance for enterprise-wide technology to junior staff

· Develop frameworks, standards & reference material for architecture and associated products

· Develop & maintain common services, repositories & utility components for the enterprise

· Provide data, application & technology deliverables on a program & project level basis including risk & opportunity assessment, modeling and design related products and services

· Effectively communicate the architecture to all levels of the organization

• · Adhere to enterprise architecture strategies, principals, standards, policies, and procedures