Kafka Engineer

About the job

Kafka Engineer

Richardson, TX / Buffalo Grove , IL (Day 1 Onsite)

Fulltime Permanent

Job Description:

• Lead and work as Architect on Kafka Capacity planning, installation, administration/Platform management, performance optimization of Kafka partitioning and Kafka brokers.
• Lead on Kafka Cluster, Partitions, Security, Disaster recovery, Data pipeline, Data replication.
• Lead on Operational management of the Confluent Kafka platform.
• Lead on tuning Kafka partitioning.
• Performance optimization with Kafka brokers.
• Lead and Architect Self-Managed Kafka connectors
• Lead on deploying confluent Kafka cluster which includes Installation, Configuration, Deployment, Securing, Monitoring and Troubleshooting
• Work on administrating confluent Kafka
• Lead on optimization of Kafka cluster using performance tuning at different levels (Producer, broker, and consumer).
• Design and automate the daily operations of the Event Streaming Environments, as well as architecting additional tools for integrating with the Event Streaming environment.
• Analyze current information technology environments to identify and assess critical capabilities and recommend solutions
• Provide research and development activities for architecture
• Collaborate with engineering and development teams to evaluate and identify optimal cloud solutions for confluent connectivity.
• Collaborate with Project Managers and technical leads to provision estimates, develop overall implementation solution plan, and serve as a lead as required. Provide lab and vendor support
• Provide guidance for enterprise-wide technology to junior staff
• Develop frameworks, standards & reference material for architecture and associated products
• Develop & maintain common services, repositories & utility components for the enterprise
• Provide data, application & technology deliverables on a program & project level basis including risk & opportunity assessment, modeling and design related products and services
• Effectively communicate the architecture to all levels of the organization
• Adhere to enterprise architecture strategies, principals, standards, policies, and procedures