About the job
Kafka Engineer
Richardson, TX / Buffalo Grove , IL (Day 1 Onsite)
Fulltime Permanent
Job Description:
- Lead and work as Architect on Kafka Capacity planning, installation, administration/Platform management, performance optimization of Kafka partitioning and Kafka brokers.
- Lead on Kafka Cluster, Partitions, Security, Disaster recovery, Data pipeline, Data replication.
- Lead on Operational management of the Confluent Kafka platform.
- Lead on tuning Kafka partitioning.
- Performance optimization with Kafka brokers.
- Lead and Architect Self-Managed Kafka connectors
- Lead on deploying confluent Kafka cluster which includes Installation, Configuration, Deployment, Securing, Monitoring and Troubleshooting
- Work on administrating confluent Kafka
- Lead on optimization of Kafka cluster using performance tuning at different levels (Producer, broker, and consumer).
- Design and automate the daily operations of the Event Streaming Environments, as well as architecting additional tools for integrating with the Event Streaming environment.
- Analyze current information technology environments to identify and assess critical capabilities and recommend solutions
- Provide research and development activities for architecture
- Collaborate with engineering and development teams to evaluate and identify optimal cloud solutions for confluent connectivity.
- Collaborate with Project Managers and technical leads to provision estimates, develop overall implementation solution plan, and serve as a lead as required. Provide lab and vendor support
- Provide guidance for enterprise-wide technology to junior staff
- Develop frameworks, standards & reference material for architecture and associated products
- Develop & maintain common services, repositories & utility components for the enterprise
- Provide data, application & technology deliverables on a program & project level basis including risk & opportunity assessment, modeling and design related products and services
- Effectively communicate the architecture to all levels of the organization
- Adhere to enterprise architecture strategies, principals, standards, policies, and procedures