Job Description:
We are seeking a skilled Core Kafka Administrator to join our dynamic team. As a Kafka Administrator, you will be responsible for managing and maintaining our Kafka clusters, ensuring their availability, performance, and security. You will play a critical role in designing Kafka infrastructure, configuring topics, monitoring cluster health, and troubleshooting issues as they arise. This role requires deep technical expertise in Kafka, strong problem-solving skills, and the ability to collaborate effectively with cross-functional teams.
Responsibilities:
- Design, deploy, and maintain Kafka clusters across multiple environments (development, testing, production).
- Configure Kafka brokers, topics, partitions, and access control policies.
- Monitor Kafka cluster performance, health, and capacity planning.
- Implement and manage Kafka connectors and ensure seamless data flow.
- Collaborate with DevOps, Engineering, and Data teams to optimize Kafka infrastructure and integrate with existing systems.
- Develop and maintain documentation, best practices, and guidelines.
Requirements
Requirements:
- Proven experience as a Kafka Administrator or similar role in a production environment.
- Deep understanding of Kafka architecture, internals, and components such as brokers, Zookeeper, Kafka Connect, and Kafka Streams.
- Hands-on experience with Kafka operations, including installation, configuration, and performance tuning.
- Strong knowledge of Kafka security protocols (SSL, SASL, ACLs) and best practices.
- Experience with monitoring tools (e.g., Prometheus, Grafana) and Kafka management tools (e.g., Kafka Manager, Confluent Control Center).
- Solid understanding of Linux system administration and networking concepts.
- Excellent communication skills and ability to work collaboratively in a team environment.
- B.E/B.Tech/M.Tech/MS/MCA degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience