Kafka/Spark Admin

Qualifications :

• 6+ years of relevant experience in Apps Development or System admin role

•Extensive experience in setting up clusters – Confluent Apache Kafka

•Working knowledge of Apache Spark and Talend would be a plus.

•Working knowledge of setting up clusters on bare-metal and Cloud VMs.

•Subject Matter Expert as an Application or Solutions architect in Apache Kafka and Apache Spark.

•Should be able to resolve Performance bottlenecks.

•Should have basic working knowledge of Capacity Management

•Extensive experience system analysis and in programming of software applications

•Consistently demonstrates clear and concise written and verbal communication

•Ability to learn new skills with a short learning curve

•Demonstrate excellent communication skills including the ability to effectively communicate with internal and external customers.

•Ability to use strong industry knowledge to relate to customer needs and dissolve customer concerns and high level of focus and attention to detail.

•Strong work ethics with good time management with ability to work with diverse teams and lead meetings.

•Expert in Installing and maintaining the Confluent Platform components including: Apache Kafka, Confluent Control Center, Confluent Schema Registry, Confluent Replicator, and Confluent Security Plugins

•Strong admin experience and versions used for Confluence/Kafka, details on the projects and environment they supported along with the tools used. Size of the environments, how many nodes/clusters, how many messages processed.

•Experience administering the following Event Driven Architecture Components: Apache Kafka, Kafka Brokers, Zookeeper, Confluent Control Center, Confluent Schema Registry, Connect cluster etc.

•Understanding of Data access, Data Retention and archiving

• Experience working with browse events across federated brokers

•Experience performing Confluent Platform installation, upgrades, and maintenance

•Experience working with Confluent Security Plugins

•The Confluent Kafka Administrator will be responsible for Design, architecture, implementation, and on-going support of Kafka clusters on an Event Streaming Architecture Pilot project.

•Manage large scale multi-nodes Kafka cluster environments.

•Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring.

•Kafka security authentication, authorization and encryption.

•Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka Cluster.

•Good to have knowledge on messaging system like AMQ, Kafka etc.

•6+ years of experience with Cloud Operations (On Premise, Internal or External Cloud)

•2+ years of experience with either of the scripting technologies Ansible (preferred) however exposure to either, Jenkins, Kubernetes/Docker Orchestration is good

•Taking initiatives and designing the solutions as per projects need.

•Having experience on OpenShift cluster administration is added advantage.

•Knowledge on Java-based applications and Docker and Kubernetes (OpenShift)