Job Description :
· They do not need a Data engineer.
· Must have Platform engineering experience and managing clusters and working in production environment.
· Good debugging skills are needed.
· A Spark or Hadoop admin profile will be ideal.
· Look at the logs and monitoring.
· Must be working on Spark Administration.
· Managing pipelines.
· Spark connections and clusters.
· Should be able to troubleshoot in a production environment.
· Monitoring experience on tools like Splunk and elastic A Kafka and Spark combination will be ideal.
· That is their environment and Come up with solutions.
· Some knowledge on Kafka will be ideal.
· Migrate the platform to production.
· Spark clusters
Any gradudate