Data Platform Engineer

Job Description:

• Installation, configuration, Setup and maintenance of the Big Data Platform.
• Contribute to Design and Architecture for implementing Big Data Projects on-premises and on cloud.
• Good experience and exposure of Hadoop eco system services like Kafka, Hbase, Hive, Spark, Zookeeper, impala, YARN
• Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required.
• Cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Cloudera Manager Enterprise, Dell Open Manage and other tools.
• Expertise in setting up HA for HDFS, YARN, Zookeeper
• Experienced as Data platform engineer on different Azure Data technologies like Data factory, Azure Databricks, ADLS, Synapse, Event Hub etc. with hands on experience administering the data platforms in production environments ensuring data platforms operate efficiently and securely.
• Experienced in Data platform engineering, integration and implementation.
• Experienced in data platform deployments, capacity planning, monitoring multi datacenters, performance tuning and troubleshooting.
• Knowledge on set up Azure data platforms and monitoring the platforms with help of Azure monitors.
• Capability to perform root cause analysis based on provided input from business regarding database issues.
• Should have knowledge working on Azure Cloud data platforms.
• Ability to work independently and as a team.
• Adaptable with new industries and technologies
• Strong problem-solving skill