Pyspark Developer

Desired Profiles:

• Subject matter expert in Python and Spark
• 3+ Years of experience in Hadoop, Spark Scala, PySpark, Hive, Impala, and SQL Technologies.
• Analyzed migration plans for various versions of Cloudera Distribution of Apache Hadoop to draw the impact analysis and proposed the mitigation plan for the same.
• Expertise in the development of API and microservices using Python
• Object Oriented Programming experience is a must
• Good understanding of Spark, Scala, and Hadoop with Hive and Impala
• Involved in various activities across project scope and in parallel handling team.
• Efficient in handling Projects E2E with proper processes and helping the team resolve any technical issues.
• Involved in SIT and UAT calls.
• Involved in business calls to finalize logic for new rules.
• Involved in pulling data from HDFS using Spark.