Python with Spark

Job Description

Exp: 5-10 Years Required Skills:

• Python, Spark Framework with all API knowledge

• Strong knowledge of the Data frames, RDD, Spark query tuning, and performance optimization • Strong knowledge of the MLlib, Spark Streaming

• Knowledge of the Hadoop Ecosystem (HDFS, HIVE, Impala)

• Knowledge of SQL, and NoSQL on different databases like Redshift, Snowflake, MongoDB,

• Synapse Analytics on Azure, DynamoDB, etc
• Strong knowledge of working with different data file formats like Parquet, JSON, CSV, etc

• Knowledge of the Cloud (AWS, Azure) and Databricks