PySpark Developer

About the job
· Experience:

2+ years hands on experience as a PySpark Developer, with a strong track record in developing and optimizing PySpark applications.
Experience with SQL and relational databases, including writing and optimizing complex SQL queries.
· Technical Skills:

Proficiency in PySpark, including hands-on experience with Spark SQL, DataFrames, RDDs, and Spark Streaming.
Solid understanding of SQL and relational database management.
Familiarity with big data platforms such as Hadoop, Hive, or AWS EMR is a plus.
· Soft Skills:

Strong problem-solving and analytical abilities.
Excellent communication skills, with the ability to convey complex technical information clearly.
Ability to work independently and collaboratively in a fast-paced environment.