Python Developer (Spark & PySpark)

Must-Have Skills

Python
Spark/PySpark
CI/CD
Microservices

Description

We are seeking a Lead Python Developer with a strong focus on Spark and PySpark to join our team. You will be responsible for developing and maintaining applications within a Big Data tech stack, leveraging your expertise in Python, Spark, CI/CD, and microservices architecture. This is a hands-on role where you will contribute to all phases of the software development lifecycle, from requirements gathering to testing and deployment.

Responsibilities

Design, develop, and test Python applications with a focus on Spark and PySpark for Big Data processing.
Collaborate with architects to design and implement solutions.
Participate in code reviews and ensure adherence to best practices.
Troubleshoot and resolve application issues.
Contribute to the continuous improvement of development processes and tools.

Qualifications

Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent work experience.
5+ years of experience in software development, preferably in the financial services industry. 
Strong proficiency in Python programming.
Extensive experience with Spark and PySpark.
Solid understanding of CI/CD methodologies and microservices architecture.
Excellent communication and collaboration skills.

Preferred Skills

Experience with Big Data technologies (Hadoop, Hive, etc.).
Familiarity with cloud platforms (AWS, Azure, etc.).
Knowledge of data modeling and database design.