Pyspark developer

Job Description ---

"We are seeking a talented Database Developer with expertise in JSON data processing and PySpark to join our team. The ideal candidate will play a crucial role in designing and developing a custom query builder for efficient JSON data processing using PySpark. Experience in building end-to-end deep learning models is a Must

This is a fantastic opportunity to work with cutting-edge technologies and contribute to the development of innovative data processing solutions.

As a Database Developer, you will collaborate with cross-functional teams, including data scientists and analysts, to understand business requirements and translate them into efficient and scalable solutions. You will be responsible for designing and implementing data models and database schemas for optimal storage and retrieval of JSON data.

Additionally, you will develop and maintain data pipelines and workflows, ensuring the accuracy and reliability of processed data through validation and quality checks. The successful candidate will have a strong proficiency in Python programming language and extensive experience with PySpark and Apache Spark for data processing.

A solid understanding of JSON data structures, SQL, and database systems is also required. Experience with distributed computing frameworks and knowledge of data processing best practices will be highly beneficial.