Description

Job Description

 

  • Designs, modifies, and builds new and scalable data processes.
  • Ability to perform root cause analysis and identify performance bottlenecks in Spark Jobs.
  • Expert in Data Engineering and building data pipelines, implementing Algorithms in a distributed environment.
  • Ability to design and develop parallel processing data platform in PySpark.
  • Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
  • Strong Proficiency in SQL.
  • Cloud knowledge especially Azure.
  • Collaborates with stakeholders, IT, database engineers and other scientists.
  • Hands-on knowledge in Azure Synapse and Azure Data Factory is a plus.

Key Skills