Job Description:
Technical/Functional Skills:
- Proficient in writing Spark code in following languages: Python or Scala or SQL
- Well versed in the concepts of Data/Delta Lake
- Experience in Big Data components such as PySpark, Spark SQL, Data frames
- Implement end-to-end data pipelines.
- Implement ML pipelines to train, build, test and deploy predictive models.
- Run tests, perform statistical analysis, and interpret test results.
- Experience in development of MLOps using cloud native services.
- Working experience in Agile delivery model
- Experience with cloud-based architectures
- Experience working with large scale data processing services (Hadoop)
- Automotive and manufacturing domain knowledge