Required Skills:
Data warehouse design and development, data conversion, data mapping and analytics.
The contractor will provide pre and post CalSAWS implementation support in data mapping and report development.
Desired Skills:
• Languages:
- Python including PySpark
- T-SQL / SQL
• Apache Spark, Apache Airflow, and related technologies • Microsoft SQL Server
• Cloud Technologies such as Azure and AWS
Responsibilities and Duties:
Develop ETL and ELT processes using various data sources including from/to SQL and Oracle databases and Apache Spark Data Lake and Delta Lake
Develop and maintain Python code (PySpark) for Apache Spark data lake and Delta Lake management and queries.
ANY GRADUATE