Description

Data Analysis, heavy SQL, analyzing existing SQL scripts, connecting to data sources and mapping to new source

·         Integrate SQL and Spark SQL scripts and map to existing pipeline

·         Existing pipeline may need to be modified using Spark and AWS


SKILLS: Big Data, Python, Scala, Sparkor Flink or Kafka or NoSQL, Java, Py-Spark, CI/CD, Microsoft Azure, AWS (ECS, EC2, EMR, Lambdas, etc).


 

Education

Any Graduate