Data Analysis, heavy SQL, analyzing existing SQL scripts, connecting to data sources and mapping to new source
· Integrate SQL and Spark SQL scripts and map to existing pipeline
· Existing pipeline may need to be modified using Spark and AWS
SKILLS: Big Data, Python, Scala, Sparkor Flink or Kafka or NoSQL, Java, Py-Spark, CI/CD, Microsoft Azure, AWS (ECS, EC2, EMR, Lambdas, etc).
Any Graduate