Spark, aws, python, SQL server needs
They take a live coding assessment in Python
Required skills: Apache Spark experience (essential - the more the better), Python, MSSQL experience, AWS experience
Nice to have's: Azure, Terraform, Scala, Docker, Kubernetes
Project – help existing infrastructure, data science is doing current data engineer responsibilities, etl on SQL server, migrating to Kubernetes, writing etl code
People are missing – spark background, independent worker, verify tables, writing etl, spotting and correcting issues, and coding python (used on coding test)
Anywhere in USA resource can be
Spark and SQL are biggest needs or wants
Any Graduate