Job Description:
Hands-on experience with GCP, google composer, bigQuery and bigTable
3 to 7 years of experience within Data Engineering/ Data Warehousing using Big Data
Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data
Hands-on experience with programming using Python/Scala
Understanding of Cloud Native Principles and architectures and Experience in creating platform level cloud native system architecture with low latency, high throughput, and high availability.
Have experience in designing and building Cloud native applications. Experience in cloud platforms like Docker, Kubernetes, OpenShift are a plus.
Expert on Hadoop and Spark Architecture and its working principle
Experience in UNIX shell scripting
Experience with NoSQL i.e., HBase, Couchbase, MongoDB is good to have
Teamwork & ability to multi-task
Excellent communication skills
Any Graduate