Data Engineer

Job Description

4+ years of hands-on experience in designing, building, testing and deploying data pipelines in Teradata and Hadoop platform with experience in, HDFS, Hive, Spark, Streaming, HBase, Kafka, Oozie etc.

Good experience in Scala, Java or Python programming

Good experience in Cloud data engineering, preferably Google Cloud with Big Query

Ï Experience with development and automated testing in a CI/CD environment.

Ï Knowledge of GIT/Jenkins and pipeline automation is a must.

Ï Experience with developing and testing real-time data-processing and Analytics Application Systems.

Ï Strong knowledge in SQL development on Database and/or BI/DW

Ï Strong knowledge in shell scripting Experience in Web Services - API development and testing.

Ï A solid understanding of common software development practices and tools.

Ï Strong analytical skills with a methodical approach to problem solving applied to the Big Data/AI domain