Data Engineers

Data Engineers
Job Type: Full-Time
Location:  5750 Gateway Blvd, Suite#102, Mason, Ohio 45040
​

Develop and build scripts in Python and shell scripting languages. Create Sqoop job with incremental load to store data to snapshot area in HDFS.

Involve in designing Hive schemas, use performance tuning techniques like partitioning, bucketing.

Develop complex logics and generic code for different validations using Spark.

Ingest data using AVRO Schema files in Hive (NOSQL) databases. Use ETL to develop jobs for extracting, cleaning, transforming, and loading data into data warehouse.

Write shell scripts for exporting log files to Hadoop cluster through automated process.

Master’s degree in Science, Technology, or Engineering (any) is required. Bachelor’s degree in the above fields along with 5 years of experience in job offered or related occupation is acceptable in lieu of the Master’s degree. Any suitable combination of education, training, or experience is acceptable.

Work location: Mason, OH and various unanticipated locations throughout the U.S.