Our client is currently seeking a Sr. Data Engineer to work on-site in SFO, CA.
This is a Contract job opportunity.
For immediate consideration email resumes/applications to naveen@arohatechnologies.com or call 510-269-2233 Ext 201
Responsibilities:
Implement systems tracking data quality and consistency
Develop tools supporting self-service data pipeline management (ETL)
SQL and MapReduce job tuning to improve data processing performance
Experience & Skills:
Extensive experience with Hadoop (or similar) Ecosystem (MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet)
Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
Good understanding of SQL Engine and able to conduct advanced performance tuning
Strong skills in the scripting language (Python, Ruby, Perl, Bash)
Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
Comfortable working directly with data analytics to bridge business requirements with data engineering
ANY GRADUATE