Sr Data Engineer

Job Description

 Our client is currently seeking a Sr. Data Engineer to work on-site in SFO, CA.

This is a Contract  job opportunity.

For immediate consideration email resumes/applications to [email protected] or call 510-269-2233 Ext 201

Responsibilities:

Implement systems tracking data quality and consistency

Develop tools supporting self-service data pipeline management (ETL)

SQL and MapReduce job tuning to improve data processing performance

Experience & Skills:

Extensive experience with Hadoop (or similar) Ecosystem (MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet)

Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)

Good understanding of  SQL Engine and able to conduct advanced performance tuning

Strong skills in the scripting language (Python, Ruby, Perl, Bash)

Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)

Comfortable working directly with data analytics to bridge business requirements with data engineering