Data Engineer

NA has a client that is seeking Data Engineer (production Support) Engineer in San Francisco, CA (4 days onsite Monday to Thursday) for a 6-12 Month long term Contract. Role includes on-call responsibilities and responding quickly to urgent issues. Must be able to coordinate well with both onsite and offshore team members. Must look to not only fix issues but create long-term solutions. Must continuously improve processes through automation, performance tuning, and reducing manual effort.

• Perform independently and guide, assist, and mentor others in analyzing, debugging, testing, documenting, and installing solutions.
• Provide prioritization, planning, estimating, work assignments, quality assurance and mentoring at any stage of a project.
• Responsible for communicating to management on status, problems, issues and underlying process problems.
• Document and present solution alternatives, which improve processes and business objectives.
• Track progress and intervene as needed to eliminate barriers and ensure delivery.
• Demonstrate anticipation and initiative in the planning for and management of problems.
• Resolve or escalate problems and manage risk for both development and production support.
• Coordinate with vendors and contractors for specific projects or issues.
• Review the technical work of other team members and provide thoughtful feedback.
• Ensure adherence to technology standards and methods.
• Maintain deep knowledge and awareness of technical and industry best practices and trends.
• Work with business users to understand requirements and assist them in issue resolution.
• Ensure that good business relationships are maintained with internal clients and other IT departments through excellent customer service and communication.

Required Skills : - 5 years of experience as a professional software engineer, preferably with experience working in a production support environment - If no formal production support experience, must have experience supporting / taking ownership of their own dev work through a warranty program of sorts, supporting/troubleshooting and working with business partners and end users to solve issues, etc. - Experience with Azure/Spark in the Cloud environment. - Digging into the Data in Azure, troubleshoot different tables, troubleshoot ingested code, etc. - Experience with Real time integrations - Streaming data into Spark (Casca and Storm) - Snowflake - 1-2 years of experience with Data Bricks - Scala Engineering experience (writing code, Batch processing (Scala ETL) for non-urgent data, etc) - If they do not have Scala, would need to come with Java experience. - Experience with Snowflake or compatible data warehouse experience. - Basic knowledge/understanding of Kafka messaging and data streaming services. - Strong SQL scripting experience - Knowledge in Kafka