Python PySpark/ Data Engineer

Job Description:

• 6+ years of professional work experience designing and implementing data pipelines in a cloud environment is required.
• 5+ years of experience migrating/developing data solutions in the AWS cloud is required.
• 2+ years of experience building/implementing data pipelines using Databricks or similar cloud database.
• Expert level knowledge of using SQL to write complex, highly optimized queries across large volumes of data.
• Hands-on object-oriented programming experience using Python is required.
• Professional work experience building real-time data streams using Spark and Experience in Spark.
• Knowledge or experience in architectural best practices in building data lakes