Role: Data engineer
Location: Sunbury on Thames,United Kingdom (2-3 days Onsite/Week)
Duration: 6+ Months
Job Description:
Data Engineer with a minimum of 3+ years of experience of data engineering experience. The role will require deep knowledge of data engineering techniques to create data pipelines and build data assets.
• At least 4+ years of Strong hands on programming experience with Pyspark / Python / Boto3 including Python Frameworks, libraries according to python best practices.
• Strong experience in code optimisation using spark SQL and pyspark.
• Understanding of Code versioning ,Git repository , JFrog Artifactory.
• AWS Architecture knowledge specially on S3, EC2, Lambda, Redshift, CloudFormation etc and able to explain benefits of each
4+ years' experience in Python, Pyspark