Data Engineer

Job Description

• Analyze customer data using Alteryx and validate the required information using Python.
• Create Lambda Function using terraform and to deploy the code using Jenkins for the employee discounts data enhancements
• Design the architecture for the workflow between front-end to OKTA and implement SCIM connector for the data flow to downstreams.
• Work on AWS services like S3 for the inbound and outbound data flow and the data is to be transferred from database to AWS using SFTP.
• Work on MYSQL for analyzing the data and run the ECS task to generate the flow from database to OKTA.
• Create data pipelines for the migration of Customers data and use AWS cloud services to send notifications to customers using SQS, SNS queuing services.
• Use Redshift, DynamoDB to store the customer data information to analyze the store statistics.
• Work on Glue, terraform for implementing the data flow from EC2 instance to OKTA.
• Involve in data migration process by integrating with Bitbucket repositories and Jenkins and create the analytics on the AWS cloud watch logs to analyze the customer information.
• Parse the data using ETL transformations to analyze the data and upload to AWS S3 and implement the cloud watch trigger to handle the data.
• Work on Jira tickets for the sprint plan and utilize Bitbucket repositories and confluence and participate in retrospective meetings.

Minimum Education Requirement:- Bachelor’s degree in computer science, computer information systems, information technology, relevant engineering, (computer engineering, software engineering, electronic engineering or related), or a combination of education and experience equating to the U.S. equivalent of a Bachelor’s degree in one of the aforementioned subjects.