Hi,
There is opportunity of Data Engineer in Nice Software Solutions
We are one of the top business intelligence solutions company, experts in producing quicker & impactful self-driven BI applications which can enhance your business growth.
AWS Data Engineer
Job Location: Nagpur/ Pune( Work from Office Opportunity)
No. Of Positions: 2
Job Type: Full Time
Responsibilities:
• Migrate on-premise Hadoop cluster to AWS EMR
• Migrate historical data from HDFS based storage to S3 based storage and update metadata
• Configure EMR cluster, add steps to EMR, spin up and terminate using AWS Python SDK (boto3)
• Orchestrate end to end flow of data involving S3 data retrieval, CloudWatch rules , Lambda functions and set up IAM roles and policies using Boto3
• Set up governance and auditing using AWS CloudTrail
• Write SQL queries for data analysis and data quality checks
• Create Spark jobs to run on EMR cluster and automate the flow
Required Skills:
• Candidate should have hands-on experience in handling of Big Data and implementing big data pipelines using AWS EMR and other associated AWS components like S3, EC2, Lambda, CloudWatch, SQS, SNS,RDS
• Candidate should have hands-on experience in creating IAM roles and policies and experience in securing AWS resources like EMR cluster, EC2 instances, S3 buckets
• Candidate should have strong experience in Python and should be able orchestrate AWS pipelines using AWS Python SDK (boto3)
• Candidate should be familiar with disaster recovery and migration services like AWS DMS
• Candidate should have fair understanding of Spark architecture and should have coding experience in creating Spark jobs (preferably using PySpark)
• Candidate should be able to write basic to intermediate level SQL queries.
We are on the lookout for dynamic individuals that bring energy and passion to their work, just like us. As an innovation-driven organization, we offer high-impact careers and growth opportunities across global locations. Our collaborative work environment is designed to help NICE thrive, learn, and grow through targeted learning and development programs as well as generous benefits and perks.
If interested kindly mail your updated resume on varora@nicesoftwaresolutions.com
Note: Only profiles who is fitting into the job specification will be shortlisted and they will only receive call from the recruiter.