Data Engineer

Job description

We are looking for an experienced Data Engineer with below skill set.
Employment Type: Permanent Position
IMMIDIATE JOINERS ONLY
Work From Home

Required:

• Minimum 5+ years of relevant experience in Data Engineering.
• Good communication, soft skills and customer handling skills required
• Always curious and learning
• Ability to closely follow architectural designs, scope, and requirements
• Ability to work independently AND act as an integral part of a team
• Architectural experience with Spark, AWS and Big Data (Hadoop

Cloudera/Mapr/Hortonworks).

• Experience on design and building of Data Lake on AWS Cloud.
• Hands on experience in AWS/Azure/GCP Cloud and related tools, storage and architectural

aspects are required.

• Experience with integration of different data sources with Data Lake is required.
• Experience in Big Data/Analytics/Data science tools and a good understanding of the leading

products in the industry are required along with passion, curiosity and technical depth

• Thorough understanding and working experience in Mapr/Cloudera/Horton Hadoop

distributions

• Solid functional understanding of the Big Data Technologies, Streaming and NoSQL

databases

• Experience in working with Big Data eco-system including tools such as YARN, Impala, Hive,

Flume, HBase, Sqoop, Apache Spark, Apache Storm, Crunch, Java, Oozie, SQOOP, Pig, Scala, Python,

Kerberos/Active Directory/LDAP,KSQL,Redis,Casandra

• Experience in solving Streaming use cases using Spark,Spark-SQL,KSQL,Kafka,NiFi
• Thorough understanding, strong technical/architecture insight and working

experience/exposure in Docker, Kubernetes

• Containerization experience with Big Data stack using Open Shift/Azure is added advantage
• Exposure to Cloud computing and Object Storage services/platforms
• Experience with Big Data deployment architecture, configuration management, monitoring,

debugging and security

• Experience in performing Cluster Sizing exercise based on capacity requirements
• Ability to build strong partnership with internal teams, vendors on resolving product

gaps/issues and escalate to the management on timely manner

• Good Exposure to CI/CD tools, application hosting, containerization concepts
• Excellent verbal and written skills, Team skills, Proficient with MS Visio, Strong analytical and

problem solving skills

• Must be a self-starter, excellent communication and interpersonal skills.
• Strong problem solving and analytical skills
• Effective verbal and written communication skills.