Description

Job description

We are looking for an experienced Data Engineer with below skill set.
Employment Type: Permanent Position
IMMIDIATE JOINERS ONLY
Work From Home

Required:

  • Minimum 5+ years of relevant experience in Data Engineering.
  • Good communication, soft skills and customer handling skills required
  • Always curious and learning
  • Ability to closely follow architectural designs, scope, and requirements
  • Ability to work independently AND act as an integral part of a team
  • Architectural experience with Spark, AWS and Big Data (Hadoop

Cloudera/Mapr/Hortonworks).

  • Experience on design and building of Data Lake on AWS Cloud.
  • Hands on experience in AWS/Azure/GCP Cloud and related tools, storage and architectural

aspects are required.

  • Experience with integration of different data sources with Data Lake is required.
  • Experience in Big Data/Analytics/Data science tools and a good understanding of the leading

products in the industry are required along with passion, curiosity and technical depth

  • Thorough understanding and working experience in Mapr/Cloudera/Horton Hadoop

distributions

  • Solid functional understanding of the Big Data Technologies, Streaming and NoSQL

databases

  • Experience in working with Big Data eco-system including tools such as YARN, Impala, Hive,

Flume, HBase, Sqoop, Apache Spark, Apache Storm, Crunch, Java, Oozie, SQOOP, Pig, Scala, Python,

Kerberos/Active Directory/LDAP,KSQL,Redis,Casandra

  • Experience in solving Streaming use cases using Spark,Spark-SQL,KSQL,Kafka,NiFi
  • Thorough understanding, strong technical/architecture insight and working

experience/exposure in Docker, Kubernetes

  • Containerization experience with Big Data stack using Open Shift/Azure is added advantage
  • Exposure to Cloud computing and Object Storage services/platforms
  • Experience with Big Data deployment architecture, configuration management, monitoring,

debugging and security

  • Experience in performing Cluster Sizing exercise based on capacity requirements
  • Ability to build strong partnership with internal teams, vendors on resolving product

gaps/issues and escalate to the management on timely manner

  • Good Exposure to CI/CD tools, application hosting, containerization concepts
  • Excellent verbal and written skills, Team skills, Proficient with MS Visio, Strong analytical and

problem solving skills

  • Must be a self-starter, excellent communication and interpersonal skills.
  • Strong problem solving and analytical skills
  • Effective verbal and written communication skills.

Education

Any graduate