Job description
We are looking for an experienced Data Engineer with below skill set.
Employment Type: Permanent Position
IMMIDIATE JOINERS ONLY
Work From Home
Required:
- Minimum 5+ years of relevant experience in Data Engineering.
- Good communication, soft skills and customer handling skills required
- Always curious and learning
- Ability to closely follow architectural designs, scope, and requirements
- Ability to work independently AND act as an integral part of a team
- Architectural experience with Spark, AWS and Big Data (Hadoop
Cloudera/Mapr/Hortonworks).
- Experience on design and building of Data Lake on AWS Cloud.
- Hands on experience in AWS/Azure/GCP Cloud and related tools, storage and architectural
aspects are required.
- Experience with integration of different data sources with Data Lake is required.
- Experience in Big Data/Analytics/Data science tools and a good understanding of the leading
products in the industry are required along with passion, curiosity and technical depth
- Thorough understanding and working experience in Mapr/Cloudera/Horton Hadoop
distributions
- Solid functional understanding of the Big Data Technologies, Streaming and NoSQL
databases
- Experience in working with Big Data eco-system including tools such as YARN, Impala, Hive,
Flume, HBase, Sqoop, Apache Spark, Apache Storm, Crunch, Java, Oozie, SQOOP, Pig, Scala, Python,
Kerberos/Active Directory/LDAP,KSQL,Redis,Casandra
- Experience in solving Streaming use cases using Spark,Spark-SQL,KSQL,Kafka,NiFi
- Thorough understanding, strong technical/architecture insight and working
experience/exposure in Docker, Kubernetes
- Containerization experience with Big Data stack using Open Shift/Azure is added advantage
- Exposure to Cloud computing and Object Storage services/platforms
- Experience with Big Data deployment architecture, configuration management, monitoring,
debugging and security
- Experience in performing Cluster Sizing exercise based on capacity requirements
- Ability to build strong partnership with internal teams, vendors on resolving product
gaps/issues and escalate to the management on timely manner
- Good Exposure to CI/CD tools, application hosting, containerization concepts
- Excellent verbal and written skills, Team skills, Proficient with MS Visio, Strong analytical and
problem solving skills
- Must be a self-starter, excellent communication and interpersonal skills.
- Strong problem solving and analytical skills
- Effective verbal and written communication skills.