Big data developer

Big data developer

Remote Job |   2021-09-08 09:20:27

Apply Now

Share Job 

Job Code : PRSD002

Hello,

Hope you are doing well and Safe.

Greetings from My3Tech !!!

We are looking for Bigdata Developer with our own W2.

Role:: Bigdata Developer

Visa:: Any

Tenure:: 24 Months

Job Description::

Responsibilities

• Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
• Implementing ETL process {{if importing data from existing data sources is relevant}}
• Monitoring performance and advising any necessary infrastructure changes
• Defining data retention policies

Skills and Qualifications

• Proficient understanding of distributed computing principles
• Ability to solve any ongoing issues with operating the cluster
• Proficiency with Hadoop v2, MapReduce, HDFS
• Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming 
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
• Experience with Spark 
• Experience with integration of data from multiple data sources
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• Knowledge of various ETL techniques and frameworks, such as Flume
• Experience with various messaging systems, such as Kafka or RabbitMQ
• Experience with Big Data ML toolkits, such as Mahout, SparkML,
• Good understanding of Lambda Architecture, along with its advantages and drawbacks
• Experience with Cloudera/MapR/Hortonworks