Python - Bigdata Developer

Duties & ResponsibilitiesRequirement Analysis, Design, Develop and Deploy project/tasks while adhering to existing SDLC standardsProvide project/task effort estimatesProvide regular project progress & Issue reportPartner with multiple teams to deliver projectsScope and deliver various Python, Big Data solutionsAbility to design solutions independently based on high-level architecture.Manage the technical communication between the survey vendor and internal systemsProvide L3 support on delivered projectsAdapt to changing needs, both technology and nature of projectsDesign, Model, Develop & Deploy Data ingestion tasks using approved toolsetDevelop automated monitoring tools using available standard tools (shell script/Python/Java/Scala etc)Data conversion/migration in/into Bigdata platformJob requirements and qualificationsPython, Big Data Engineer job description should contain the following requirements and qualifications:Experience programming and/or architecting a backend language (Python, Script, Java etc).Experience as a Big Data Engineer or similar roleExperience with Avro, Parquet, HBase, Hive, Impala, ArcadiaExperience with Data migration and Data enrichment in Hadoop space Experience with non-relational & relational databases (Oracle, SAP, MySQL, NoSQL, Hadoop, MongoDB, etc.)Creative and innovative approach to problem-solvingCrisp communication & Intrapersonal skill is a must