Job Description
· Over all 7 to 12 years of IT experience. Extensive experience in hashtag#BigData, Analytics, hashtag#ETL technologies
· Application Development background along with knowledge of Analytics hashtag#libraries, hashtag#statistical and hashtag#bigdata computing hashtag#libraries
· Minimum 4+ years of experience in hashtag#Spark, hashtag#Python/ hashtag#Scala/ hashtag#java programming.
· Hands on experience in hashtag#coding, hashtag#designing and development of complex data pipelines using hashtag#bigdata technologies
· Experience in developing applications on hashtag#BigData. Design and build highly scalable hashtag#data pipelines
· Expertise in hashtag#Python, hashtag#SQL hashtag#Database, hashtag#Spark, non-relational databases
· Knowledge of hashtag#Palantir would be added advantage
· Responsible to ingest data from files, streams and hashtag#databases. Process the data using hashtag#Spark, hashtag#Python
· Develop programs in hashtag#PySpark and hashtag#Python as part of data cleaning and processing
· Responsible to design and develop distributed, high volume, high velocity multi-threaded event processing systems
· Develop efficient software code for multiple use cases leveraging hashtag#Python and hashtag#BigData technologies for various use cases built on the hashtag#platform
· Provide high operational excellence guaranteeing high availability and platform stability
· Implement scalable solutions to meet the ever-increasing data volumes, using hashtag#bigdata/ hashtag#Palantir technologies hashtag#Pyspark, any hashtag#Cloud computing etc.
· Individual who can work under their own direction towards agreed targets/goals and with creative approach to work
· Intuitive individual with an ability to manage change and proven time management
Proven interpersonal skills while contributing to team effort by accomplishing related results as needed
Any gradudate