London,United Kingdom
Contract
Skills
Spark
Java
Role: Java Developer
FTE or Contract: Only Contract
Work Location: London Office, UK
Remote or Hybrid: In office all 5 days
Job Description :
Proficiency in Java, with a good understanding of its ecosystems
Experience in Data Engineering using HDFS, Spark, and Java. Good knowledge of Hadoop Architecture
Transformation and aggregated data from multiple sources.
Good Knowledge of Spark Architecture including Spark Core, Spark SQL, RDD, Data Set, and Data Frames.
Performance tuning using Optimization techniques Caching Data in Memory, Broadcast Hint for SQL Queries.
Azure/Cloud DevOps concepts, CI/CD pipeline
Good knowledge on the architecture of a Spark application.
Knows the concepts of deployment pipelines.
Hands-on experience with git bash.
Has worked with scrum methodology. Familiar with ceremonies and ways of working.
Able to communicate with the end clients via email with good email etiquette and via phone.
Understanding business needs, identifying the right data sources, and developing scalable and reliable data pipelines to ensure a smooth process
Any Graduate