Bigdata Engineer/Bigdata Developer

Position: Bigdata Engineer/Bigdata Developer
Location: 👉 Philadelphia, PA
Duration: 👉 Fulltime opportunity
Experience: +10 Years
Job Description - 
Relevant Experience 
(in Yrs) 10-12 years
Technical/Functional Skills  Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins
Roles & Responsibilities We are seeking a talented and experienced Data Framework Development Technical Lead to join our growing team. In this exciting role, you will play a pivotal role in shaping the future of our data infrastructure by designing, developing, and implementing cutting-edge data frameworks. You will split your time equally between:
• 50% Leading and Guiding:
o Understanding the data needs and challenges faced by various development teams.
o Designing and architecting scalable, efficient, and secure data frameworks using Python, Java, Spark, and Scala.
o Providing clear technical guidance and mentorship to your team, fostering collaboration and knowledge sharing.
o Conducting code reviews and ensuring adherence to best practices and coding standards.
o Documenting processes and best practices for future reference and knowledge transfer.
• 50% Hands-on Development:
o Writing clean, efficient, and maintainable code for data pipelines, data processing tasks, and data quality checks.
o Implementing unit tests and integration tests to ensure code quality and reliability.
o Troubleshooting and resolving technical issues related to the data framework.
o Staying abreast of the latest advancements in data engineering technologies and best practices.
To be successful in this role, you will need:
• 5+ years of experience in data engineering or a related field.
• +2 years Framework experience
• Proven experience in designing and developing scalable data frameworks using Python, Java, Spark, and Scala.
• Strong leadership skills with the ability to motivate and guide a team of engineers.
• Excellent communication and collaboration skills.
• A passion for data engineering and a commitment to continuous learning.
• Experience in code review and documentation is a plus.
• Experience with cloud platforms like AWS.
• Familiarity with data governance and security principles.
• Experience with DevOps practices and tools.
Generic Managerial Skills Motivated team player with excellent communication, interpersonal, analytical and problem solving skills.