Data Engineer-AWS, Pyspark

Data Engineer-AWS, Pyspark

The ideal candidate will have expertise in AWS, PySpark, and Unix.
This role involves analyzing business processes, identifying opportunities for improvement, and implementing solutions that align with our companys goals.
The candidate will work closely with cross-functional teams to ensure successful project delivery and contribute to the overall growth of the organization.

Roles & Responsibilities
Analyze business processes to identify areas for improvement and optimization.
Collaborate with stakeholders to gather and document business requirements.
Develop and implement data-driven solutions using AWS, PySpark, and Unix.
Provide insights and recommendations based on data analysis to support decision-making.
Oversee the development and maintenance of data pipelines and ETL processes.
Ensure data quality and integrity across various systems and platforms.
Create and maintain detailed documentation of business processes and technical solutions
Conduct regular reviews and updates of business processes to ensure alignment with organizational goals.
Facilitate communication and collaboration between technical and non-technical teams.
Monitor project progress and provide regular updates to stakeholders.
Identify and mitigate risks associated with data and process changes.
Support the development and implementation of best practices for data management and analysis.
Provide training and support to team members on new tools and processes

Qualifications
Possess a strong understanding of AWS services and their applications in business processes.
Demonstrate proficiency in PySpark for data processing and analysis.
Have experience working with Unix systems and scripting.
Exhibit excellent analytical and problem-solving skills.
Show strong communication and interpersonal skills.
Have a proven track record of successfully managing and delivering projects.
Display the ability to work effectively in a fast-paced, dynamic environment.
Be detail-oriented with a focus on data accuracy and quality.
Demonstrate the ability to work independently and as part of a team.
Show a commitment to continuous learning and professional development.
Have experience with data visualization tools and techniques.
Possess a bachelors degree in a related field or equivalent work experience.
Be familiar with Agile