Data Engineer

Job summary
We are seeking a Data Engineer with 6 to 9 years of experience to join our dynamic team.
The ideal candidate will have strong technical skills in Unix, Airflow, PySpark, and AWS.
This role involves analyzing business processes, identifying areas for improvement, and implementing solutions that align with our companys goals.
The successful candidate will play a crucial role in driving our business forward through data-driven decision-making

Responsibilities

Analyze business processes to identify areas for improvement and optimization.
Collaborate with stakeholders to gather and document business requirements.
Develop and maintain data pipelines using PySpark and Airflow.
Implement and manage cloud-based solutions on AWS.
Provide technical expertise in Unix to support various business applications.
Create detailed reports and presentations to communicate findings and recommendations.
Lead cross-functional teams to implement business solutions.
Ensure data integrity and security across all platforms.
Monitor and troubleshoot data workflows to ensure smooth operations
Conduct regular reviews and updates of business processes to ensure alignment with company goals.
Provide training and support to team members on new tools and processes.
Stay updated with the latest industry trends and technologies to drive innovation.
Collaborate with IT and other departments to ensure seamless integration of new solutions.