Data Engineer

Data Engineer

Required Skills : Unix,PySpark,AWS,Airflow

Job summary
We are seeking a Data Engineer with 6 to 9 years of experience to join our dynamic team.
The ideal candidate will have strong technical skills in Unix, Airflow, PySpark, and AWS.
This role involves analyzing business processes, identifying areas for improvement, and implementing solutions that align with our companys goals.
The successful candidate will play a crucial role in driving our business forward through data-driven decision-making

Responsibilities

Analyze business processes to identify areas for improvement and optimization.
Collaborate with stakeholders to gather and document business requirements.
Develop and maintain data pipelines using PySpark and Airflow.
Implement and manage cloud-based solutions on AWS.
Provide technical expertise in Unix to support various business applications.
Create detailed reports and presentations to communicate findings and recommendations.
Lead cross-functional teams to implement business solutions.
Ensure data integrity and security across all platforms.
Monitor and troubleshoot data workflows to ensure smooth operations
Conduct regular reviews and updates of business processes to ensure alignment with company goals.
Provide training and support to team members on new tools and processes.
Stay updated with the latest industry trends and technologies to drive innovation.
Collaborate with IT and other departments to ensure seamless integration of new solutions.

Qualifications
Possess a strong background in Unix, Airflow, PySpark, and AWS.
Demonstrate excellent analytical and problem-solving skills
Exhibit strong communication and interpersonal skills.
Display a proactive approach to identifying and solving business challenges
Maintain a strong focus on data integrity and security.
Show proficiency in creating detailed documentation and reports
Stay updated with industry trends and best practices.
Demonstrate the ability to work independently and as part of a team.
Show a commitment to continuous learning and professional development.
Have a proven track record of successfully implementing business solutions.
Exhibit strong organizational and time management skills.
Demonstrate the ability to manage multiple projects simultaneously.