Job Description:
We are looking for a highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in ELT processes, AWS, and data migration. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining our data architecture to support our data analytics and business intelligence initiatives.
Key Responsibilities:
Design, develop, and maintain scalable ETL/ELT pipelines to ingest and process large volumes of data from various sources.
Implement data migration strategies to ensure smooth transition of data between systems and environments.
Work with AWS services such as S3, Redshift, Lambda, Glue, and others to build and optimize data solutions.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs.
Ensure data quality, integrity, and security across all data processes and pipelines.
Monitor and troubleshoot data pipelines and workflows to ensure high availability and performance.
Provide technical guidance and mentorship to junior data engineers and other team members.
Stay updated with the latest industry trends and best practices in data engineering and cloud technologies.
Required Skills and Qualifications:
Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Proven experience as a Data Engineer, with a focus on ELT processes and data migration.
Strong expertise in AWS services, including but not limited to S3, Redshift, Lambda, and Glue.
Proficient in SQL and experience with relational databases and data warehousing.
Solid understanding of data modeling, data architecture, and data warehousing concepts.
Experience with scripting languages such as Python, Scala, or Java.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills, with the ability to work effectively in a team environment.
Preferred Qualifications:
Experience with big data technologies such as Hadoop, Spark, or Kafka.
Knowledge of data governance and data security best practices.
Experience with CI/CD tools and processes.
Familiarity with machine learning and AI concepts.
Benefits:
Competitive salary and benefits package.
Opportunity to work with cutting-edge technologies and a talented team.
Professional development opportunities and career growth.
Flexible work environment and work-life balance.
Bachelor's or Master's degree in Computer Science