Data Engineer

Job Description:

Are you interested in guiding key business decisions around one of ***’s most significant customer-facing teams? Do you want to build a cutting-edge highly scalable analytics big data platform using AWS technologies such as Redshift, RDS, S3, EMR, Glue, ADP, Hive, Kinesis, SNS/SQS, and NAWS-supported streaming services? Do you want to collaborate with Business Intelligence Engineers (BIE) and Data Scientists (DS) to build Client/LLM models to support our major customer-facing features and initiatives to drive team efficiency?

We are seeking an experienced, self-driven, analytical, and strategic Sr. Data Engineer. In this role, you will be working in one of the world's largest and most complex data warehouse environments. You should be passionate about working with huge datasets and be someone who loves to bring data together to answer business questions. You should have deep expertise in the creation and management of a data lake and the proven ability to guide the continuous enhancement of data architecture by identifying efficiency-gaining solutions and leveraging evolving new technologies. In this role, you will have ownership of end-to-end development of data engineering solutions to complex questions and you’ll play an integral role in strategic decision-making.

The right candidate will possess excellent business and communication skills, be able to work with business owners to tackle ambiguous business questions with creative data/science solution designs and be able to collaborate with BIEs and DSs to build those solutions or answer business questions. You should have a solid understanding of how to build efficient and scalable data infrastructure and data models and have the capability or the desire to learn and implement Elastic MapReduce (EMR)-based solutions where appropriate.

Key job responsibilities

In this role, you will have the opportunity to display your skills in the following areas:

Design, implement, and support an analytical data infrastructure providing ad hoc access to large datasets and computing power.
Managing AWS resources including EC2, RDS, Redshift, etc.
Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies.
Explore and learn the latest AWS technologies to provide new capabilities and increase efficiency.
Collaborate with BIEs to recognize and help adopt best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation.
Collaborate with DS to implement advanced analytics algorithms that exploit our rich data sets for statistical analysis, prediction, clustering, and machine learning.
Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers.