Data Engineer

Job Description:

·        

•         Develop and improve the existing data structure by creating an efficient, scalable data model to be used by multiple teams within the organization·         Design and develop complex ETL pipelines to support the needs of DEX Business Intelligence teams and various reporting needs
•          Manage AWS resources as needed
•          Partner with BAs/BIEs to design, develop and maintain scaled, automated, user-friendly systems, reports, dashboards, etc. that will support our business needs and improve the efficiency of managing delivery programs
•          Keep up to date with advances in big data technologies and run pilots to design the data architecture to scale with the increased data sets of customer experience on AWS
•          Draw insights from data and clearly communicate them (verbal/written) to the stakeholders and senior management as required
•          Keeping up with new tool launches and integrate them in team’s existing infrastructure
•         Gain knowledge of all supporting infrastructure components, including operating systems, hardware/storage configurations and networks
•          Work closely with machine learning and data scientists to scale model training and explore new data sources and model features
•          Provide technical leadership and mentoring other engineers for best practices on data engineering

The minimum requirement for performance of the job duties is a bachelor’s degree (or equivalent) in Computer Science or a directly related IT field with 3 years of relevant work experience or master’s degree with 1 year of relevant work experience.

Skills Required

C++ Azure Hadoop SDLC