Design, build and maintain data platform infrastructure on AWS environment
Oversee design, build, and maintain data platform infrastructure on AWS environment
Develop data pipelines to collect the metrics that is required to monitor data refreshes, reports deliveries and track SLAs.
Work with the DWH development team and business users in establishing SLAs for data refreshes and reports
Build continuous integration/deployment (CI/CD) pipelines to accelerate development and improve team agility
Oversee project
Monitor all aspects of data platform system security, performance, storage, incidents, and usage for databases, data pipelines, applications, and infrastructure on AWS. Escalate to respective teams for fixes.
Ensure data pipelines meet intraday and daily SLAs, as per documented SLA definitions and escalate accordingly.
develop appropriate instrumentation to collect metrics on system performance, cost, data ingress/egress /storage processes
Have a clear understanding of the reports/analyses/insights to be driven by data and build data driven solutions to optimally support the operational analytics needs
Documents user stories, epics, and reports
Coordinate infrastructure enhancements and maintenance with the system/network engineering teams
Work with DWH development team and analytics team to do manual releases where required.
Onboard users to data analytics systems with appropriate approvals
Conduct system performance tests and collect metrics. Tune/add capacity
Complete knowledge management processes
Own strategy and communicate potential major shifts in expected workload based on business, market, or operational changes.
Operate ongoing business relationship management sessions to review operational metrics, understand pain points, identify upcoming projects and engagement efforts
