- Design, build and maintain data platform infrastructure on AWS environment
|
- Oversee design, build, and maintain data platform infrastructure on AWS environment
|
- Develop data pipelines to collect the metrics that is required to monitor data refreshes, reports deliveries and track SLAs.
|
- Work with the DWH development team and business users in establishing SLAs for data refreshes and reports
|
- Build continuous integration/deployment (CI/CD) pipelines to accelerate development and improve team agility
|
|
- Monitor all aspects of data platform system security, performance, storage, incidents, and usage for databases, data pipelines, applications, and infrastructure on AWS. Escalate to respective teams for fixes.
|
- Ensure data pipelines meet intraday and daily SLAs, as per documented SLA definitions and escalate accordingly.
|
- develop appropriate instrumentation to collect metrics on system performance, cost, data ingress/egress /storage processes
|
- Have a clear understanding of the reports/analyses/insights to be driven by data and build data driven solutions to optimally support the operational analytics needs
|
- Documents user stories, epics, and reports
|
- Coordinate infrastructure enhancements and maintenance with the system/network engineering teams
|
- Work with DWH development team and analytics team to do manual releases where required.
|
- Onboard users to data analytics systems with appropriate approvals
|
- Conduct system performance tests and collect metrics. Tune/add capacity
|
- Complete knowledge management processes
|
- Own strategy and communicate potential major shifts in expected workload based on business, market, or operational changes.
|
- Operate ongoing business relationship management sessions to review operational metrics, understand pain points, identify upcoming projects and engagement efforts
|
