Lead the design and development of the AEP platform architecture, ensuring that it meets business objectives, customer needs, and compliance requirements.
Collaborate with cross-functional teams, including engineering, operations, and security, to ensure that the platform is scalable, reliable, and secure.
Develop and implement best practices for platform development, deployment, and maintenance.
Manage and mentor a team of platform engineers, providing guidance and support on technical issues.
Work with product owners to prioritize platform features and enhancements based on business objectives and customer needs.
Monitor platform performance and identify areas for optimization and improvement.
Collaborate with cross-functional teams to identify and gather data requirements for AEP CDP development and deployment.
Develop, test and deploy data pipelines, ETL jobs, and data processing workflows using big data technologies (e.g., Hadoop, Spark, Kafka, etc.).
Develop, deploy and maintain data integrations with various source systems.
Develop and maintain data quality standards and validation rules.
Develop and maintain documentation for data architecture, data flows, and data mapping.
Monitor and troubleshoot data processing issues and implement corrective actions.
Ensure that data is accurate, complete, and timely and follows data privacy and security standards