Data Engineer

Roles & Responsibilities:
1. Collaborate with cross-functional teams to understand data requirements and establish seamless connections with external vendors.
2. Develop and implement robust data acquisition strategies, ensuring data quality, integrity, and security.
3. Lead the design and implementation of data cleansing and transformation process to align vendor data with internal standards and structures.
4. Utilize internal tools and SDKs for efficient data integration and processing, focusing on scalability and performance optimization.
5. Implement and manage agents for monitoring, logging, and automation within AWS environments.
6. Work with Amazon SNS for efficient notification and communication workflows.
7. Work with other AWS services, including S3, Athena, and Glue, to optimize data storage, querying, and processing.
8. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management.
9. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.