Sr. Data Engineer

Key Responsibilities
• Design and implement robust data pipelines for high-throughput data ingestion, transformation, and storage.
• Optimize data processing workflows for performance and scalability in Azure cloud environments.
• Collaborate with data scientists and business analysts to understand requirements and deliver data engineering solutions that meet business objectives.
• Ensure data consistency, reliability, and security in distributed data processing environments.
• Monitor and troubleshoot data pipeline failures, ensuring minimal downtime and maximum reliability.
• Refine Requirements
• Design and develop Informatica solutions.
• Perform Unit and Integration Testing
• Handle deployments.
• Draft architectural diagrams, interface specifications and other design documents
• Participate in the development and communication of data strategy and roadmaps across the technology organization to support project portfolio and business strategy.
• Innovate, develop, and drive the development and communication of data strategy and roadmaps across the technology organization to support project portfolio.
• Drive the development and communication of enterprise standards for data domains and data solutions, focusing on simplified integration and streamlined operational and analytical uses
• Drive digital innovation by leveraging innovative new technologies and approaches to renovate, extend, and transform the existing core data assets, including SQL-based, NoSQL-based, and Cloud-based data platforms.
• Define high-level migration plans to address the gaps between the current and future state, typically in sync with the budgeting or other capital planning processes.
• Lead the analysis of the technology environment to detect critical deficiencies and recommend solutions for improvement.
• Mentor team members in data principles, patterns, processes and practices.
• Promote the reuse of data assets, including the management of the data catalog for reference.
• Draft and review architectural diagrams, interface specifications and other design documents.