Software Developer - ETL

Scope of Services and Deliverables - The Services and Deliverables to be provided by the Vendor will include the following:

• Monitor and analyze incident, provide timely resolution.
• Participate in the review of project, work request and maintenance release artefacts - Use Case, System Requirement Specification, etc.
• Deliver detailed system design documents and any other supporting documentation conforming to Ministry standards.
• Design logical and physical data models using Sybase Power Designer
• Produce transformation mapping document.
• Implement solution using Azure Data Factory (ADF) pipeline and stored procedure, and Informatica PowerCenter
• Develop Azure CI/CD pipeline to automate ADF release.
• Develop complex Oracle PL/SQL program to fulfill project requirements.
• Implement complex data conversion, e.g., binary to character, EBCDIC to UTF
• Implement complex data transformation(s) for derived and calculated values.
• Integrate data sets from diverse source systems.
• Implement ADF for initial data load and incremental load.
• Promote ADF and Informatica ETL/ELT through all Ministry environments including Development, Integration Testing, QA, UAT, Production
• Debug ADF pipeline and stored procedure, and Informatica workflow to investigate and fix defects.
• Actively participate, support, and provide feedback to project team during design/development/testing/implementation phase.
• Produce supporting documentation.
• Optimize performance of ADF pipeline, Azure SQL and Synapse databases, and Informatica workflow
• Monitor application functionality and performance on a daily basis.
• Provide effective knowledge transfer to Ministry staff at all stages of this assignment.

ETL and BI Development                                                                                                                                             

• Extensive experience with ETL tools Informatica PowerCenter and Microsoft SSIS.
• Extensive experience with Azure Data Factory, including:

o   Self-Hosted Integration Runtime

o   Data movement, ETL pipelines

o   Performance tuning on large data volumes

o   Complex data transformations

o   ADF Debugger to validate data transformation.

o   Azure Roles

• Experience with CI/CD (DevOps) pipelines and concepts, including:

o   Azure Resource Management

o   GitHub Repo

o   Source code version control

o   Branching, pull requests, build, release, merging pipeline across multiple parallel development repositories.

• Experience with Azure DevOps, including:

o   Azure Boards

o   Azure Test Plans

o   Azure Pipelines

o   Azure Repos

o   Azure Artefacts

• Experience with Informatica, including:

o   Workflow Manager

o   Repository Manager

o   Designer

o   Workflow Monitor

• Expert experience with Business Intelligence tools IBM Cognos and Microsoft PowerBI.

Oracle PL/SQL Development                                                                                                                                                     

• Extensive experience in designing and developing Oracle PL/SQL programs.

Database Technologies                                                                                                                               

• Experience with Oracle, Microsoft SQL Server database and tools.
• Extensive knowledge of Azure SQL DB and Synapse platforms, including:

Performance tuning on large data volume