Job Description
Git, Gitlab
- The candidate must have thorough knowledge about
- collaboration in SW development teams
- shared software-repositories and their concepts
JIRA
- The candidate must have experience with Jira
Tools for Reporting and Analysis
- The candidate must have working experience with at least one of the following tools for reporting and analysis: SSIS, SSAS, SSRS / Power BI
Azure Data Factory and Synapse pipelines development
- The candidate should have understanding of how DF pipelines work and how they integrate with other Azure service
- The candidate should have practical knowledge of DF pipelines: how they work and how they integrate with other Azure service
- The candidate should have ability to create a design and implement
- The candidate should have understanding of using a Databricks and/or Synapse Delta Lake based Staging Layer and Business Layer for BI purposes
- The candidate should understand data modelling and structural design
Spark development
- The candidate should have practical experience in Spark and how it interacts and is used in Synapse and Databricks Notebooks
- The candidate should have knowledge about spark design, data structures and mpp flows
- The candidate should have expertise in Spark SQL and how it interacts and is used in Databricks or Synapse Notebooks
Kafka
- Understanding of Kafka and the basics of how streaming works
- Knowledge of how to integrate Kafka with Spark and other persistence services
Azure DevOps
- The candidate should have working experience with the CI/CD in DWH development process
- continuous integration
- continuous delivery / deployment
- Candidate should be able to describe tools that support automatization of testing and delivery processes
- Candidate should be able to explain the benefits and limitations of the concepts applied to DWH development process and give examples from own practical experience
Databases in Azure
- Ability to implement DDLs, DMLs and queries for given tasks using SQL and T-SQL
DB development T-SQL
- Experience with T-SQL or comparable SQL dialects, preferably on MS Databases
RDBMS Tools Cloud
- Experience in working with front end management tool for database systems like
- Azure Databricks and Azure Synapse
- Integration into Azure Data Pipelines
Data Modelling Tools
- The candidate should have working experience with at least one modelling tool, and he should be able to explain -
- Data Modelling
- Data Containers and Storage possibilities
- Support of Analytical Method
- Reporting
- Non-functional requirements (performance, storage consumption, cost)