Description

Job Description

 

Git, Gitlab

 

  • The candidate must have thorough knowledge about
  • collaboration in SW development teams
  • shared software-repositories and their concepts

 

JIRA

 

  • The candidate must have experience with Jira

 

Tools for Reporting and Analysis

 

  • The candidate must have working experience with at least one of the following tools for reporting and analysis: SSIS, SSAS, SSRS / Power BI

 

Azure Data Factory and Synapse pipelines development

 

  • The candidate should have understanding of how DF pipelines work and how they integrate with other Azure service
  • The candidate should have practical knowledge of DF pipelines: how they work and how they integrate with other Azure service
  • The candidate should have ability to create a design and implement
  • The candidate should have understanding of using a Databricks and/or Synapse Delta Lake based Staging Layer and Business Layer for BI purposes
  • The candidate should understand data modelling and structural design

 

Spark development

 

  • The candidate should have practical experience in Spark and how it interacts and is used in Synapse and Databricks Notebooks
  • The candidate should have knowledge about spark design, data structures and mpp flows
  • The candidate should have expertise in Spark SQL and how it interacts and is used in Databricks or Synapse Notebooks

 

Kafka

 

  • Understanding of Kafka and the basics of how streaming works
  • Knowledge of how to integrate Kafka with Spark and other persistence services

 

Azure DevOps

 

  • The candidate should have working experience with the CI/CD in DWH development process
  • continuous integration
  • continuous delivery / deployment
  • Candidate should be able to describe tools that support automatization of testing and delivery processes
  • Candidate should be able to explain the benefits and limitations of the concepts applied to DWH development process and give examples from own practical experience

 

Databases in Azure

 

  • Ability to implement DDLs, DMLs and queries for given tasks using SQL and T-SQL

 

DB development T-SQL

 

  • Experience with T-SQL or comparable SQL dialects, preferably on MS Databases

 

RDBMS Tools Cloud

 

  • Experience in working with front end management tool for database systems like
  • Azure Databricks and Azure Synapse
  • Integration into Azure Data Pipelines

 

Data Modelling Tools

 

  • The candidate should have working experience with at least one modelling tool, and he should be able to explain -
  • Data Modelling
  • Data Containers and Storage possibilities
  • Support of Analytical Method
  • Reporting
  • Non-functional requirements (performance, storage consumption, cost)

Education

Any Graduate