Must Have : SQL, Python, Azure SQL Database, Azure Data Factory, Data Modelling, ETL, Azure Blob Storage, Azure Synapse Analytics
Good to Have : Azure Databricks, Azure Stream Analytics, Azure Functions, API Integration, Knowledge on Cloud Platforms (AWS, Azure, GCP)
Knowledge, Skills And Experience
- Proficiency in crafting and optimizing complex SQL queries for data transformation, aggregation, and analysis.
- Good programming skills in Python for data processing and manipulation, including libraries such as Pandas and NumPy.
- Experience with a range of Azure data services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage and file formats like JSON & Parquet.
- Ability to design and implement data models, applying both relational and dimensional modeling techniques, within an Azure environment.
- In-depth understanding of ETL processes and methodologies, ensuring seamless data movement and transformation using Azure Data Factory.
- Adeptness in using Azure Functions for serverless data processing, automation, and orchestrating workflows.
- Skill in creating clear and concise technical documentation, facilitating communication and knowledge sharing.
- Designing efficient and well-structured data schemas within Azure SQL Database.
- Utilizing Azure Databricks for scalable data processing, analytics, and machine learning.
- Leveraging Python programming for data processing and manipulation within an Azure environment. Skilled in API integration.
- Implementing data integration and orchestration workflows using Azure Data Factory.
- Working experience with Azure DevOps CI/CD pipelines to deploy Azure resources.
- Collaborating effectively in a cross-functional team environment, translating technical concepts for non- technical stakeholders.
- Crafting and optimizing complex SQL queries for data manipulation and analysis within Azure services.
- In-depth understanding of ETL processes and methodologies, ensuring seamless data movement and transformation.
- Adeptness in version control using GitHub for collaborative code management.