Job Overview:
• Experience building and optimizing Big Data pipelines, architectures, and datasets.
• Strong analytic skills related to working with structured and unstructured datasets.
• Hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
• Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
• 5 years experience in Azure Data Lake Storage Gen2, Azure Data Factory, Data bricks, Event Hub, and Azure Synapse.
• Familiarity with several of the following technologies: Event Hub, Docker, Azure Kubernetes Service, Azure DWH, API Azure, Azure Function, Power BI, Azure Cognitive Services.
• Azure DevOps experience to deploy the data pipelines through CI/CD.
Any Graduate