5 to 7 years Designing and implementing highly performance data ingestion & transformation pipelines from multiple sources using Databricks and ADF Azure Pipelines
Experience in Developing scalable and re-usable frameworks for ingestion and transformation of large data sets.
Experience building data lakes & data warehouses to support operational intelligence and business intelligence
Experience working with SAP and Non-SAP ERP systems ; Good exposure to Order2Cash, Procure2Pay domain area
Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times.
3 years’ Experience with Optimization and Tuning Experience.
3 to 5 years’ experience with Azure Synapse, IOT hub, Event hub, Streaming analytics.
3 to 5 years’ experience with Github or other code repositories.
Good Understanding of Azure Cloud Architecture
Strong programming experience with back end languages such as Python and SQL
Strong Experience with Orchestration tools like Airflow