Description

  • 9+ yrs of experience in Design, develop, and implement end-to-end data integration solutions using Azure Data Factory (ADF) and Azure Synapse Analytics and Azure Databricks.
  • Should be well versed with Delta lakes, Delta tables, Delta Lake Architecture, and Logic Apps.
  • Collaborate with cross-functional teams to understand data requirements, design data models, and develop data pipelines for efficient data processing and analysis.
  • Develop ETL/ELT workflows, data ingestion processes, and data transformation activities using ADF pipelines and activities.
  • Optimize data processing and storage in Azure Synapse Analytics, ensuring high performance and scalability.
  • Perform data quality checks, data validation, and data profiling to ensure data accuracy and integrity.
  • Implement data security and access controls to protect sensitive data in compliance with organizational and industry standards.
  • Monitor and troubleshoot data integration and data warehousing solutions, identifying and resolving performance issues and bottlenecks.
  • Collaborate with data architects and data scientists to design and implement data lakes, data marts, and data warehouses to support analytics and reporting requirements.
  • Stay updated with the latest Azure Data Engineering trends, best practices, and technologies, and provide recommendations for process improvements and tool enhancements.
  • Document technical specifications, data flows, and solution designs to ensure effective knowledge transfer and maintainable solutions.
  • Provide technical guidance and mentorship to junior team members, sharing your expertise in Azure Data Factory, ADLS, Databricks, and Azure Synapse Analytics.

Key Skills
Education

ANY GRADUATE

Back To Jobs