Big Data Lead

Job Description

Primary Tech skills AZURE ,Pyspark,SQL

Secondary Tech skills: SAS, Synapse, Databricks

Roles

Technical coordination with the Product Group Technical Lead, Architecture Team, Data Engineering Team, BSA, and QE Team for the assigned projects

Ability to drive more than one project in parallel.

Experience of DWH, Data Integration, Cloud, Architecture, Design, and Data Modeling

Experience in Pyspark, SQL,Cloud data warehouses like Azure Synapse, and data bricks

Experience working with structured and unstructured data

Extensive knowledge of ETL and Data Warehousing concepts, strategies, and methodologies

Experience in ETL/Pipeline Development using tools such as Azure Databricks and Azure Data Factory with development expertise on batch and real-time data integration

Experience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements

Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, and SQL Server

Experience with Orchestration tools, Azure DevOps, and GitHub

Experience Experience in end-to-end development, including coding, testing, debugging and deployment

Must be team-oriented with strong communication, collaboration, prioritization, and adaptability skills