Azure Big Data Architect

As a Data Architect, you will

• Design, Architect, Deploy and maintain solutions on the MS Azure using different Cloud & Big Data Technologies.

• Manage the full life-cycle of a Data Lake / Big Data solutions from requirement gathering and analysis to platform selection, design of the architecture and deployment.

• Be responsible for implementing solutions which can scale on Cloud.

• Collaborate with a team of business domain experts, data scientists and application developers to develop BD solutions.

• Explore and learn new technologies for creative business problem solving and mentor a team of Data Engineers.

EXPERTISE AND QUALIFICATIONS

Required Experience, Skills & Competencies:

• Strong Hands-on experience in implementing Data Lake with technologies like – Data Factory (ADF), ADLS, Databricks, Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB and Purview.

• Experience of using big data technologies like Hadoop (CDH or HDP), Spark, Airflow, NiFi, Kafka, Hive, HBase or MongoDB, Neo4J, Elastic Search, Impala, Sqoop etc.

• Strong programming & debugging skills either in Python and Scala/Java. Experience of building REST services is good to have.

• Experience of supporting BI and Data Science teams in consuming the data in a secure and governed manner.

• Good understanding and Experience of using CI/CD with Git, Jenkins / Azure DevOps.

• Experience of setting up cloud-computing infrastructure solutions.

• Hands on Experience/Exposure to NoSQL Databases and Data Modelling in Hive

• 9+ years of technical experience with at-least 5 years on MS Azure and 2 year on Hadoop (CDH/HDP).