Data Analyst/ Data Engineer

Data Engineer Specializing in ADF (Azure Data Factory), Databricks, Spark SQL, and Dashboard Development

 

• We are currently seeking a skilled Data Analyst with proficiency in Azure Data Factory (ADF), Databricks, Spark SQL, and dashboard creation. This role involves:
• Data Analysis with ADF and Databricks: Utilizing Azure Data Factory and Databricks for comprehensive data analysis. This includes extracting, transforming, and loading data (ETL) processes, and managing data workflows.
• Expertise in Spark SQL: Leveraging Spark SQL for querying and analysing large datasets within Databricks environments. The candidate should possess the ability to write efficient, complex SQL queries.
• Data Mapping Creation: Developing detailed data mappings to assist in the integration and transformation of data from various sources into structured formats for analysis.
• Dashboard Development: Designing and building intuitive, informative dashboards that effectively communicate data insights. Experience with tools like Tableau, Power BI, or Databricks’ native visualization capabilities is preferred.
• Data Quality and Integrity: Ensuring the accuracy and consistency of data throughout the data processing lifecycle, from extraction to visualization.
• Collaborative Project Involvement: Working collaboratively with cross-functional teams, including data engineers and business stakeholders, to understand requirements and deliver data-driven solutions.
• Data-Driven Decision Making: Assisting in the interpretation of data and providing insights that support business decision-making.
• Continuous Learning and Improvement: Staying updated with the latest trends and advancements in data analytics, ADF, Databricks, and Spark SQL to continuously improve processes and implementations.
• Technical Documentation: Creating clear and comprehensive documentation regarding data processes, mappings, and dashboard functionalities.
• Problem-Solving Skills: Utilizing strong analytical and problem-solving skills to address challenges in data analysis and dashboard development.
• The ideal candidate will have a strong background in data analysis, with a demonstrated ability to handle large datasets and build effective visualizations. They should be comfortable working in a dynamic, fast-paced environment and possess excellent communication skills to articulate complex data concepts to non-technical stakeholders.