Azure Data Engineer

Collaborate with cross-functional teams to understand the existing pricing system’s intricacies and pain points, identifying areas for improvement.
Design and implement a robust data movement strategy from diverse sources to the new “PriceFx” ecosystem using Azure Data Factory.
Develop and optimize ETL pipelines using Azure Data Factory to ensure seamless and reliable data integration.
Leverage Azure Databricks for data processing, transformation, and analysis, driving insights that fuel the pricing decision-making process.
Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server.
Experience with Orchestration tools, Azure DevOps, and GitHub.
Experience to own end-to-end development, including coding, testing, debugging and deployment.
Architect and implement PYTHON-based API extensions, with a focus on scalability, performance, and security.
Work closely with data scientists and analysts to develop algorithms and models that enhance the accuracy of pricing calculations.
Collaborate with the development team to ensure Python/Flask-based APIs are seamlessly integrated into the overall ecosystem.
Provide technical leadership, mentoring, and guidance to team members, fostering a culture of innovation and excellence.
Stay updated with the latest industry trends and technologies related to Azure, data engineering, and pricing analytics.
Solid experience with the Azure ecosystem, particularly Azure Data Factory and Azure Databricks.
Proficiency in designing and implementing ETL pipelines for data movement and transformation.
Strong Python programming skills, including experience with Flask or similar frameworks for API development.
A deep understanding of pricing analytics and the automotive industry’s pricing dynamics is a strong plus.
Familiarity with cloud-based data storage solutions and data lakes.
Excellent problem-solving skills and the ability to dissect complex issues to find optimal solutions.
Strong communication skills to collaborate effectively with both technical and non-technical stakeholders.
Experience with version control systems and collaborative development workflows.
Proven track record of delivering high-quality solutions on time and within scope.

Bachelor’s degree in Computer Science or a related field of study