Summary:
As a Software Developer on our data team, you'll harness the principles of computer science to craft innovative solutions driving our data infrastructure. Your role involves working with cutting-edge technologies like Azure Databricks, Azure Synapse, and Azure Data Lake to construct robust data pipelines and infrastructure components. Fluency in Python is essential for crafting efficient code that powers our data ecosystem. If you possess machine learning expertise, you'll have the opportunity to leverage it to extract invaluable insights from our data streams.
Job Responsibilities:
Designing and developing data pipelines. Create data pipelines and ETL (Extract, Transform, Load) processes to extract data from various sources, transform it, and load it into data warehouses, lakes, or other storage systems.
Collaborating with data producers/consumers and maintaining flexibility on domain ownership as business priorities evolve.
Deploying and managing Azure-based data platforms with proper security and access controls.
Skills:
Experience in a Data Engineering or Software Engineering role with a focus on cloud-based data processing.
Experience in developing tools and data pipelines using Apache Spark and Python or similar tools.
Previous experience collaborating with hardware teams is a notable advantage in this role, enhancing your ability to synergize software solutions with hardware components.
Experience in machine learning is a big plus.
Education/Experience:
Bachelor's degree in computer science, software engineering or relevant field required.
5-7 years’ experience required
Any Graduate