Data Engineer

Summary:

The Utah State Board of Education IT department is working on a comprehensive modernization initiative referred to as the Utah Schools Information Management System (USIMS). We are replacing the current legacy system data collection and associated reporting applications and reports from the ground up. We are looking for a high‐energy, adaptive team player with a great work ethic to join our Information Technology (IT) team as a Data Engineer, reporting to the USIMS Program Manager/Chief Product Owner. The Data Engineer is accountable for the architecting and solutioning of our data pipeline.
 

The Ideal Candidate:

The ideal candidate for this position has experience in Azure, data pipelines, data architecture and warehousing, and has dabbled in machine learning. They are a Data Engineer with a passion for data, and for making peoples’ lives easier. They enjoy both philosophical discussions and physical deployments and are comfortable working with multiple teams.

Principal Duties:
 

As a Data Engineer, your responsibilities will include:

• Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.
• Designs efficient data structures and database schemas, as well as working with distributed system architecture and non-relational databases.
• Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
• Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Works closely with a team of engineers, product managers, and analysts.
• Defines company data assets (data models), jobs to populate data models.
• Designs data integrations and data quality framework.
• Designs and evaluates open source and vendor tools for data lineage.
• Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.
• Other duties as assigned.

Requirements:

1. Degree – Candidate must possess a bachelor’s degree from an accredited college in Computer Science, Information Technology, Business, or equivalent experience.
2. Functional Experience – Candidates must have 5+ years of experience with BI reporting tools like Power BI or Tableau.
3. Functional Experience – Candidates must have 3+ years of experience with large sets of regulated data, designing efficient data structures, and database schemas, as well as working with distributed systems architecture and CosmosDB.
4. Functional Experience – Candidates must have 3+ years of experience with SQL and Python, with a focus on building reusable frameworks.
5. Functional Experience – Candidates must have 3+ years’ experience with integration technologies and protocols such as SOAP, REST, JSON and APIs, with experience in handling streaming data.
6. Functional Experience - Data Lake and/or Date Warehousing – Experience with planning and implementing a data warehouse, data lake, or other data repositories is required.
7. Functional Experience - Hands-on experience in Azure Data Factory, DataBricks, Azure Storage, SQL Pools, CI/CD Pipeline Design along with other Azure services like functions and Logic apps.
8. Interpersonal Relationships – Candidates must demonstrate the ability to work well with others of all personality types while demonstrating problem-solving and the ability to prioritize tasks.
9. Communication – Candidates must demonstrate the ability to communicate in verbal and written form with both technical and non-technical personnel.
10. Initiative – Candidates must demonstrate success as a self-starting, hardworking and inquisitive worker.
11. Teamwork – Candidates must demonstrate the ability to work with cross-functional teams to deliver on a common goal.
12. Agile/Scrum - Candidates must demonstrate experience in an agile product environment to include deep understanding and experience with agile methodologies.

Bonus skills:

1. Certifications: Azure Data Engineering, Azure DBA, Azure Developer or others related to the position
2. Domain Driven Design – Understanding and experience with Domain Driven Design
3. Financial or Education Domains and their data standards – Ed-Fi, CEDS, SIF, GAAP, etc.
4. Knowledge and Experience with Data Privacy, Data Governance, and Data Cataloguing principles.
5. Machine Learning – Knowledge of best practices and experience with an LLM