Data Engineer

Responsibilities

This position will work closely with our Data Analytics team to design, build, and maintain the computational infrastructure to support the business intelligence platform
This position plans, designs, and optimizes for data throughput and query performance issues
This requires constantly updating expertise in areas such as platform, network and storage technologies, bandwidth management, data bus implications, and design
Additionally, this position plays a key role in the configuration and utilization of backend database technology
Drive optimization of the full data pipeline and infrastructure to support the actual content, volume, ETL to support the intended kinds of queries and analysis to match expected responsiveness
Design, architect, and document the database schema and data pipelines
Design, implement, and test data collection, storage, and mapping procedures
Research, design, and test computational environments to support analytical modeling (statistics, machine learning, optimization, and simulation)
Develop statistical models for data quality assurance and data imputation
Collaboratively troubleshoot technical and performance issues within the data platform
Write, optimize, and automate data processing tasks
Deploy and maintain system and database monitoring tools
Maintain central repository/code base for production code (e.g Github).
 

Qualifications

This position requires expertise in Python scripting language and experience in API integration
B.S. or M.S. in computer science, computer engineering, or a related technical field
Minimum 7 years of experience in cloud-based ETL architecture/development, implementation and support
Advanced SQL development skills and an in-depth understanding of database technologies
Minimum of 5 years’ experience working with Microsoft BI Tools including Azure Data Lake, Azure Data Lake Analytics, Azure SQL Database, Data Bricks and Azure SQL Data warehouse and Azure Data Factory
Experience with Azure cloud infrastructure and distributed computing Familiarity with large-scale analytics systems
Excellent analytical and problem-solving skills
Strong written and oral communication skills
You must be work authorized in the United States without the need for employer sponsorship