Senior Azure Data Engineer

Job Duties: Design, implement and support infrastructure on Microsoft Azure using Azure Resource manager (ARM) templates and orchestrate interactions in the ecosystem. Develop YAML and PowerShell scripts to create build and release pipelines for deploying python-based applications to Azure cloud servers. Set different data storage options including Azure Blob Storage, ADLS Gen-1, Gen-2. Implement quality gate checks on python applications using tools including SonarQube for code coverage and Checkmarks for security scan on open-source libraries. Configure and automate the data pipeline and spark cluster creation using Databricks an Azure Data Factory in Azure cloud using Python and Shell. Configure and monitor dashboards using New Relic (APM) and Azure Monitor service to find out the performance of an application and live status which help in assessing the impact and determining the cause across all the platforms and application domains. Create the deployment pipeline of Azure App Service into a subnet in a Private Virtual Network and Internal Load Balancer to support the use, transfer and storage of highly sensitive data. Write playbooks in Ansible to automate the configuration of computer systems in cloud to set up Dev, Stage and Prod environments. Create real-time streaming operational data store environment with Azure event hubs and stream analytics which directly stream into MS Power BI for corporate reporting. Discuss business solutions with the client business team, resolve existing problems and improve the application stability. Perform requirements gathering and analysis. Perform project planning and estimate time required for project completion, Prepare schedules. Create design documentation, and perform design reviews and development, testing and deployment of application enhancements. Will work in Plano, Texas and/or various client sites throughout the U.S. Must be willing to travel and/or relocate.

Salary: $135,000/year