Data Engineer

ob Description

1. Build and maintain secure and compliant data processing pipelines by using different tools and techniques
2. You use various Azure data services and frameworks to store and produce cleansed and enhanced datasets for analysis
3. This data store can be designed with different architecture patterns based on business requirements, including: Modern data warehouse (MDW), Big data and Lakehouse architecture
4. You also help to ensure that the operationalization of data pipelines and data stores are high-performing, efficient, organized, and reliable, given a set of business requirements and constraints
5. You help to identify and troubleshoot operational and data quality issues. You also design, implement, monitor, and optimize data platforms to meet the data pipelines.
6. You must have solid knowledge of data processing languages, including: SQL, Python/Pyspark
7. You need to understand parallel processing and data architecture patterns. You should be proficient in using the following to create data processing solutions:
• Azure Data Factory
• Azure Synapse Analytics
• Azure Data Lake Storag