Senior Python Data Engineer

Summary : We are looking to hire an EPE (Enterprise Python Environment) Developer with a focus on data engineering, you would be responsible for leveraging Python and data engineering skills to build and maintain enterprise-level data solutions. This role typically involves working with large-scale data processing, data pipelines, and data integration to support various business needs within an organization.

Job responsibilities:

Developing and maintaining data pipelines and ETL (Extract, Transform, Load) processes using Python.

Designing and implementing scalable data processing solutions to handle large volumes of data.

Collaborating with data scientists, analysts, and other stakeholders to understand data requirements and develop solutions to support their needs. Integrating external data sources and APIs to enrich and expand the organization's data assets.

Utilizing data engineering best practices to ensure data security, privacy, and compliance with regulations.

Developing and maintaining data documentation, including data dictionaries, data lineage, and metadata management.

Required Skills:

Minimum 8+ years of experience is required.

Hands on experience in Python programming Experience in building data pipelines using Azure Data Factory and Databricks Strong understanding of data engineering concepts, including ETL processes, data modeling, data architecture, and data integration Experience with Python application frameworks (Django, Flask, Pyramid, Tornado) Experience with Python testing and code analysis tools (Pytest, Pylint) Knowledge of SQL and experience working with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).

Familiarity with SSIS Education: Bachelor’s degree in computer science or finance