Description

Key Responsibilities:

Data Integration and Synchronization:

Design efficient data synchronization processes between on-premises Oracle databases and Snowflake using Kafka and CDC extraction tools.

Platform Migration:

Lead the strategic planning and execution of migrating existing in-house data platforms to cloud, ensuring minimal disruption and data integrity.

Data Modeling for Snowflake and Databricks:

Develop efficient data models for cloud database to facilitate scalable data storage, processing, and analytics.

Data Pipeline Development:

Architect and implement data pipelines using Airflow and Python.

Analytics and Reporting:

Utilize Snowflake and Databricks for advanced reporting and analytics, providing actionable business insights.

Collaboration and Innovation:

Work with cross-functional teams to understand data needs and deliver technical solutions, mentoring on best practices.

• Tools and Skillsets:

Data Architecture: Demonstrated experience in migrating on-premises data to cloud and setting up stable, scalable frameworks

Databases: Proficiency in Oracle, Snowflake, and Databricks.

Data Integration: Experience with Kafka and CDC tools (like Debezium connector) for real-time data synchronization.

ETL Tools: Expertise in Airflow for data pipeline orchestration.

Programming: Advanced proficiency in Python for data processing and automation.

Data Modeling: Strong understanding of data modeling techniques and experience in designing scalable data models for cloud data warehouses.

Reporting Tools: Familiarity with BI tools and technologies for creating reports and dashboards.

Cloud Platforms: Knowledge of cloud infrastructure and services, preferably Azure, as it relates to Snowflake and Databricks integration.

Project Management: Experience in leading large-scale data migration and platform integration projects.

Communication: Excellent verbal and written communication skills for effective collaboration across teams. Strong analytical, problem-solving, and team management skills.

Education

Bachelor's degree in Computer Science