Key Responsibilities:
Data Integration and Synchronization:
Design efficient data synchronization processes between on-premises Oracle databases and Snowflake using Kafka and CDC extraction tools.
Platform Migration:
Lead the strategic planning and execution of migrating existing in-house data platforms to cloud, ensuring minimal disruption and data integrity.
Data Modeling for Snowflake and Databricks:
Develop efficient data models for cloud database to facilitate scalable data storage, processing, and analytics.
Data Pipeline Development:
Architect and implement data pipelines using Airflow and Python.
Analytics and Reporting:
Utilize Snowflake and Databricks for advanced reporting and analytics, providing actionable business insights.
Collaboration and Innovation:
Work with cross-functional teams to understand data needs and deliver technical solutions, mentoring on best practices.
• Tools and Skillsets:
Data Architecture: Demonstrated experience in migrating on-premises data to cloud and setting up stable, scalable frameworks
Databases: Proficiency in Oracle, Snowflake, and Databricks.
Data Integration: Experience with Kafka and CDC tools (like Debezium connector) for real-time data synchronization.
ETL Tools: Expertise in Airflow for data pipeline orchestration.
Programming: Advanced proficiency in Python for data processing and automation.
Data Modeling: Strong understanding of data modeling techniques and experience in designing scalable data models for cloud data warehouses.
Reporting Tools: Familiarity with BI tools and technologies for creating reports and dashboards.
Cloud Platforms: Knowledge of cloud infrastructure and services, preferably Azure, as it relates to Snowflake and Databricks integration.
Project Management: Experience in leading large-scale data migration and platform integration projects.
Communication: Excellent verbal and written communication skills for effective collaboration across teams. Strong analytical, problem-solving, and team management skills.
Bachelor's degree in Computer Science