Data Engineer with Dataikus Specialized

Key Responsibilities:

Dataiku Platform Management:
Design, implement, and maintain data pipelines using Dataiku to process, analyze, and visualize data.
Develop and manage Dataiku projects, ensuring they meet business requirements and adhere to best practices.
Collaborate with data scientists and analysts to integrate machine learning models into Dataiku workflows.
Customize Dataiku components and plugins to extend platform functionality as needed.
Troubleshoot and resolve issues related to Dataiku workflows, datasets, and connections.
SQL Development and Optimization:
Write and optimize complex SQL queries to extract, manipulate, and analyze data from various sources.
Develop stored procedures, views, and functions to support data integration and reporting needs.
Perform data quality checks and validation to ensure the accuracy and integrity of SQL-based solutions.
Optimize database performance through indexing, query optimization, and database tuning.
Data Integration and Transformation:
Design and implement ETL (Extract, Transform, Load) processes to integrate data from disparate sources into Dataiku.
Develop and maintain data transformation scripts and workflows to support analytical and reporting requirements.
Ensure seamless integration between Dataiku and other data systems, including databases, cloud storage, and APIs.
Collaboration and Communication:
Work closely with business stakeholders to understand data needs and translate them into technical solutions.
Provide technical expertise and support to team members and stakeholders regarding Dataiku and SQL-related matters.
Document technical processes, workflows, and data transformations to ensure clarity and knowledge sharing.
Participate in code reviews, providing constructive feedback and ensuring adherence to coding standards.
Project Management:
Manage multiple projects simultaneously, ensuring timely delivery of high-quality solutions.
Monitor project progress and adjust plans as needed to meet deadlines and deliverables.
Contribute to project planning and scoping, providing estimates and identifying potential risks and challenges.
Continuous Improvement:
Stay current with industry trends and advancements in Dataiku, SQL, and data science technologies.
Identify opportunities for process improvements and propose enhancements to existing workflows and solutions.
Participate in training and development activities to continuously enhance technical skills and knowledge.
Required Qualifications:

Technical Skills:
Proven experience with Dataiku, including the design and management of data pipelines and workflows.
Advanced SQL skills with a strong ability to write, optimize, and troubleshoot complex queries.
Experience with ETL processes and data integration techniques.
Familiarity with data visualization and reporting tools is a plus.
Knowledge of machine learning concepts and model integration within Dataiku is advantageous.
Experience:
Minimum of 5+ years of experience in application development, with a focus on Dataiku and SQL.
Demonstrated experience in managing and optimizing large-scale data projects.
Previous experience working in a similar role within a corporate or enterprise environment is preferred.
Soft Skills:
Strong analytical and problem-solving abilities.
Excellent communication and interpersonal skills, with the ability to convey complex technical concepts to non-technical stakeholders.
Ability to work independently and as part of a collaborative team.
Strong organizational skills with the ability to manage multiple priorities effectively.