Data Engineer

Dear Candidate, 

We have urgent requirement with our premium Client.

Role: Senior Data Engineer

Work location: Mumbai, Bangalore, Trivandrum

Exp: 3-7 years

Role & Responsibilities:

• Work with business users and other stakeholders to understand business processes.
• Ability to design and implement Dimensional and Fact tables
• Identify and implement data transformation/cleansing requirements
• Design and develop scalable and efficient data architectures using Kafka topics and Flink jobs, ensuring high performance and reliability.
• Optimize Flink dashboards and improve job performance and usability.
• Lead efforts to identify and resolve performance bottlenecks in Flink dashboards, topic optimization, and underlying data structures.
• Implement best practices for data modeling, data integration, and data governance to ensure data accuracy, consistency, and security.
• Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data Warehouse
• Develop conceptual, logical, and physical data models with associated metadata including data lineage and technical data definitions
• Design, develop and maintain ETL workflows and mappings using the appropriate data load technique
• Provide research, high-level design, and estimates for data transformation and data integration from source applications to end-user BI solutions.

© 2020 Quantiphi Inc, All rights reserved

• Provide production support of ETL processes to ensure timely completion and availability of data in the data warehouse for reporting use. Analyze and resolve problems and provide technical assistance as necessary. Partner with the BI team to evaluate, design, develop BI reports and dashboards according to functional specifications while maintaining data integrity and data quality. Work collaboratively with key stakeholders to translate business information needs into well-defined data requirements to implement the BI solutions.
• Leverage transactional information, data from ERP, CRM, HRIS applications to model, extract and transform into reporting & analytics.
• Define and document the use of BI through user experience/use cases, prototypes, test, and deploy BI solutions.
• Develop and support data governance processes, analyze data to identify and articulate trends, patterns, outliers, quality issues, and continuously validate reports, dashboards and suggest improvements. ● Train business end-users, IT analysts, and developers.
• Good to have: Designing and implementing data pipeline in Cloud Dataflow.

Required Skills:

• Bachelor’s or Master's degree in Computer Science, Information Technology or similar field or equivalent work experience.
• Minimum of 5 years of experience in data architecture, with a focus on Flink and Apache Kafka.
• Extensive hands-on experience in integrating Apache Kafka with Flink, and implementing Flink dashboards.
• Solid understanding of data modeling concepts and experience in designing dataflow pipelines.
• 4+ years of experience with Informatica Power Center on Data Warehousing or Data Integration projects.
• Expert with data warehousing standards, strategies, and tools.
• Expert with SDLC processes.
• Proficiency in Python, Apache Kafka, Apache Flink, and Dataflow.
• Experience in Informatica Power exchange for Mainframe, Salesforce, and other new-age data sources.
• 
  Experience in Informatica Webservices, XML, Java Transformations, etc. ● Strong knowledge of relational databases ● Strong SQL background.
• Strong experience in GCP & Google BigQuery.
• Strong problem-solving, multi-tasking, and organizational skills.
• In-depth understanding of database management systems, online analytical processing (OLAP) and ETL (Extract, transform, load) framework, data-warehousing.
• Knowledge of SQL queries, SQL Server Reporting Services (SSRS), and SQL Server Integration Services (SSIS) is a must.
• Knowledge of AWS data lake is a plus.
• Highly proficient in working with large volumes of business data and strong understanding of database design and implementation.
• Good written and verbal communication skills.
• Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.
• Demonstrated experience of leading a team spread across multiple locations.

Position is on Contract

Regards,

Nidhi Tiwari

Technical Recruiter

WhatsApp: 9595741193

[email protected]

Post your jobs at world’s 1st & only Global Technology Job Portal www.iitjobs.com

Refer consultant and earn Rs 50000