Data Engineer/Talend ETL Developer

Job Duties & Responsibilities:

• Design, Develop and maintain secure, consistent and reliable ETL solutions supporting critical business processes across the various Business Units.
• Ensure data solutions are compliant with enterprise security standards
• Work in complex multi-platform environments on multiple project assignments.
• Develop and perform tests and validate data flows and prepare ETL processes to meet complex business requirements, including designing and implementing of complex end-to-end solutions using BI platforms.
• Coordinate with analysts and developers to ensure jobs designed and developed meet minimum support standards and best practices before migration into the production environment.
• Partner with various infrastructure teams, application teams, and architects to generate process designs and complex transformations to various data elements to provide the Business with insights into their business processes.
• Uses strategies such as Indexing and partitioning to fine tune the data warehouse and big data environments to improve the query response time and scalability.
• Define and capture metadata and rules associated with ETL processes.
• Assist production support team in providing resolutions to production job failures, data issues and performance tuning

Required Skills & Experience:

• Strong understanding of Data warehousing (Dimensional Modeling, ETL etc.) and RDBMS concepts
• 5+ years working experience with Talend ETL tool
• 5+ years working experience in SQL, Stored Procedures and Table Design
• 5+ years working experience in SQL Query optimization and ETL Data loading Performance
• 2+ years working experience in shell scripting
• Experience in real time streaming technologies is preferred, not required
• Previous Snowflake Cloud Data Warehouse a big plus, not required
• Experience as a Data Engineer in Hadoop Platforms on components like HIVE, KAFKA, NiFi, Spark etc is a big plus, not required
• Experience deploying machine learning models and automating processes in production is a plus, not required
• Experience with cloud technologies(AWS, Azure, GCP) is big plus, not required