Looking for an exceptional individual and has a proven track record in conceiving and delivering Data Warehouse solutions at company-wide scale.
- 8+ years of data engineering experience in a fast-paced company that delivers software, with the understanding of SDLC methodologies.
- Strong understanding of engineering best practices, analytical and problem-solving, design principles and agile methods.
- A good understanding of designing and building highly scalable Data warehouses, Data pipelines, Data Modelling, designing Data Lakes and Big Data Analytics using NoSQL, and programming languages (like Python, Java, Scala).
- Experience in building petabyte scale distributed systems using technologies like Hadoop, Hive, Spark, Snowflake, Presto, Redshift, Cassandra, MongoDB, Kafka and streaming. Databricks, Snowflake, Segmentation experience is desired.
- Excellent communication, collaborative demeanor and ability to work in distributed, multi-functional teams with the ability to articulate a point of view.
- Required to perform on-call duties in a data-ops / DRE environment.
- Bachelor's/Master’s degree in Computer Science required, or equivalent experience
What?
As a Tech Lead, Data Engineer, you will live :Design, Develop and maintain scalable data pipelines and Data warehouse to support continuing increases in data volume and complexity.
- Develop set processes for data mining, data modelling, and data production.
- Collaborates with Data Architects and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
- Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key partners and business processes that depend on it.
- Writes unit/integration tests, contributes to engineering wiki, and documents work.
- Performs data analysis required to solve data related issues and assist in the resolution of data issues.
- Works closely with a team of frontend and backend engineers, product managers, and analysts.
- Designs data integrations and data quality framework.
- Prepare accurate database design and architecture reports for management and Business teams.
- Be responsible for the migration of data from legacy systems to new solutions.
- Monitor the system performance by performing regular tests, solving problems and integrating new features.
- Recommend solutions to improve new and existing database systems.
- Educate staff members through training and individual support.
- Offer support by responding to system problems in a timely manner.