Description


Job description:

Define and deliver a big-data ecosystem at enterprise scale; assess the data architecture in place and work with core mesh team to continuously enhance and evolve data tech stack.
Promote data mesh technology to broad user groups in both technology and business organizations, and partner with key stakeholders to assist with defining the data and analytics strategies.
Define and document data mesh architecture and developmental recommendations, and stay hands-on in developing and maintaining the framework, cookbook, and bootstrap code for data infrastructure as-a platform.
Develop short- and long-term architectural strategies and plans for on-boarding data products. Identifies innovations for short- and long-term strategic opportunities.
Ensure all Non-Functional Requirements (e.g., security, performance, availability and DR/fail-over, scalability, compliance etc.) are properly articulated, designed, implemented, and well documented.
Partner with Data Governance team to ensure the completion and accuracy in metadata collections.
Evaluate, prototype and recommend emerging Cloud data technologies and platforms from open source or vendors. Independently conduct POC projects.
Communicate complex technical topics to non-technical business and senior executives and assist with scoping and architecting cloud data solutions.

Required:

At least 8 years of experience developing data and services in an enterprise and/or cloud environment.
Deep understanding of data warehouse, data lake architecture and data management processes.
Hands-on expertise of multiple modern cloud storages and services such as Snowflake, Azure SQL, ADLS2, Azure Cosmos DB, MongoDB, CockroachDB, DataStax, or Redis.
Working experience using ETL/analytics tools such as Talend, NiFi, dBt, DataBricks, or ADF, etc.
Knowledge of on-prem/cloud data virtualization such as Tibco DV, Denodo, Starburst, or Dremio.
Skilled in variety of languages such as Java, or Python
Experience in writing scripts for Linux shell and Windows PowerShell.
Strong organization and communication skills.
Bachelor's degree in Computer Science or related discipline.

Preferred Specific Skills:
Knowledge of data analytics technology and methodology, such as advanced analytics or machine learning.
Experience with DevOps, DataOps and/or MLOps using ADO.
Working knowledge of data security such as Voltage, SecuPi, Protegrity.
Knowledge of IaC and automation such as Terraform, Ansible.
Working experience with Azure and AWS cloud data and service offerings.

Education

Bachelor's degree in Computer Science