Infrastructure Architect (GCP)

Job Title: Infrastructure Architect (GCP)

Location: Melbourne (Preferred), Sydney (Alternative)

Experience: 5-8 Years

Role and Responsibilities:

• Key cloud engineer for customer engagements
• Collaborate with lead Data Consultant on customer engagements
• Define solution architecture and detailed design for data platforms on GCP
• Build solutions, i.e., perform hands on coding for the designed solution
• Interact with customer data engineering team to provide sound advice and guidance on solution architecture as well as hands on coding solutions
• Perform pair programming with customer’s data engineers and handover the developed solution to customer engineers.

Minimum Qualifications:

● Solution Architecture Knowledge and Expertise Required

       ○ Designing data platform architecture and design for

           (a) migrating open source or other public cloud based data platforms to Cloud (pref. GCP)

           (b) Designing green field data platforms on cloud
      ○ Ability to perform research on tools and technology, identify important considerations for technology selection in the architecture, provide recommendations on tool selection
      ○ Define solution architecture and detailed design for

          (a) batch ingestion an processing of data from sources such as files, cloud and on-prem databases,

          (b) streaming solutions for real time data ingestion and processing (such as loganalytics, click-stream analytics, real time data ingestion from other types of sources)
      ○ Build data pipelines and CI/CD pipelines
      ○ In-depth knowledge of at least one public cloud, preferably GCP
● Tools experience Required
      ○ GCP (GCP preferred, or equivalent in other public clouds acceptable)
      ○ GCP Dataflow, Pub/Sub, Cloud Composer, BigQuery, Cloud Run,Cloud
      ○ Functions,Spanner, CloudBuild, Vertex AI, Terraform
● Coding expertise
      ○ Programming knowledge and willingness to be hands-on as part of day today work
      ○ Knowledge of at least one (preferably both): Python, Java Preferred Qualifications
● Solution Architecture Knowledge and Expertise Required
     ○ Experience with open source ecosystem and distributions such as Hadoop,Spark, Cloudera/Hortonworks
     ○ Understanding and experience with NoSQL databases such as HBASE, MongoDB
● Tools experience Required
     ○ Other public clouds
     ○ Open source ecosystem and frameworks (Hadoop, SPARK, Oozie,Kafka, HBASE)

Certification:

● At least one of below:
     ○ GCP Data engineering (preferred)
     ○ AWS

Customer Experience:

● Experience in large enterprise environments, navigating architectural review and approval frameworks, lobbying design submissions, engaging cross-functional stakeholders (Preferably one of the Big Four AU Banks) Please share any profiles matching these requirements.