Sydney,Australia
Contract
Skills
Business analysis
spark
scala
Hadoop
migration
Abinitio
AWS
show less
As experienced Tech BA to play a key role in the scaled migration of on-premise Hadoop-based data platform, with customized data processing frameworks to AWS-EMR. Candidate must have a strong background in data analytics, Hadoop, and AWS Data Services with experience in managing complex migrations. Banking domain experience is a must
Key Responsibilities
1. Elicit and document business requirements for migrating existing ingestion/transform pipelines.
2. Analyze data sources, data flows, and data transformations with existing source-target mapping documents for migration purposes.
3. Collaborate with business stakeholders and data engineers/design teams.
4. Ensure DQ integrity and security throughout the migration process.
5. Develop and execute testing and validate test plans ensuring the migration is successful.
6. Communicate project progress, issues, and changes to the stakeholders
- Bachelors/Masters degree in engineering
- 4-6 years experience with as Technical BA with migration experience of data pipelines using Spark/Scala/Sqoop/Ab Initio.
Must Haves
Technical Business Analyst experienced in Banking Domains like Retail Banking, Cards, Corporate Banking, Home Loans and other banking services
Technical expertise on Hadoop, AWS Data Services
Strong in SQL writing
6+ Years total | 4-6 relevant |
Secondary
Experience in Spark/Ab Initio/Scala/Sqoop scripts
- Experience with S3, Glue, Lake Formation, Redshift
- Experience in Data Governance, Security, Compliance
Any Graduate