Description


About the Role:
We are seeking a highly experienced and skilled AWS Cloud Solution Architect with a strong background in data engineering and analytics to join our growing team. You will play a pivotal role in designing, developing, and implementing scalable and secure cloud-based solutions for data ingestion, transformation, storage, analysis, and visualization. You will leverage your expertise in AWS services and data engineering principles to build robust data pipelines and architectures that support our organization's data-driven initiatives.
Responsibilities:
Collaborate with business stakeholders and data scientists to understand data requirements and translate them into technical solutions.
Design and architect secure, scalable, and cost-effective data pipelines on AWS utilizing services like S3, Redshift, Glue, EMR, Kinesis, and Lambda.
Develop and implement data transformation and processing workflows using tools like Microservices, NodeJS, or AWS Glue.
Select and configure appropriate AWS storage solutions for various data types (structured, semi-structured, unstructured).
Implement best practices for data security, governance, and compliance throughout the data lifecycle.
Develop and maintain documentation for designed architectures and data pipelines.
Automate infrastructure provisioning and configuration management using infrastructure as code (IaC) tools like Terraform or CloudFormation.
Monitor and optimize the performance and cost efficiency of data pipelines.
Stay up to date with the latest trends and innovations in cloud technologies, data engineering tools, and data analytics frameworks.
Qualifications:
12+ years of experience in data engineering, data architecture, or a related field.
Proven experience in designing and implementing scalable and secure data pipelines on AWS.
In-depth knowledge of data engineering principles, data modeling techniques, and data storage solutions.
Expertise in at least one scripting language like Python or Java and experience with data processing frameworks (Spark, PySpark).
Experience with AWS services for data management and analytics (S3, Redshift, Glue, EMR, Kinesis, Lambda).
Strong understanding of data security and governance best practices.
Excellent communication, collaboration, and problem-solving skills.
Ability to work independently and as part of a cross-functional team.

Education

Any Graduate