Job Description: AWS Data Engineer /Data Engineer
Location: Chennai, Bengaluru, Hyderabad
Exp: 5 Years +
Key Responsibilities:
Data Pipeline Development: Design and implement scalable, reliable, and efficient data pipelines on AWS for data collection, processing, and storage.
Cloud Architecture Design: Build cloud-native solutions for data storage, processing, and analytics using AWS services such as S3, Redshift, Athena, Lambda, EMR, and Glue.
Data Integration: Integrate various data sources and ensure that data pipelines are well-integrated with internal and external systems.
Data Warehousing: Design and manage large-scale data warehousing solutions with AWS Redshift or other AWS-based tools.
ETL Development: Develop, maintain, and optimize ETL processes to extract, transform, and load data into the data lake, data warehouse, and other storage solutions.
Big Data Solutions: Utilize AWS services like EMR, Kinesis, and DynamoDB for real-time data processing and analysis.
Automation and Monitoring: Implement automated workflows for data loading and processing, monitor data pipeline health, and ensure data quality.
Collaboration with Teams: Work closely with data scientists, data analysts, and other teams to understand data needs and deliver data solutions accordingly.
Performance Optimization: Continuously improve the performance, scalability, and efficiency of data processes and infrastructure.
Documentation: Maintain proper documentation of the data architecture, pipelines, and processes for internal and external audits.
Any Graduate