Build data pipelines as per the business requirements and load the processed Data into data warehouse/ data lakes/ data Mart. Design and implement multiple data products and features in collaboration with Product Owners, Business analysts using Agile/Scrum methodology. Create automated data pipelines using workflow orchestration tools. Identify and tackle issues concerning data management to improve data quality. Use PySpark, Python, Spark, SQL, Hive, AWS S3, Dynamo DB, Redis Cache, AWS Lambda, Athena, Airflow. Accept Bachelor with 5yr exp as Master. Primary worksite is Edison NJ, but relocation is possible.
Bachelor's degree in Computer Science