Responsibilities:
• Develop, maintain, and enhance ETL pipelines for data ingestion and transformation.
• Design and build lightweight UIs using frameworks like Flask to display data in an intuitive, basic form.
• Build and expose RESTful API endpoints to integrate with databases and applications.
• Work with Postgres, DynamoDB, GraphQL to manage large volumes of data.
• Work with other engineering teams to ensure seamless integration and support for cross-functional projects.
• Assist with streaming data solutions, ensuring scalable data accessibility.
Skills:
• Primary Programming Language: Python
• Secondary Languages: Java, Go (for certain data layer updates)
• Databases: Postgres, DynamoDB, GraphQL
• Front-end Development: Flask (UI development)
• AWS: Experience with AWS services, including EMR, Kubernetes, and general cloud computing resources.
• 5+ years of experience in software engineering with strong experience in Python.
• Experience with ETL pipelines, data transformations, and working with large datasets.
• Strong familiarity with both relational and NoSQL databases (e.g., Postgres, DynamoDB).
• Comfortable building and consuming APIs and working with GraphQL.
• Experience with AWS cloud infrastructure and tools such as EMR and Kubernetes.
• Flexibility to work on different types of tasks (e.g., 50% ETL pipelines and 50% backend development)
Bachelor's degree in Computer Science