Responsibilities/Requirements:
- Must be familiar with ELK's Logstash to create complex configurations for data parsing and real-time visualization, integrating data sources, and optimizing data workflows.
- Should be able to optimize Logstash performance through advanced pipeline management, leveraging persistent queues and worker tuning to ensure high availability and fault tolerance.
- Familiarity with:
- Python
- Bash
- SQL
- AWS
- ETL/Pipelines