Big Data Engineer

Job Summary:
We are seeking a motivated Junior Big Data Engineer with L1 (Level 1) Support experience to join our team. The ideal candidate will have a strong foundation in big data technologies, along with experience in providing first-level support for data processing systems. In this role, you will be responsible for monitoring, troubleshooting, and resolving basic data-related issues, as well as escalating more complex problems to senior engineers when necessary.
Key Responsibilities:
Provide L1 support for big data systems, ensuring smooth and efficient operation.
Monitor the performance and health of data pipelines, clusters, and data storage systems.
Respond to alerts, identify root causes of issues, and apply basic troubleshooting steps to resolve them.
Escalate more complex issues to L2/L3 support teams or senior engineers, providing relevant information and context.
Collaborate with cross-functional teams to ensure timely resolution of incidents.
Assist in the implementation and maintenance of monitoring tools for big data environments.
Document incident reports, solutions, and preventive measures for future reference.
Support basic tasks related to data ingestion, transformation, and storage.
Follow predefined Standard Operating Procedures (SOPs) for system issues and incidents.
Required Skills & Qualifications:
3+ years of experience in Big Data Engineering, L1 support, or related roles.
Basic knowledge of big data technologies such as Hadoop, Spark, HDFS, Hive, and Kafka.
Familiarity with monitoring tools like Nagios, Grafana, or equivalent.
Basic understanding of distributed computing systems and their operational challenges.
Proficiency in Linux/Unix commands for troubleshooting and log analysis.
Basic scripting skills in Python, Bash, or similar languages.
Experience with cloud environments such as AWS, Azure, or GCP.
Knowledge of incident management processes (ITIL or similar frameworks).
Strong communication skills to interact with cross-functional teams and escalate issues effectively.
Ability to work independently on L1 tasks and as part of a larger support team.
Bachelor’s degree in Computer Science, Information Technology, or related field (or equivalent experience).
Preferred Skills:
Exposure to ETL processes and data pipeline management.
Experience with ticketing systems like JIRA, ServiceNow, or Remedy.
Familiarity with databases (SQL and NoSQL) for basic querying and troubleshooting.
Knowledge of version control tools like Git.
Understanding of basic networking and security principles in a big data environment.