Senior Associate L1 DE-Big Data Azure

About the job
The Senior Associate People Senior Associate L1 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to insure the necessary health of the overall solution
Your Impact:

Data Ingestion, Integration and Transformation
Data Storage and Computation Frameworks, Performance Optimizations
Analytics & Visualizations
Infrastructure & Cloud Computing
Data Management Platforms
Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time
Build functionality for data analytics, search and aggregation

Qualifications

Your Skills & Experience:

Minimum 2 years of experience in Big Data technologies
Hands-on experience with the Hadoop stack – HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow, and other components required in building end-to-end data pipelines. Working knowledge of real-time data pipelines is added advantage.
Strong experience in at least the programming language Java, Scala, and Python. Java preferable
Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDB, Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery, etc.
Well-versed and working knowledge with data platform-related services on Azure
Bachelor’s degree and year of work experience of 4 to 6 years or any combination of education, training, and/or experience that demonstrates the ability to perform the duties of the position
Set Yourself Apart With:

Good knowledge of traditional ETL tools (Informatica, Talend, etc) and database technologies (Oracle, MySQL, SQL Server, Postgres) with hands-on experience
Knowledge of data governance processes (security, lineage, catalog) and tools like Collibra, Alation, etc
Knowledge of distributed messaging frameworks like ActiveMQ / RabbiMQ / Solace, search & indexing, and Microservices architectures
Performance tuning and optimization of data pipelines
Cloud data specialty and other related Big data technology certifications