Senior Data Engineer

Qualifications

Bachelor’s degree in computer science, computer science engineering, or related experience required; advanced degree preferred.
Should have a good understanding of the Python programming language, including object-oriented programming principles, data types, variables, loops, conditional statements, methods, and classes.
8+ years of Software Design and Development experience working on web services.
Excellent programming skills in Python, Py Spark. Java (good to have)
Expertise in working with a variety of databases - Oracle SQL, Couchbase, Mongo DB.
Design data models for storage and retrieval to meet product and requirements
Should have good Experience in Data migration.
Build scalable data pipelines using Spark, Airflow, Apache projects (Spark, Flink, Hive, and Kafka)
Familiar with modern software development practices (Agile, TDD, CICD) applied to data engineering
Enhance data quality through internal tools/frameworks detecting DQ issues. Working knowledge of relational databases and SQL query authoring
Excellent problem solving and analytical skills
Should have knowledge of RESTful web services and how to consume them in web applications
Experience working with AWS is desired
Should be able to deploy web applications to various environments, including local, development, staging, and production
Experience with design and coding in Java and across one or more platforms and additional languages as appropriate.
Excellent problem-solving and troubleshooting skills.
Excellent time management and project management skills.
Great teammate with excellent verbal and written communication skills.