Data Engineer

Job duties include:

• Design, develop, and operate high-scale applications focusing on operational excellence, security, and scalability.
• Involve in the entire software development life cycle (SDLC) activities of the project including, requirement gathering from the business owners of the product, performing analysis on the requirements, providing design solutions, discussing the technical and non-technical aspects of the design with the concerned teams, development, testing, and support operations.
• Compile and assess user feedback for the existing software products
• Create technical specifications and document application functionality as a reference for future maintenance and upgrades
• Design and develop data pipelines and data processing systems using Hadoop and related technologies such as Spark, MapReduce, Hive, etc.
• Work on ETL and Data Pipelines using Informatica and RDBMS Databases like Oracle, SQL Server, Snowflake, etc.
• Build end-to-end automation using Python, and Unix shell scripting to automate routine jobs.
• Develop and execute unit, functional, and integration tests of developed software components.
• Develop, test, and deploy updates and bug fixes to the application using CI/CD pipelines.
• Participate in a tight-knit engineering team employing agile software development practices.

Requirements: Bachelor’s degree in Comp Sci, Engg, IT, or related with at least 60 months of experience. Salary ranges between $141,315.00 to $145,000.00/year.