BIG DATA ENGINEER

Position Description

Interact with Business and Functional Leads to gather Requirements; Understand the current legacy Applications; Analysis and Estimation of the scope of work and their timeline; Prepare detailed project schedule, baseline the same, manage changes to ensure timely delivery; Design Solutions and contribute to defining the System Architecture by understanding the business requirements; Perform high and low-level design, provide pseudo codes, implement the prototype, and conduct design & code reviews; Develop data platform applications using identified cloud technologies like azure data factory & azure databricks etc.; Create test cases and perform unit testing and integration testing; Review Code and Test Cases to ensure the quality and the required coding standards; Engage other technical team members in the design, development, delivery, and deployment of solutions; Monitor and optimize the performance of the data applications; Scheduling and Tracking deliverables; Deploy the application and coordinate with business user’s UAT signoff; Provide extensive production support for data applications deployed in production and involve in post go live activities. Relocation/ telecommuting may be required plus travel to various unanticipated client locations within the United States for short- and long-term assignments.

Languages and Tools

Azure Databricks, Azure Synapse Analytics, Azure Functions, Azure Data Factory, Apache Spark, Python, Scala, Unix, PowerShell, Azure CLI, SSIS, Pytest, ADLS Gen2, Azure SQL DB, Oracle DB, Teradata, Hive, HDFS

Education

Masters in computer science/Computer Applications/Technology/Engineering (Mechanical/Civil/ Electronics & Electrical). Will accept Bachelor of Science in Computer Science/Computer Applications/Technology/Engineering (Mechanical/Civil/ Electronics & Electrical) followed by 5 years of progressive experience in field or related field in lieu of Masters. Will Accept Foreign Educational Equivalent.