Data Engineering Specialist

We currently are on the lookout for an Data Migration & Web Scraping / Extraction Expert who will be responsible to perform web-scraping & web-acquisition activities that enable efficient scraping of data from online sources. Build effective & sustainable data-scraping tasks to support continuous data acquisition. Collaborate with various teams to support building a seamless ecosystem of data acquisition strategies. We are seeking candidates with a credible attitude, who are humble, energetic, ambitious, and can thrive in a fast-paced ambiguous environment. 

Key Responsibilities:

Data Extraction and Web Scraping:

• Develop and implement web scraping scripts and tools to extract data from various online sources
• Monitor and maintain web scraping processes to ensure data accuracy and reliability
• Identify and resolve issues related to data extraction and scraping

Data Migration and ETL:

• Design, plan, and execute data migration projects to transfer data between systems or platforms
• Ensure data integrity and accuracy throughout the migration process

Data Quality Assurance:

• Perform data validation and quality checks to ensure the accuracy and completeness of migrated data
• Troubleshoot and rectify data inconsistencies or errors during migration

Collaboration and Communication:

• Collaborate with cross-functional teams, including data analysts, engineers, and stakeholders, to understand data requirements and deliver on project objectives
• Provide regular updates and reports on data migration progress to relevant stakeholders

Documentation and Reporting:

• Document all processes, procedures, and scripts
• Generate comprehensive reports and documentation for internal and external use

Excel Data cleaning:

-   Import, clean, and organize large datasets in Excel

-   Perform data validation, data cleansing, and data transformation tasks

-   Use various Excel functions, formulas, and features to analyze and interpret data

-   Write VBA (Visual Basic for Applications) macros to automate repetitive tasks and improve  efficiency

Qualifications:

• Bachelor's degree in CS, IT or Data Science
• Strong command on Javascript to support web scraping
• Proven experience in data migration projects, including ETL processes
• Proficiency in web scraping techniques and tools (e.g. Beautiful Soup, Selenium, Scrapy)
• Strong programming skills in languages like Python, R, or other relevant languages
• Excellent critical-thinking & problem-solving skills to compose robust solutions
• Strong communication and teamwork abilities
• Attention to detail and a commitment to data accuracy
• Knowledge of data visualisation tools (Tableau)
• Familiarity with Mc Excel, Python,SQL,Java Script