Python Developer

Position Overview

We are a seed-funded startup focused on using state-of-the-art AI technologies to revolutionize the credit industry. Our team consists of experts in machine learning and software engineers who have worked at top-tier US tech companies like Apple, Amazon, etc , and we are passionate about using AI to improve access to credit information for businesses. We have the product on the market, the first clients, and sufficient runway. We are seeking a talented Python Developer with a specialization/interest in Web Scraping. In this role, you will be at the forefront of extracting critical data from various online sources, leveraging your expertise in Python and web scraping technologies to drive our data-driven solutions.

Key Responsibilities

• Web Scraping and Data Collection: Develop, deploy, and maintain web scraping scripts and tools using Python to gather essential data from multiple online sources.
• Data Processing and Management: Process and structure the scraped data, ensuring its relevance, accuracy, and readiness for analysis.
• Automation and Optimization: Automate scraping tasks for efficient and regular data updates. Optimize scripts for performance, scalability, and reliability.
• Collaborative Data Strategy Development: Work closely with data analysts and engineers to integrate scraped data into broader data strategies and systems.
• Compliance Adherence: Ensure all data collection methods comply with legal and ethical standards, including respecting website terms of service and data privacy laws.
• Technical Problem Solving: Address challenges related to dynamic web content, anti-scraping measures, and large-scale data extraction.
• Documentation and Reporting: Create detailed documentation for the scraping processes and provide regular updates on scraping operations.

Qualifications

• Proven expertise in Python and it's ecosystem as well as best practices, with a strong focus on web scraping tools (e.g., BeautifulSoup, Scrapy, Selenium).
• Experience in building and managing automated web scraping systems.
• Understanding of web technologies (HTML, CSS, JavaScript) and familiarity with network protocols.
• Knowledge in handling various data formats (JSON, XML, CSV).
• Ability to write clean, maintainable, and efficient code.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
• Strong problem-solving skills and the ability to work independently in a fast-paced environment.
• Experience with cloud platforms, particularly AWS, is a plus.
• Being scrappy!