• Design and build web crawlers to scrape data and URLs.
• Maintain and run web crawlers full stack applications.
• Integrate the data crawled and scraped into our databases.
• Create more/better ways to crawl relevant information.
• 3+ years of experience in Python with knowledge of Scrapy framework
• Experience in e-commerce data scaping / web crawler projects.
• Strong knowledge of web technologies (HTML, CSS, JavaScript, XPath, Regex)
• Understanding of PHP basics and experience in working with MySQL or MariaDB is a plus
• Understanding of data privacy policies (esp. GDPR) and personally identifiable information
• Good Communication skills.