Python Developer - Web Scraping/Crawling

Recruitment Firm
India

- Develop and maintain service that extracts websites data using scrapers and APIs across multiple websites
- Extract structured/unstructured data
- Manipulate data through text processing, image processing, regular expressions, etc.
- Writing reusable, testable, and efficient code
- Manage testing and bug fixes
- Structure and manage database for analyses, collaborating with the U.S. thought leaders to shape the upcoming reports
- Manage data by proper data integration and management to all aspects of achieving data and analytics result quality.
- Continue and build on our work by automating the data pipeline on our data science/ BI platform.