Moroccan housing data pipeline using scrapy, mongodb , zyte and digitalocean cloud
-
Updated
Oct 8, 2022 - Python
Moroccan housing data pipeline using scrapy, mongodb , zyte and digitalocean cloud
A scrapy spider hosted on zyte created for "myanimelist.net/topanime.php" connected to a SQL cloud database for the Anime Dashboard. The spider creates a ETL pipeline using DataClasses and regular expressions.
I have used scrapy framework to scrape data from the IMDB website of Movies like name, directors, actors, votes, duration, genre and imdb rating. i had uploaded this spider on zyte cloud platform to run on it and i scraped about 8 lakhs rows of data from IMDB of different genres.
Zyte-based web scraper for AI product data insights
Webscraping competition during the Extract Summit 2021 conference.
Yet another bunch of cli utilities for Zyte's Scrapy Cloud.
Reproducible benchmark comparing Zenrows and Zyte across 8 protected and unprotected targets
Benchmark comparing Zenrows, Zyte, ScraperAPI and Scrapfly across four protected targets
To associate your repository with the zyte topic, visit your repo's landing page and select "manage topics."