This repository has been archived on 2020-12-10. You can view files and clone it, but cannot push or open issues or pull requests.
IRProject/scrape.sh
Claudio Maggioni (maggicl) fab188aba7 Added Shutterstock crawler
2020-12-01 22:32:45 +01:00

7 lines
272 B
Bash
Executable file

#!/bin/bash
source ./venv/bin/activate.sh
scrapy runspider photo_scraper/spiders/flickr.py -o scraped/flickr.csv
scrapy runspider photo_scraper/spiders/stock123rf.py -o scraped/123rf.csv
scrapy runspider photo_scraper/spiders/shutterstock.py -o scraped/shutterstock.csv