Scrapy Project These are collection of some of web scraping projects with scrapy. Requirements: Python 3 Scrapy framework Selenium BeautifulSoap Install Requirements: pip install -r requirements.txt Usage: cd <project directory> scrapy crawl <spider name> -o <output file name>.<jl/json/csv>