Skip to content

Latest commit

 

History

History
15 lines (12 loc) · 437 Bytes

README.md

File metadata and controls

15 lines (12 loc) · 437 Bytes

Scrapy Project

These are collection of some of web scraping projects with scrapy.

Requirements:

  1. Python 3
  2. Scrapy framework
  3. Selenium
  4. BeautifulSoap

Install Requirements:

  1. pip install -r requirements.txt

Usage:

  1. cd <project directory>
  2. scrapy crawl <spider name> -o <output file name>.<jl/json/csv>