Skip to content

Latest commit

 

History

History
50 lines (32 loc) · 1.47 KB

README.md

File metadata and controls

50 lines (32 loc) · 1.47 KB

Hilleberg_Scraper

A scraper for the B-Ware Sale of the tent manufacturer Hilleberg. This program is based on the wg_gesucht repository and compare the already existing items with new ones and notify via telegram or pushover (or both/none).

Before use

Define your preferred way of notification in the config.txt file under use_notification and set your pushover user-token & app-token or your telegram bot-token & bot-chatID before use or there will be no notification. Also check the Filter Option and change it if needed (main.py).

config.txt

config

URL & Filter (main.py)

url_searchitems

ATTENTION

The scraper is using BeautifulSoup4, so you have to install it on your machine.

First install python3-pip with:

sudo apt-install python3-pip

And the Bs4-Modul with:

pip3 install bs4

Extra Information

If deployed on a server or raspberry-pi use a crontab to let it run in the background. A good interval would be every 5 minutes.

crontab -e

And insert following crontab statement:

*/5 * * * * cd /your/path/to/script/hilleberg_scraper && exec python3 main.py

Things to know

If you are interesting in changing the code take a look into the sample.html file. It shows you a small overview of the used html dataset.