Skip to content

A scraper for the B-Ware Sale of the tent manufacturer Hilleberg with notification via pushover or telegram.

License

Notifications You must be signed in to change notification settings

Qu4ndo/hilleberg_scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Hilleberg_Scraper

A scraper for the B-Ware Sale of the tent manufacturer Hilleberg. This program is based on the wg_gesucht repository and compare the already existing items with new ones and notify via telegram or pushover (or both/none).

Before use

Define your preferred way of notification in the config.txt file under use_notification and set your pushover user-token & app-token or your telegram bot-token & bot-chatID before use or there will be no notification. Also check the Filter Option and change it if needed (main.py).

config.txt

config

URL & Filter (main.py)

url_searchitems

ATTENTION

The scraper is using BeautifulSoup4, so you have to install it on your machine.

First install python3-pip with:

sudo apt-install python3-pip

And the Bs4-Modul with:

pip3 install bs4

Extra Information

If deployed on a server or raspberry-pi use a crontab to let it run in the background. A good interval would be every 5 minutes.

crontab -e

And insert following crontab statement:

*/5 * * * * cd /your/path/to/script/hilleberg_scraper && exec python3 main.py

Things to know

If you are interesting in changing the code take a look into the sample.html file. It shows you a small overview of the used html dataset.

About

A scraper for the B-Ware Sale of the tent manufacturer Hilleberg with notification via pushover or telegram.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published