-
Notifications
You must be signed in to change notification settings - Fork 12
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update README.md #80
base: master
Are you sure you want to change the base?
Update README.md #80
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
While the updated README introduces additional content, it doesn't seem to provide significant extra value or guidance to the repository. The increase in lines doesn't appear to justify the changes made.
- [Python 3.8+](https://www.python.org/downloads/) | ||
- [Node.js 14+](https://nodejs.org/) | ||
- [pip](https://pip.pypa.io/en/stable/) | ||
- [yarn](https://classic.yarnpkg.com/en/docs/install/) | ||
- [Elasticsearch](https://www.elastic.co/downloads/elasticsearch) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We recently moved away from nodejs implemented scrapers, right? so nodejs and yarn are probably not needed in this list. Also elasticsearch is installed as part of requirements.txt
, so I feel that this line will create confusion for people.
- To run the mailing list scrapers, use the following commands based on the type of documents you want to scrape: | ||
- **For Linux Foundation Documents** | ||
|
||
Ensure that the `URL` environment variable is set to the appropriate mailing list URL (e.g., `https://lists.linuxfoundation.org/pipermail/lightning-dev/` or `https://lists.linuxfoundation.org/pipermail/bitcoin-dev/`). | ||
Run the following command: | ||
```bash | ||
node mailing-list/main.js | ||
``` |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this is a depreciated scraper
a4bd36f
to
2112dad
Compare
Guide for (this) Scraper Repository