Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs(AI): Add more details to requirements #12078

Merged
merged 2 commits into from
Aug 1, 2024
Merged

docs(AI): Add more details to requirements #12078

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
389ddbc
docs(AI): Add more details to requirements
marcelklehr Jul 31, 2024
c2d7e83
fix: app_context_chat.rst
marcelklehr Aug 1, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions admin_manual/ai/app_context_chat.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,10 @@ Requirements
* CPU Sizing

* At least 12GB of system RAM
* Below version 3, 10-20 Cores, the more cores (physical cores) the faster the prompt processing will be. Overall performance will increase with an increase in memory bandwidth (more memory sticks and/or higher DDR version)
* Since version 3, this app makes use of the configured Text To Text Free prompt provider instead of running its own Language model, you will thus need only 4-8 cores for the embedding model

* A dedicated machine is recommended

Space usage
~~~~~~~~~~~
Expand Down
1 change: 1 addition & 0 deletions admin_manual/ai/app_stt_whisper2.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,7 @@ Requirements

* The more cores you have and the more powerful the CPU the better, we recommend 10-20 cores
* The app will hog all cores by default, so it is usually better to run it on a separate machine
* 4GB for the app

Installation
------------
Expand Down
4 changes: 3 additions & 1 deletion admin_manual/ai/app_translate.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,9 +20,11 @@ Requirements
------------

* Minimal Nextcloud version: 26
* x86 CPU
* x86 CPU with 4-8 cores for the app to use (The more cores the faster it will be)
* 2GB of RAM for the app should be enough
* GNU lib C (musl is not supported)
* This app does not support using GPU for processing and may thus not be performing ideally for long texts
* The workload will run on the web server workers

(*Note*: Nextcloud AIO is currently not supported due to it using musl)

Expand Down
Loading