From 63d4d9875ecc055c37e8808df3c7e514e1297c17 Mon Sep 17 00:00:00 2001 From: Anupam Kumar Date: Tue, 6 Aug 2024 12:52:31 +0530 Subject: [PATCH] fix(AI/ContextChat): remove previous limitations Signed-off-by: Anupam Kumar --- admin_manual/ai/app_context_chat.rst | 15 ++++++++------- 1 file changed, 8 insertions(+), 7 deletions(-) diff --git a/admin_manual/ai/app_context_chat.rst b/admin_manual/ai/app_context_chat.rst index ad021ca3472..05f55a6bb9e 100644 --- a/admin_manual/ai/app_context_chat.rst +++ b/admin_manual/ai/app_context_chat.rst @@ -11,15 +11,15 @@ Context Chat is an :ref:`assistant` feature that is implemente Together they provide the ContextChat text processing tasks accessible via the :ref:`Nextcloud Assistant app`. -The *context_chat* and *context_chat_backend* apps run only open source models and do so entirely on-premises. Nextcloud can provide customer support upon request, please talk to your account manager for the possibilities. +The *context_chat* and *context_chat_backend* apps will use the Free text to text task processing providers like OpenAI integration, LLM2, etc. and such a provider is required on a fresh install, or it can be configured to run open source models entirely on-premises. Nextcloud can provide customer support upon request, please talk to your account manager for the possibilities. This app supports input and output in languages other than English if the language model supports the language. Requirements ------------ -* Minimal Nextcloud version: 28 -* The *context_chat_backend* app is built as an External App and thus depends on AppAPI v2.3.0 and later +* Minimal Nextcloud version: 30 +* The *context_chat_backend* app is built as an External App and thus depends on the lastest AppAPI * Nextcloud AIO is supported * We currently support NVIDIA GPUs and x86_64 CPUs * CUDA >= v12.2 on your host system @@ -55,6 +55,11 @@ Installation occ app:enable context_chat +4. Optionally, run two instances of this occ command for faster processing of requests: + +.. code-block:: + + occ background-job:worker 'OC\TaskProcessing\SynchronousBackgroundJob' **Note**: Both apps need to be installed and both major version and minor version of the two apps must match for the functionality to work (ie. "v1.3.4" and "v1.3.1"; but not "v1.3.4" and "v2.1.6"; and not "v1.3.4" and "v1.4.5"). Keep this in mind when updating. @@ -95,11 +100,7 @@ Nextcloud customers should file bugs directly with our Customer Support. Known Limitations ----------------- -* The underlying language model used by Context Chat cannot be changed -* We currently only support the English language * Language models are likely to generate false information and should thus only be used in situations that are not critical. It's recommended to only use AI at the beginning of a creation process and not at the end, so that outputs of AI serve as a draft for example and not as final product. Always check the output of language models before using it. * Make sure to test this app for whether it meets your use-case's quality requirements * Customer support is available upon request, however we can't solve false or problematic output, most performance issues, or other problems caused by the underlying model. Support is thus limited only to bugs directly caused by the implementation of the app (connectors, API, front-end, AppAPI) -* Due to technical limitations that we are in the process of mitigating, each task currently incurs a time cost of between 0 and 5 minutes in addition to the actual processing time * Nextcloud usernames can be only 56 characters long. This is a limitation of the vector database we use (Chroma DB) and will be fixed soon. -* AI as a service providers like OpenAI integration, LLM2, etc. don't work with this app as of now. We are in process of integrating them.