OpenWebUI issues

[geoand]

When using the OpenWebUI for Quarkud LangChain4j workshop one sees the following:

2025-02-03 10:50:23,186 ERROR [[io.qua.dev](http://io.qua.dev/).run.jso.JsonRpcCodec] (executor-thread-18) Error in JsonRPC Call: java.lang.IllegalArgumentException: text cannot be null or blank
        at dev.langchain4j.internal.Exceptions.illegalArgument(Exceptions.java:19)
        at dev.langchain4j.internal.ValidationUtils.ensureNotBlank(ValidationUtils.java:98)
        at dev.langchain4j.data.segment.TextSegment.<init>(TextSegment.java:29)
        at dev.langchain4j.data.segment.TextSegment.from(TextSegment.java:94)
        at dev.langchain4j.model.embedding.EmbeddingModel.embed(EmbeddingModel.java:24)
        at dev.langchain4j.model.embedding.onnx.bgesmallenq.BgeSmallEnQuantizedEmbeddingModel_ORSMi1NXux1KZo2401CGXcECI8s_Synthetic_ClientProxy.embed(Unknown Source)
        at io.quarkiverse.langchain4j.runtime.devui.EmbeddingStoreJsonRPCService.findRelevant(EmbeddingStoreJsonRPCService.java:102)
        at io.quarkiverse.langchain4j.runtime.devui.EmbeddingStoreJsonRPCService_ClientProxy.findRelevant(Unknown Source)
        at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
        at java.base/java.lang.reflect.Method.invoke(Method.java:580)
        at io.quarkus.devui.runtime.comms.JsonRpcRouter.lambda$invoke$12(JsonRpcRouter.java:323)
        at io.smallrye.mutiny.unchecked.UncheckedSupplier.lambda$toSupplier$0(UncheckedSupplier.java:41)
        at io.smallrye.context.impl.wrappers.SlowContextualSupplier.get(SlowContextualSupplier.java:21)
        at io.smallrye.mutiny.operators.uni.builders.UniCreateFromItemSupplier.subscribe(UniCreateFromItemSupplier.java:28)
        at io.smallrye.mutiny.operators.AbstractUni.subscribe(AbstractUni.java:36)
        at io.smallrye.mutiny.operators.uni.UniRunSubscribeOn.lambda$subscribe$0(UniRunSubscribeOn.java:27)
        at io.quarkus.vertx.core.runtime.VertxCoreRecorder$15.runWith(VertxCoreRecorder.java:637)
        at org.jboss.threads.EnhancedQueueExecutor$Task.doRunWith(EnhancedQueueExecutor.java:2675)
        at org.jboss.threads.EnhancedQueueExecutor$Task.run(EnhancedQueueExecutor.java:2654)
        at org.jboss.threads.EnhancedQueueExecutor.runThreadBody(EnhancedQueueExecutor.java:1627)
        at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1594)
        at org.jboss.threads.DelegatingRunnable.run(DelegatingRunnable.java:11)
        at org.jboss.threads.ThreadLocalResettingRunnable.run(ThreadLocalResettingRunnable.java:11)
        at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
        at java.base/java.lang.Thread.run(Thread.java:1583)

cc @iocanel @phillip-kruger

[phillip-kruger]

I guess you need to handle if text is null here:

quarkus-langchain4j/core/runtime/src/main/java/io/quarkiverse/langchain4j/runtime/devui/EmbeddingStoreJsonRPCService.java

Line 98 in 3d322ce

public JsonArray findRelevant(String text, String limit) {

[jmartisk]

You mean Dev UI, right? This happens when you search for relevant embeddings but provide a blank reference text. Right, this could be handled on the client side so that it fails faster, no need to send a request to the server in this case

[geoand]

Right, DevUI

[jmartisk]

Btw. I'm noticing that we're probably splitting the documents into too small segments, max-segment-size=100 seems to split it into chunks shorter even than one sentence

[geoand]

Right, DevUI I mean the OpenWebUI that can be opened from the DevUI

[jmartisk]

OpenWebUI isn't integrated with the EmbeddingStoreJsonRPCService in any way, so this has to be from the Embedding store page in the Dev UI

[geoand]

Might have copy and pasted the wrong stack trace

[jmartisk]

Anyway, I've submitted #1265 to fix the Dev UI thing, if you have any more, please provide more context :)

but I don't think the OpenWebUI makes any sense in step 6 because it just calls the OpenAI model directly and you can't get RAG working with it AFAIK

[geoand]

Can't really remember more at this point, so let's close the issue