LMStudio: select GPU runtime in CI, harden ping test#549
Conversation
Ping test timed out where LM Studio defaulted to the CPU (avx2) runtime. Add a hidden CI step that selects an installed Vulkan runtime before load, and make the ping robust: max_tokens 500 to 64, socket timeout 60s to 120s.
|
Getting another recurrent failure in the failing check for this PR: https://github.com/amd/playbooks/actions/runs/29502189131/job/87634358274?pr=549 Tackling these as well. |
The issue appears to be that the model fails to load initially. As a result, when the next command tries to chat with the model, it reports that no model is available because the model was never loaded successfully. Model loading failureThe model load step fails with the following error: This also explains why Follow-up chat failureAfter that, when we try to chat with the model, it fails because the model was not loaded: So the root problem is the initial model loading failure. The later “model not found” error is a downstream issue caused by the model never being loaded successfully. |
Large-model loads (e.g. gpt-oss-120b) can intermittently fail under memory pressure. Add a clean-unload + single retry to the load-model tests.
Mirror the Linux runtime-select for Windows (generic Vulkan detection), addressing PR review feedback.
Addresses: #419, #457
Summary
lmstudio-ping-endpointtimed out on runners where LM Studio ran on the CPU (avx2) runtime.max_tokens500 to 64, socket timeout 60s to 120s.Why
Nothing pinned the LM Studio runtime, so an app update could silently select the CPU engine, and a 500-token reasoning generation exceeded the hardcoded 60s client timeout. All 6 Linux runners were switched to Vulkan; the fix passed in the latest scheduled run:
https://github.com/amd/playbooks/actions/runs/29484903834
Test plan