https://docs.openvino.ai/2024/openvino-workflow/running-inference/inference-devices-and-modes/auto-device-selection.html The time to compile the model and perform the first inference) is reduced when using AUTO: 