When updating nydus to 2.2.3 and nydus-snapshotter to 0.12.0, some work will be needed on dragonball side as the nydus tests are failing there with the following error:
09:55:09 INFO: Running nydus test
09:55:09 bash -f integration/nydus/nydus_tests.sh
09:55:09 Running setup
09:55:09 Download tarball from https://github.com/dragonflyoss/image-service/releases/download/v2.2.3/nydus-static-v2.2.3-linux-amd64.tgz
09:55:10 Download tarball from https://github.com/containerd/nydus-snapshotter/releases/download/v0.12.0/nydus-snapshotter-v0.12.0-x86_64.tgz
09:55:11 Enabling all debug options in file /etc/kata-containers/configuration.toml
09:55:11 [debug]
09:55:11 level = "debug"
09:55:11 [proxy_plugins]
09:55:11 [proxy_plugins.nydus]
09:55:11 type = "snapshot"
09:55:11 address = "/run/containerd-nydus/containerd-nydus-grpc.sock"
09:55:11 [plugins]
09:55:11 [plugins.cri]
09:55:11 disable_hugetlb_controller = false
09:55:11 [plugins.cri.containerd]
09:55:11 snapshotter = "nydus"
09:55:11 disable_snapshot_annotations = false
09:55:11 [plugins.cri.containerd.runtimes]
09:55:11 [plugins.cri.containerd.runtimes.runc]
09:55:11 runtime_type = "io.containerd.runc.v2"
09:55:11 [plugins.cri.containerd.runtimes.runc.options]
09:55:11 BinaryName = "/usr/local/sbin/runc"
09:55:11 Root = ""
09:55:11 [plugins.cri.containerd.runtimes.kata]
09:55:11 runtime_type = "io.containerd.kata.v2"
09:55:11 privileged_without_host_devices = true
09:55:11 INFO: restart containerd service
09:55:12 nydus-snapshotter is running
09:55:12 Running nydus integration tests
09:55:13 Image is up to date for sha256:dcac4621b8636ac822ab7737648a272fcf378b8df6d315816036f00d5536d1e2
09:55:15 Pod 47232412d47a6af55dff6659a287aef9e625ba417f6aa690b96254c3dac4ec18 created
09:55:16 Container 95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67 created
09:55:16 time="2023-09-18T07:55:16Z" level=fatal msg="starting the container \"95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67\": rpc error: code = Unknown desc = failed to create containerd task: failed to create shim task: Others(\"failed to handler message create container\\n\\nCaused by:\\n 0: create\\n 1: handler rootfs\\n 2: new nydus rootfs\\n 3: failed to do rafs mount\\n 4: fail to attach rafs \\\"/var/lib/containerd-nydus/snapshots/2/fs/image/image.boot\\\"\\n 5: add share fs mount\\n 6: Mount rafs at /rafs/95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67/rootfs_lower error: Failed to Mount backend Some(\\\"rafs\\\") at /rafs/95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67/rootfs_lower mount config FsMountConfigInfo { ops: \\\"mount\\\", fstype: Some(\\\"rafs\\\"), source: Some(\\\"/var/lib/containerd-nydus/snapshots/2/fs/image/image.boot\\\"), mountpoint: \\\"/rafs/95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67/rootfs_lower\\\", config: Some(\\\"{\\\\\\\"device\\\\\\\":{\\\\\\\"backend\\\\\\\":{\\\\\\\"type\\\\\\\":\\\\\\\"registry\\\\\\\",\\\\\\\"config\\\\\\\":{\\\\\\\"readahead\\\\\\\":false,\\\\\\\"host\\\\\\\":\\\\\\\"ghcr.io\\\\\\\",\\\\\\\"repo\\\\\\\":\\\\\\\"dragonflyoss/image-service/alpine\\\\\\\",\\\\\\\"proxy\\\\\\\":{\\\\\\\"fallback\\\\\\\":false},\\\\\\\"timeout\\\\\\\":5,\\\\\\\"connect_timeout\\\\\\\":5,\\\\\\\"retry_limit\\\\\\\":2}},\\\\\\\"cache\\\\\\\":{\\\\\\\"type\\\\\\\":\\\\\\\"blobcache\\\\\\\",\\\\\\\"config\\\\\\\":{\\\\\\\"work_dir\\\\\\\":\\\\\\\"/var/lib/containerd-nydus/cache\\\\\\\",\\\\\\\"disable_indexed_map\\\\\\\":false}}},\\\\\\\"mode\\\\\\\":\\\\\\\"direct\\\\\\\",\\\\\\\"digest_validate\\\\\\\":false,\\\\\\\"enable_xattr\\\\\\\":true,\\\\\\\"fs_prefetch\\\\\\\":{\\\\\\\"enable\\\\\\\":true,\\\\\\\"prefetch_all\\\\\\\":true,\\\\\\\"threads_count\\\\\\\":8,\\\\\\\"merging_size\\\\\\\":1048576,\\\\\\\"bandwidth_rate\\\\\\\":0}}\\\"), tag: \\\"kataShared\\\", prefetch_list_path: None, dax_threshold_size_kb: None }\\n \\n Caused by:\\n vmm action error: FsDevice(AttachBackendFailed(\\\"attach/detach a backend filesystem failed:: missing field `version` at line 1 column 489\\\"))\"): unknown"
09:55:16 [nydus_tests.sh:164] ERROR: sudo -E crictl start 95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67
09:55:16 Running teardown
09:55:16 integration/nydus/nydus_tests.sh: line 189: 29579 Killed nohup /usr/local/bin/containerd-nydus-grpc --config /etc/snapshotter-config.toml --nydusd-config /etc/nydusd-config.json --log-to-stdout > /dev/null 2>&1
When updating nydus to 2.2.3 and nydus-snapshotter to 0.12.0, some work will be needed on dragonball side as the nydus tests are failing there with the following error:
/cc @studychao @ChengyuZhu6