Test jobs not completing on test-macstadium-macos11-arm64-2 with ChannelClosedException

[smlambert]

Raising this to monitor it, in case it starts being a recurring problem.

Recent occurrences of test jobs failing with ChannelClosedException:

15:26:38  Cannot contact test-macstadium-macos11-arm64-2: hudson.remoting.ChannelClosedException: Channel "hudson.remoting.Channel@4dfa7683:test-macstadium-macos11-arm64-2": Remote call on test-macstadium-macos11-arm64-2 failed. The channel is closing down or has closed down
...
15:35:34  wrapper script does not seem to be touching the log file in /Users/jenkins/workspace/Test_openjdk11_hs_extended.system_aarch64_mac@tmp/durable-bcf35e03
15:35:34  (JENKINS-48300: if on an extremely laggy filesystem, consider -Dorg.jenkinsci.plugins.durabletask.BourneShellScript.HEARTBEAT_CHECK_INTERVAL=86400)

To make it easy for the infrastructure team to repeat and diagnose, please
answer the following questions:

• test suite/name (e.g, BUILD_LIST, TARGET, CUSTOM_TARGET)? not specific to test suite
• a link into recent Test_ job on https://ci.adoptium.net which showed the failure
  • https://ci.adoptium.net/job/Test_openjdk11_hs_extended.system_aarch64_mac/111
  • https://ci.adoptium.net/job/Test_openjdk11_hs_sanity.openjdk_aarch64_mac/112/
• Hyperlink to re-run in Grinder:
• Is there an existing issue elsewhere covering this?
• Which machine(s) does it work on?
• Which machine(s) does it fail on? test-macstadium-macos11-arm64-2

Any other details:
Maybe this is a two-off failure from the recent jdk11 2282 build pipeline, will keep monitoring to see if it recurs:
https://trss.adoptium.net/searchResult?buildId=63fe453317052c6715e8d8ee&searchText=ChannelClosedException

[adamfarley]

Issue continues to occur.

25th of June: https://ci.adoptium.net/job/Test_openjdk20_hs_extended.openjdk_aarch64_mac/41/ (Triaged.)
5th of August: https://ci.adoptium.net/job/Test_openjdk11_hs_extended.openjdk_aarch64_mac_testList_1/63 (Triaged.)

[sxa]

Needs testing on the orka and remaining static systems

[sxa]

We have no fixed aarch64 macs any more so only orka nodes are available:

• 10 iterations of jdk_util_0
• 100 iterations of jdk_util_0
• 10 iterations of LangLoadTest_5m_0
• 100 iterations of LangLoadTest_5m_0

All failed due to an orka node provisioning issue - leaving links above to allow future re-runs.