The Operation will be canceled. The next steps may not contain expected logs.

[tarekgh]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=696281

Build leg reported

Build / browser-wasm linux Release LibraryTests / Send to Helix

Pull Request

dotnet/runtime#103009

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The Operation will be canceled. The next steps may not contain expected logs.",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=696281
Error message validated: [The Operation will be canceled. The next steps may not contain expected logs.]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 6/4/2024 8:08:48 PM UTC

Report

Build	Repository	Step Name	Console log	Pull Request
1554880	dotnet/runtime	Send to Helix	Log
1554878	dotnet/aspnetcore	Run Quarantined Tests	Log
1554851	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132367
1554847	dotnet/runtime	Send to Helix	Log	dotnet/runtime#130723
1554842	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132375
1554815	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132358
1554809	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132245
1554717	dotnet/runtime	Send to Helix	Log
1554696	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132367
1554620	dotnet/aspnetcore	Run Quarantined Tests	Log
1554587	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132362
1554582	dotnet/maui	Controls Layout	Log
1554548	dotnet/maui	Controls Border,BoxView,Brush,Button	Log
1554514	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132096
1554486	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132358
1554509	dotnet/maui	Controls Shell	Log
1554500	dotnet/maui	Controls (vlatest) Entry	Log	dotnet/maui#37404
1554496	dotnet/maui	Controls Border,BoxView,Brush,Button	Log
1554472	dotnet/runtime	Send to Helix	Log	dotnet/runtime#131265
1554468	dotnet/runtime	Send to Helix	Log	dotnet/runtime#129806
1554435	dotnet/aspnetcore	Run Quarantined Tests	Log
1554285	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132353
1554258	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#129220
1554278	dotnet/runtime	Send to Helix	Log
1554194	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#131507
1554269	dotnet/aspnetcore	Run Quarantined Tests	Log
1554246	dotnet/maui	Controls (v18.5) Shadow	Log
1554225	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132347
1554239	dotnet/aspnetcore	Run Quarantined Tests	Log
1554206	dotnet/runtime	Send tests to Helix (Windows)	Log	dotnet/runtime#131510
1554208	dotnet/runtime	Send tests to Helix (Windows)	Log	dotnet/runtime#131509
1554210	dotnet/runtime	Send tests to Helix (Windows)	Log	dotnet/runtime#132346
1554097	dotnet/runtime	Send to Helix	Log
1554076	dotnet/sdk	🟣 Build	Log	dotnet/sdk#55785
1553914	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132326
1553863	dotnet/runtime	Build product	Log	dotnet/runtime#132319
1553745	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#132098
1553795	dotnet/maui	Controls Layout	Log	dotnet/maui#37438
1553731	dotnet/aspnetcore	Run Quarantined Tests	Log
1553489	dotnet/runtime	Send to Helix	Log	dotnet/runtime#129853
1553650	dotnet/sdk	Run TestBuild Tests	Log	dotnet/sdk#55783
1553504	dotnet/aspnetcore	Run Quarantined Tests	Log
1553310	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#130859
1553382	dotnet/maui	Controls Layout	Log	dotnet/maui#37182
1553358	dotnet/maui	Controls (v18.5) CarouselView	Log
1553213	dotnet/maui	Controls CollectionView	Log	dotnet/maui#37307
1553156	dotnet/runtime	Send to Helix	Log	dotnet/runtime#129853
1553185	dotnet/maui	Controls Shell	Log	dotnet/maui#37397
1553146	dotnet/runtime	Send to Helix	Log	dotnet/runtime#123920
1553173	dotnet/maui	Controls Layout	Log	dotnet/maui#37176
1553131	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132245
1553134	dotnet/aspnetcore	Run Quarantined Tests	Log
1553129	dotnet/roslyn	Run Unit Tests	Log
1553066	dotnet/sdk	Run AoT Tests	Log	dotnet/sdk#55739
1553010	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#132245
1552964	dotnet/maui	Controls Shell	Log
1552769	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#132197
1552812	dotnet/maui	Controls Layout	Log
1552837	dotnet/maui	Controls Shell	Log
1552851	dotnet/runtime	Build product	Log	dotnet/runtime#123920
1552604	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#132286
1550827	dotnet/runtime	Build native test components	Log	dotnet/runtime#128675
1552539	dotnet/maui	Controls CollectionView	Log
1552304	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#132234
1552405	dotnet/aspnetcore	Run Quarantined Tests	Log
1552284	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#131552
1552562	dotnet/roslyn-sdk	CmdLine	Log	dotnet/roslyn-sdk#1274
1552384	dotnet/maui	Controls CollectionView	Log
1552244	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#131538
1552235	dotnet/maui	Controls Page,Performance,Picker,ProgressBar	Log
1552114	dotnet/runtime	Send to Helix	Log
1552373	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132284
1552372	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132282
1552215	dotnet/maui	Controls Shell	Log	dotnet/maui#37405
1552414	dotnet/roslyn	Run Unit Tests	Log
1551891	dotnet/maui	Controls Border,BoxView,Brush,Button	Log	dotnet/maui#37393
1552121	dotnet/maui	Controls Shell	Log	dotnet/maui#37034
1552100	dotnet/maui	Controls CarouselView	Log
1552099	dotnet/maui	Controls SearchBar,Shape,Slider	Log
1552101	dotnet/maui	Controls TabbedPage,TableView,TimePicker,TitleView,ToolbarItem,Triggers	Log
1551997	dotnet/runtime	Send tests to Helix (Unix)	Log
1552139	dotnet/runtime	Send tests to Helix (Unix)	Log
1552086	dotnet/maui	Controls Border,BoxView,Brush,Button	Log
1552102	dotnet/maui	Use .NET SDK 10.0.100	Log
1552070	dotnet/maui	Controls Border,BoxView,Brush,Button	Log
1551875	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132270
1552008	dotnet/maui	Controls Shell	Log
1549740	dotnet/maui	Controls CollectionView	Log	dotnet/maui#37307
1551572	dotnet/runtime	Send to Helix	Log
1551897	dotnet/runtime	Send to Helix	Log
1551663	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#132214
1551775	dotnet/maui	Controls Shell	Log	dotnet/maui#37382
1551570	dotnet/runtime	Send to Helix	Log
1551777	dotnet/maui	Controls Shell	Log	dotnet/maui#36907
1551774	dotnet/maui	Controls CollectionView	Log	dotnet/maui#37111
1551678	dotnet/maui	Controls Image,ImageButton,IndicatorView,InputTransparent,IsEnabled,IsVisible	Log
1551696	dotnet/maui	Controls Shell	Log	dotnet/maui#37365
1548230	dotnet/maui	Controls Shell	Log
1551485	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#132007
1551468	dotnet/runtime	Send to Helix	Log	dotnet/runtime#129853
Displaying 100 of 1623 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
9	284	1623

[dkurepa]

These appear to be timeout cancellations, and most of them are happening on the same runtime leg that uses OSX.1200.ARM64.Open, looking at grafana, they do indeed appear to be quite high. Will check with the team on what we can do about this

[dkurepa]

For pipelines experiencing timeouts on osx.1200.arm64.open we recommend using osx.14.arm64.open, as this queue has a lot more machines

[dkurepa]

There is also a number of Publish Using Darc timeouts, these are in 99% of cases AzDo Api issues. During the Publish Using Darc job, we queue up a Maestro Promotion pipeline, that downloads the artifacts from the build calling it, and publishes them where they need to go. While publishing is happening, the build pipeline keeps busy waiting for the promotion pipeline to be done, checking the status of it every 60 seconds. In cases where this times out, the build most likely did get promoted, the AzDo API just kept telling us the wrong thing

[ivanpovazan]

@dkurepa for context, the same timeouts are also caught with this tracking #1883
where I asked about potentially bumping the queues to osx.13.amd/arm64, would that suffice?
(bumping to osx.14 is not an option right now as we still want testing on osx.13 which is the minimum supported OS version)

[CarnaViire]

For the "known issues" folks: the timeout here is reported twice, making BA red despite the tracking issue. E.g.:

1️⃣ dotnet/runtime#117255

2️⃣ dotnet/runtime#117800

cc @AlitzelMendez