Tests #1296
Triggered via merge group
February 28, 2025 22:35
jmalone-tt
Status
Failure
Total duration
6h 23m 45s
Artifacts
22
before_merge.yaml
on: merge_group
Matrix: lowering-tests
tools-tests
24s
Matrix: model-tests
collect-model-artifacts-from-matrix-jobs
0s
gen-and-test-model-accuracy
0s
Matrix: model-autogen-op-tests
collect-op-artifacts-from-matrix-jobs
0s
validate-pr
1s
Annotations
33 errors, 1 warning, and 68 notices
|
model-tests (26)
Process completed with exit code 1.
|
|
model-tests (25)
The job was canceled because "_26" failed.
|
|
model-tests (28)
The job was canceled because "_26" failed.
|
|
model-tests (29)
The job was canceled because "_26" failed.
|
|
model-tests (24)
The job was canceled because "_26" failed.
|
|
model-tests (30)
The job was canceled because "_26" failed.
|
|
model-tests (31)
The job was canceled because "_26" failed.
|
|
model-tests (34)
The job was canceled because "_26" failed.
|
|
model-tests (3)
The job was canceled because "_26" failed.
|
|
model-tests (32)
The job was canceled because "_26" failed.
|
|
model-tests (35)
The job was canceled because "_26" failed.
|
|
model-tests (38)
The job was canceled because "_26" failed.
|
|
model-tests (40)
The job was canceled because "_26" failed.
|
|
model-tests (36)
The job was canceled because "_26" failed.
|
|
model-tests (33)
The job was canceled because "_26" failed.
|
|
model-tests (37)
The job was canceled because "_26" failed.
|
|
model-tests (39)
The job was canceled because "_26" failed.
|
|
model-tests (4)
The job was canceled because "_26" failed.
|
|
model-tests (5)
The job was canceled because "_26" failed.
|
|
model-tests (6)
The job was canceled because "_26" failed.
|
|
model-tests (8)
The job was canceled because "_26" failed.
|
|
model-tests (9)
The job was canceled because "_26" failed.
|
|
model-tests (7)
The job was canceled because "_26" failed.
|
|
model-tests (27)
The job was canceled because "_26" failed.
|
|
model-tests (27)
A task was canceled.
|
|
model-tests (23)
The job was canceled because "_26" failed.
|
|
model-tests (16)
The job was canceled because "_26" failed.
|
|
pcie-cards-are-being-used-cleanup
This can happen if a test hung and is normally an issue with the test, rather than infra. Tenstorrent cards seem to be in use. Killing PIDs and exiting unsuccessfully.
|
|
model-tests (16)
Process completed with exit code 1.
|
|
model-tests (21)
The job was canceled because "_26" failed.
|
|
model-tests (20)
The job was canceled because "_26" failed.
|
|
model-tests (22)
The job was canceled because "_26" failed.
|
|
validate-pr
Process completed with exit code 1.
|
|
model-tests (22)
Runner tt-metal-pytorch-vm-n300-5 did not respond to a cancelation request with 00:05:00.
|
|
disk-usage-before-startup
Disk usage is 20 %
|
|
disk-usage-after-startup
Disk usage is 20 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 38 %
|
|
disk-usage-after-startup
Disk usage is 38 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 19 %
|
|
disk-usage-after-startup
Disk usage is 19 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 38 %
|
|
disk-usage-after-startup
Disk usage is 38 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 38 %
|
|
disk-usage-after-startup
Disk usage is 38 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 20 %
|
|
disk-usage-after-startup
Disk usage is 20 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 39 %
|
|
disk-usage-after-startup
Disk usage is 39 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 27 %
|
|
disk-usage-after-startup
Disk usage is 27 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 26 %
|
|
disk-usage-after-startup
Disk usage is 26 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 20 %
|
|
disk-usage-after-startup
Disk usage is 20 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 20 %
|
|
disk-usage-after-startup
Disk usage is 20 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 20 %
|
|
disk-usage-after-startup
Disk usage is 20 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 19 %
|
|
disk-usage-after-startup
Disk usage is 19 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 39 %
|
|
disk-usage-after-startup
Disk usage is 39 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 20 %
|
|
disk-usage-after-startup
Disk usage is 20 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 19 %
|
|
disk-usage-after-startup
Disk usage is 19 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
|
disk-usage-before-startup
Disk usage is 20 %
|
|
disk-usage-after-startup
Disk usage is 20 %
|
|
printing-smi-info-startup
Touching and printing out SMI info
|
|
reset-successful-startup
tt-smi reset was successful
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
model-accuracy-tests-group-1
|
117 MB |
|
|
model-accuracy-tests-group-10
|
206 MB |
|
|
model-accuracy-tests-group-11
|
14.1 MB |
|
|
model-accuracy-tests-group-12
|
10.2 MB |
|
|
model-accuracy-tests-group-13
|
342 MB |
|
|
model-accuracy-tests-group-14
|
414 MB |
|
|
model-accuracy-tests-group-15
|
148 MB |
|
|
model-accuracy-tests-group-17
|
34.5 MB |
|
|
model-accuracy-tests-group-18
|
93.1 MB |
|
|
model-accuracy-tests-group-19
|
177 MB |
|
|
model-accuracy-tests-group-2
|
325 MB |
|
|
model-tests-metrics-group-1
|
24.2 KB |
|
|
model-tests-metrics-group-10
|
13.8 KB |
|
|
model-tests-metrics-group-11
|
16.8 KB |
|
|
model-tests-metrics-group-12
|
20.9 KB |
|
|
model-tests-metrics-group-13
|
24.7 KB |
|
|
model-tests-metrics-group-14
|
38.9 KB |
|
|
model-tests-metrics-group-15
|
7.13 KB |
|
|
model-tests-metrics-group-17
|
42 KB |
|
|
model-tests-metrics-group-18
|
80.5 KB |
|
|
model-tests-metrics-group-19
|
33.7 KB |
|
|
model-tests-metrics-group-2
|
19.6 KB |
|