Skip to content

Commit 7ee6125

Browse files
ayerofieiev-ttactions-user
ayerofieiev-tt
and
actions-user
authored
Update models and ops report (#656)
* Update README.md * [auto][on-merge-queue] Update metrics report in README.md --------- Co-authored-by: GitHub Actions <[email protected]>
1 parent 8071824 commit 7ee6125

File tree

191 files changed

+9563
-9563
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

191 files changed

+9563
-9563
lines changed

‎README.md

Lines changed: 155 additions & 155 deletions
Large diffs are not rendered by default.

‎docs/OperationsReport.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@
3232
| 28 | [aten.clamp_min.default](operations/aten.clamp_min.default.md) | 9 | 0 | 0 | 0 | ✘ | 0 |
3333
| 29 | [aten.clone.default](operations/aten.clone.default.md) | 433 | 305 | 0 | 0 | 🚧 | 0.7 |
3434
| 30 | [aten.constant_pad_nd.default](operations/aten.constant_pad_nd.default.md) | 66 | 36 | 0 | 0 | 🚧 | 0.55 |
35-
| 31 | [aten.convolution.default](operations/aten.convolution.default.md) | 1552 | 1299 | 0 | 0 | 🚧 | 0.84 |
35+
| 31 | [aten.convolution.default](operations/aten.convolution.default.md) | 1552 | 1319 | 0 | 0 | 🚧 | 0.85 |
3636
| 32 | [aten.convolution_backward.default](operations/aten.convolution_backward.default.md) | 570 | 0 | 0 | 0 | ✘ | 0 |
3737
| 33 | [aten.copy.default](operations/aten.copy.default.md) | 12 | 0 | 0 | 0 | ✘ | 0 |
3838
| 34 | [aten.cos.default](operations/aten.cos.default.md) | 3 | 2 | 0 | 0 | 🚧 | 0.67 |
@@ -132,5 +132,5 @@
132132
| 128 | [aten.view.default](operations/aten.view.default.md) | 1268 | 893 | 0 | 0 | 🚧 | 0.7 |
133133
| 129 | [aten.where.self](operations/aten.where.self.md) | 13 | 0 | 0 | 0 | ✘ | 0 |
134134
| 130 | [aten.zeros.default](operations/aten.zeros.default.md) | 47 | 34 | 0 | 0 | 🚧 | 0.72 |
135-
| 131 | [aten.zeros_like.default](operations/aten.zeros_like.default.md) | 7 | 0 | 0 | 0 | ✘ | 0 |
135+
| 131 | [aten.zeros_like.default](operations/aten.zeros_like.default.md) | 7 | 2 | 0 | 0 | 🚧 | 0.29 |
136136

‎docs/models/Autoencoder (conv)-train/input_variations.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -12,10 +12,10 @@
1212
### aten.convolution.default
1313
| | ATen Input Variations | Status | Isolated | PCC | Host |
1414
|---:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------|:-----------|---------:|-------:|
15-
| 0 | Tensor<[1, 1, 28, 28]> input = ?,<br>Tensor<[16, 1, 3, 3]> weight = ?,<br>Optional[Tensor]<[16]> bias = ?,<br>List[int] stride = [1, 1],<br>List[int] padding = [1, 1],<br>List[int] dilation = [1, 1],<br>bool transposed = False,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999984 | 6 |
16-
| 1 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[16, 1, 2, 2]> weight = ?,<br>Optional[Tensor]<[1]> bias = ?,<br>List[int] stride = [2, 2],<br>List[int] padding = [0, 0],<br>List[int] dilation = [1, 1],<br>bool transposed = True,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999994 | 6 |
17-
| 2 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[4, 16, 3, 3]> weight = ?,<br>Optional[Tensor]<[4]> bias = ?,<br>List[int] stride = [1, 1],<br>List[int] padding = [1, 1],<br>List[int] dilation = [1, 1],<br>bool transposed = False,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999977 | 6 |
18-
| 3 | Tensor<[1, 4, 7, 7]> input = ?,<br>Tensor<[4, 16, 2, 2]> weight = ?,<br>Optional[Tensor]<[16]> bias = ?,<br>List[int] stride = [2, 2],<br>List[int] padding = [0, 0],<br>List[int] dilation = [1, 1],<br>bool transposed = True,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999993 | 6 |
15+
| 0 | Tensor<[1, 1, 28, 28]> input = ?,<br>Tensor<[16, 1, 3, 3]> weight = ?,<br>Optional[Tensor]<[16]> bias = ?,<br>List[int] stride = [1, 1],<br>List[int] padding = [1, 1],<br>List[int] dilation = [1, 1],<br>bool transposed = False,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999985 | 6 |
16+
| 1 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[16, 1, 2, 2]> weight = ?,<br>Optional[Tensor]<[1]> bias = ?,<br>List[int] stride = [2, 2],<br>List[int] padding = [0, 0],<br>List[int] dilation = [1, 1],<br>bool transposed = True,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999992 | 6 |
17+
| 2 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[4, 16, 3, 3]> weight = ?,<br>Optional[Tensor]<[4]> bias = ?,<br>List[int] stride = [1, 1],<br>List[int] padding = [1, 1],<br>List[int] dilation = [1, 1],<br>bool transposed = False,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.99998 | 6 |
18+
| 3 | Tensor<[1, 4, 7, 7]> input = ?,<br>Tensor<[4, 16, 2, 2]> weight = ?,<br>Optional[Tensor]<[16]> bias = ?,<br>List[int] stride = [2, 2],<br>List[int] padding = [0, 0],<br>List[int] dilation = [1, 1],<br>bool transposed = True,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999994 | 6 |
1919
### aten.convolution_backward.default
2020
| | ATen Input Variations | Status | Isolated | PCC | Host |
2121
|---:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------|:-----------|------:|-------:|

‎docs/models/Autoencoder (conv)/input_variations.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -9,8 +9,8 @@
99
| | ATen Input Variations | Status | Isolated | PCC | Host |
1010
|---:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------|:-----------|---------:|-------:|
1111
| 0 | Tensor<[1, 1, 28, 28]> input = ?,<br>Tensor<[16, 1, 3, 3]> weight = ?,<br>Optional[Tensor]<[16]> bias = ?,<br>List[int] stride = [1, 1],<br>List[int] padding = [1, 1],<br>List[int] dilation = [1, 1],<br>bool transposed = False,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999983 | 6 |
12-
| 1 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[16, 1, 2, 2]> weight = ?,<br>Optional[Tensor]<[1]> bias = ?,<br>List[int] stride = [2, 2],<br>List[int] padding = [0, 0],<br>List[int] dilation = [1, 1],<br>bool transposed = True,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999994 | 6 |
13-
| 2 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[4, 16, 3, 3]> weight = ?,<br>Optional[Tensor]<[4]> bias = ?,<br>List[int] stride = [1, 1],<br>List[int] padding = [1, 1],<br>List[int] dilation = [1, 1],<br>bool transposed = False,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999981 | 6 |
12+
| 1 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[16, 1, 2, 2]> weight = ?,<br>Optional[Tensor]<[1]> bias = ?,<br>List[int] stride = [2, 2],<br>List[int] padding = [0, 0],<br>List[int] dilation = [1, 1],<br>bool transposed = True,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999992 | 6 |
13+
| 2 | Tensor<[1, 16, 14, 14]> input = ?,<br>Tensor<[4, 16, 3, 3]> weight = ?,<br>Optional[Tensor]<[4]> bias = ?,<br>List[int] stride = [1, 1],<br>List[int] padding = [1, 1],<br>List[int] dilation = [1, 1],<br>bool transposed = False,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.99998 | 6 |
1414
| 3 | Tensor<[1, 4, 7, 7]> input = ?,<br>Tensor<[4, 16, 2, 2]> weight = ?,<br>Optional[Tensor]<[16]> bias = ?,<br>List[int] stride = [2, 2],<br>List[int] padding = [0, 0],<br>List[int] dilation = [1, 1],<br>bool transposed = True,<br>List[int] output_padding = [0, 0],<br>int groups = 1 | Done | Done | 0.999994 | 6 |
1515
### aten.max_pool2d_with_indices.default
1616
| | ATen Input Variations | Status | Isolated | PCC | Host |

‎docs/models/Autoencoder (linear)-train/input_variations.md

Lines changed: 18 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -14,13 +14,13 @@
1414
| | ATen Input Variations | Status | Isolated | PCC | Host |
1515
|---:|:-------------------------------------------------------------------------------------|:---------|:-----------|---------:|-------:|
1616
| 0 | Tensor<[128]> self = ?,<br>Tensor<[1, 64]> mat1 = ?,<br>Tensor<[64, 128]> mat2 = ? | Done | Done | 0.999991 | 0 |
17-
| 1 | Tensor<[128]> self = ?,<br>Tensor<[1, 784]> mat1 = ?,<br>Tensor<[784, 128]> mat2 = ? | Done | Done | 0.99987 | 0 |
18-
| 2 | Tensor<[12]> self = ?,<br>Tensor<[1, 3]> mat1 = ?,<br>Tensor<[3, 12]> mat2 = ? | Done | Done | 0.999989 | 0 |
19-
| 3 | Tensor<[12]> self = ?,<br>Tensor<[1, 64]> mat1 = ?,<br>Tensor<[64, 12]> mat2 = ? | Done | Done | 0.999985 | 0 |
20-
| 4 | Tensor<[3]> self = ?,<br>Tensor<[1, 12]> mat1 = ?,<br>Tensor<[12, 3]> mat2 = ? | Done | Done | 0.999999 | 0 |
21-
| 5 | Tensor<[64]> self = ?,<br>Tensor<[1, 128]> mat1 = ?,<br>Tensor<[128, 64]> mat2 = ? | Done | Done | 0.999977 | 0 |
17+
| 1 | Tensor<[128]> self = ?,<br>Tensor<[1, 784]> mat1 = ?,<br>Tensor<[784, 128]> mat2 = ? | Done | Done | 0.999878 | 0 |
18+
| 2 | Tensor<[12]> self = ?,<br>Tensor<[1, 3]> mat1 = ?,<br>Tensor<[3, 12]> mat2 = ? | Done | Done | 0.999992 | 0 |
19+
| 3 | Tensor<[12]> self = ?,<br>Tensor<[1, 64]> mat1 = ?,<br>Tensor<[64, 12]> mat2 = ? | Done | Done | 0.999993 | 0 |
20+
| 4 | Tensor<[3]> self = ?,<br>Tensor<[1, 12]> mat1 = ?,<br>Tensor<[12, 3]> mat2 = ? | Done | Done | 1 | 0 |
21+
| 5 | Tensor<[64]> self = ?,<br>Tensor<[1, 128]> mat1 = ?,<br>Tensor<[128, 64]> mat2 = ? | Done | Done | 0.99997 | 0 |
2222
| 6 | Tensor<[64]> self = ?,<br>Tensor<[1, 12]> mat1 = ?,<br>Tensor<[12, 64]> mat2 = ? | Done | Done | 0.999995 | 0 |
23-
| 7 | Tensor<[784]> self = ?,<br>Tensor<[1, 128]> mat1 = ?,<br>Tensor<[128, 784]> mat2 = ? | Done | Done | 0.99998 | 0 |
23+
| 7 | Tensor<[784]> self = ?,<br>Tensor<[1, 128]> mat1 = ?,<br>Tensor<[128, 784]> mat2 = ? | Done | Done | 0.999979 | 0 |
2424
### aten.detach.default
2525
| | ATen Input Variations | Status | Isolated | PCC | Host |
2626
|---:|:--------------------------|:---------|:-----------|------:|-------:|
@@ -30,22 +30,22 @@
3030
### aten.mm.default
3131
| | ATen Input Variations | Status | Isolated | PCC | Host |
3232
|---:|:----------------------------------------------------------|:---------|:-----------|---------:|-------:|
33-
| 0 | Tensor<[1, 128]> self = ?,<br>Tensor<[128, 64]> mat2 = ? | Done | Done | 0.999983 | 0 |
34-
| 1 | Tensor<[1, 128]> self = ?,<br>Tensor<[128, 784]> mat2 = ? | Done | Done | 0.999983 | 0 |
35-
| 2 | Tensor<[1, 12]> self = ?,<br>Tensor<[12, 3]> mat2 = ? | Done | Done | 0.999999 | 0 |
36-
| 3 | Tensor<[1, 12]> self = ?,<br>Tensor<[12, 64]> mat2 = ? | Done | Done | 0.999998 | 0 |
37-
| 4 | Tensor<[1, 3]> self = ?,<br>Tensor<[3, 12]> mat2 = ? | Done | Done | 1 | 0 |
33+
| 0 | Tensor<[1, 128]> self = ?,<br>Tensor<[128, 64]> mat2 = ? | Done | Done | 0.999978 | 0 |
34+
| 1 | Tensor<[1, 128]> self = ?,<br>Tensor<[128, 784]> mat2 = ? | Done | Done | 0.999981 | 0 |
35+
| 2 | Tensor<[1, 12]> self = ?,<br>Tensor<[12, 3]> mat2 = ? | Done | Done | 1 | 0 |
36+
| 3 | Tensor<[1, 12]> self = ?,<br>Tensor<[12, 64]> mat2 = ? | Done | Done | 0.999992 | 0 |
37+
| 4 | Tensor<[1, 3]> self = ?,<br>Tensor<[3, 12]> mat2 = ? | Done | Done | 0.999989 | 0 |
3838
| 5 | Tensor<[1, 64]> self = ?,<br>Tensor<[64, 128]> mat2 = ? | Done | Done | 0.999986 | 0 |
3939
| 6 | Tensor<[1, 64]> self = ?,<br>Tensor<[64, 12]> mat2 = ? | Done | Done | 0.999992 | 0 |
40-
| 7 | Tensor<[1, 784]> self = ?,<br>Tensor<[784, 128]> mat2 = ? | Done | Done | 0.999881 | 0 |
41-
| 8 | Tensor<[12, 1]> self = ?,<br>Tensor<[1, 3]> mat2 = ? | Done | Done | 0.999999 | 0 |
42-
| 9 | Tensor<[12, 1]> self = ?,<br>Tensor<[1, 64]> mat2 = ? | Done | Done | 0.999995 | 0 |
43-
| 10 | Tensor<[128, 1]> self = ?,<br>Tensor<[1, 64]> mat2 = ? | Done | Done | 0.999997 | 0 |
40+
| 7 | Tensor<[1, 784]> self = ?,<br>Tensor<[784, 128]> mat2 = ? | Done | Done | 0.999855 | 0 |
41+
| 8 | Tensor<[12, 1]> self = ?,<br>Tensor<[1, 3]> mat2 = ? | Done | Done | 0.999996 | 0 |
42+
| 9 | Tensor<[12, 1]> self = ?,<br>Tensor<[1, 64]> mat2 = ? | Done | Done | 0.999996 | 0 |
43+
| 10 | Tensor<[128, 1]> self = ?,<br>Tensor<[1, 64]> mat2 = ? | Done | Done | 0.999996 | 0 |
4444
| 11 | Tensor<[128, 1]> self = ?,<br>Tensor<[1, 784]> mat2 = ? | Done | Done | 0.999996 | 0 |
45-
| 12 | Tensor<[3, 1]> self = ?,<br>Tensor<[1, 12]> mat2 = ? | Done | Done | 0.999998 | 0 |
45+
| 12 | Tensor<[3, 1]> self = ?,<br>Tensor<[1, 12]> mat2 = ? | Done | Done | 0.999992 | 0 |
4646
| 13 | Tensor<[64, 1]> self = ?,<br>Tensor<[1, 128]> mat2 = ? | Done | Done | 0.999996 | 0 |
47-
| 14 | Tensor<[64, 1]> self = ?,<br>Tensor<[1, 12]> mat2 = ? | Done | Done | 0.999998 | 0 |
48-
| 15 | Tensor<[784, 1]> self = ?,<br>Tensor<[1, 128]> mat2 = ? | Done | Done | 0.999996 | 0 |
47+
| 14 | Tensor<[64, 1]> self = ?,<br>Tensor<[1, 12]> mat2 = ? | Done | Done | 0.999994 | 0 |
48+
| 15 | Tensor<[784, 1]> self = ?,<br>Tensor<[1, 128]> mat2 = ? | Done | Done | 0.999995 | 0 |
4949
### aten.relu.default
5050
| | ATen Input Variations | Status | Isolated | PCC | Host |
5151
|---:|:--------------------------|:---------|:-----------|------:|-------:|

‎docs/models/Autoencoder (linear)/input_variations.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -8,12 +8,12 @@
88
### aten.addmm.default
99
| | ATen Input Variations | Status | Isolated | PCC | Host |
1010
|---:|:-------------------------------------------------------------------------------------|:---------|:-----------|---------:|-------:|
11-
| 0 | Tensor<[128]> self = ?,<br>Tensor<[1, 64]> mat1 = ?,<br>Tensor<[64, 128]> mat2 = ? | Done | Done | 0.999986 | 0 |
12-
| 1 | Tensor<[128]> self = ?,<br>Tensor<[1, 784]> mat1 = ?,<br>Tensor<[784, 128]> mat2 = ? | Done | Done | 0.999887 | 0 |
13-
| 2 | Tensor<[12]> self = ?,<br>Tensor<[1, 3]> mat1 = ?,<br>Tensor<[3, 12]> mat2 = ? | Done | Done | 0.999997 | 0 |
14-
| 3 | Tensor<[12]> self = ?,<br>Tensor<[1, 64]> mat1 = ?,<br>Tensor<[64, 12]> mat2 = ? | Done | Done | 0.999978 | 0 |
15-
| 4 | Tensor<[3]> self = ?,<br>Tensor<[1, 12]> mat1 = ?,<br>Tensor<[12, 3]> mat2 = ? | Done | Done | 0.999997 | 0 |
16-
| 5 | Tensor<[64]> self = ?,<br>Tensor<[1, 128]> mat1 = ?,<br>Tensor<[128, 64]> mat2 = ? | Done | Done | 0.999981 | 0 |
11+
| 0 | Tensor<[128]> self = ?,<br>Tensor<[1, 64]> mat1 = ?,<br>Tensor<[64, 128]> mat2 = ? | Done | Done | 0.99999 | 0 |
12+
| 1 | Tensor<[128]> self = ?,<br>Tensor<[1, 784]> mat1 = ?,<br>Tensor<[784, 128]> mat2 = ? | Done | Done | 0.999905 | 0 |
13+
| 2 | Tensor<[12]> self = ?,<br>Tensor<[1, 3]> mat1 = ?,<br>Tensor<[3, 12]> mat2 = ? | Done | Done | 0.999993 | 0 |
14+
| 3 | Tensor<[12]> self = ?,<br>Tensor<[1, 64]> mat1 = ?,<br>Tensor<[64, 12]> mat2 = ? | Done | Done | 0.999999 | 0 |
15+
| 4 | Tensor<[3]> self = ?,<br>Tensor<[1, 12]> mat1 = ?,<br>Tensor<[12, 3]> mat2 = ? | Done | Done | 0.999985 | 0 |
16+
| 5 | Tensor<[64]> self = ?,<br>Tensor<[1, 128]> mat1 = ?,<br>Tensor<[128, 64]> mat2 = ? | Done | Done | 0.999967 | 0 |
1717
| 6 | Tensor<[64]> self = ?,<br>Tensor<[1, 12]> mat1 = ?,<br>Tensor<[12, 64]> mat2 = ? | Done | Done | 0.999993 | 0 |
1818
| 7 | Tensor<[784]> self = ?,<br>Tensor<[1, 128]> mat1 = ?,<br>Tensor<[128, 784]> mat2 = ? | Done | Done | 0.999979 | 0 |
1919
### aten.relu.default

0 commit comments

Comments
 (0)