@@ -65,3 +65,31 @@ The following things are tested
65
65
| var | Yes | Yes | Yes | Yes | | |
66
66
67
67
[ ^ 1 ] : ` sum ` and ` prod ` have special type promotion rules.
68
+
69
+ ## Additional Planned Features
70
+
71
+ In addition to getting full coverage of the spec, there are some additional
72
+ features and improvements for the test suite that are planned. Work on these features
73
+ will be guided primarily by concrete needs from library implementers, so if
74
+ you are someone using this test suite to test your library, please [ let us
75
+ know] ( https://github.com/data-apis/array-api-tests/issues ) the limitations you
76
+ come across.
77
+
78
+ - Making the test suite more usable for partially conforming libraries. Many
79
+ tests rely on various functions in the array library to function. This means
80
+ that if certain functions aren't implemented, for example, ` asarray() ` or
81
+ ` equals() ` , then many tests will not function at all. We want to improve
82
+ this situation, so that tests that don't strictly require these functions can
83
+ still be run.
84
+
85
+ - Better reporting. The pytest output can be difficult to parse, especially
86
+ when there are many failures. Additionally some error messages can be
87
+ difficult to understand without prior knowledge of the test internals.
88
+ Better reporting can also make it easier to compare different
89
+ implementations by their conformance.
90
+
91
+ - Better tests for numerical outputs. Right now numerical outputs are either
92
+ not tested at all, or only tested against very rough epsilons. This is
93
+ partly due to the fact that the spec does not mandate any level of precision
94
+ for most functions. However, it may be useful to, for instance, give a
95
+ report of how off a given function is from the "expected" exact output.
0 commit comments