Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add third data quality metric #11939

Merged
merged 39 commits into from
Jan 30, 2025

Merge branch 'develop' into wip/mk/dq-metric

45fb321
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

Add third data quality metric #11939

Merge branch 'develop' into wip/mk/dq-metric
45fb321
Select commit
Loading
Failed to load commit list.
GitHub Actions / Standard Library Tests Report (GraalVM CE, linux, amd64) succeeded Jan 29, 2025 in 1s

10657 passed, 0 failed and 305 skipped

Tests passed successfully

Report Passed Failed Skipped Time
/runner/_work/enso/enso/target/test-results/AWS_Tests/JUnit.xml 108✅ 21⚪ 392s
/runner/_work/enso/enso/target/test-results/Base_Internal_Tests/JUnit.xml 35✅ 7s
/runner/_work/enso/enso/target/test-results/Base_Tests/JUnit.xml 3048✅ 46⚪ 402s
/runner/_work/enso/enso/target/test-results/Examples_Tests/JUnit.xml 34✅ 81s
/runner/_work/enso/enso/target/test-results/Geo_Tests/JUnit.xml 5✅ 521ms
/runner/_work/enso/enso/target/test-results/Image_Tests/JUnit.xml 174✅ 1⚪ 2s
/runner/_work/enso/enso/target/test-results/Microsoft_Tests/JUnit.xml 532✅ 51⚪ 41s
/runner/_work/enso/enso/target/test-results/Snowflake_Tests/JUnit.xml 1⚪ 0ms
/runner/_work/enso/enso/target/test-results/Table_Internal_Tests/JUnit.xml 1✅ 889ms
/runner/_work/enso/enso/target/test-results/Table_Tests/JUnit.xml 6616✅ 184⚪ 392s
/runner/_work/enso/enso/target/test-results/Tableau_Tests/JUnit.xml 13✅ 959ms
/runner/_work/enso/enso/target/test-results/Test_Tests/JUnit.xml 10✅ 589ms
/runner/_work/enso/enso/target/test-results/Visualization_Tests/JUnit.xml 81✅ 1⚪ 4s

✅ /runner/_work/enso/enso/target/test-results/AWS_Tests/JUnit.xml

129 tests were completed in 392s with 108 passed, 0 failed and 21 skipped.

Test suite Passed Failed Skipped Time
(Enso Cloud -> Enso Cloud) copying/moving 1⚪ 0ms
(Enso Cloud -> Enso Cloud) Data Link copying/moving 1⚪ 0ms
(Enso Cloud -> Local) copying/moving 1⚪ 0ms
(Enso Cloud -> Local) Data Link copying/moving 1⚪ 0ms
(Enso Cloud -> S3) copying/moving 1⚪ 0ms
(Enso Cloud -> S3) Data Link copying/moving 1⚪ 0ms
(Local -> Enso Cloud) copying/moving 1⚪ 0ms
(Local -> Enso Cloud) Data Link copying/moving 1⚪ 0ms
(Local -> Local) copying/moving 5✅ 275ms
(Local -> Local) Data Link copying/moving 3✅ 2s
(Local -> S3) copying/moving 5✅ 13s
(Local -> S3) Data Link copying/moving 3✅ 17s
(S3 -> Enso Cloud) copying/moving 1⚪ 0ms
(S3 -> Enso Cloud) Data Link copying/moving 1⚪ 0ms
(S3 -> Local) copying/moving 5✅ 13s
(S3 -> Local) Data Link copying/moving 3✅ 16s
(S3 -> S3) copying/moving 5✅ 21s
(S3 -> S3) Data Link copying/moving 3✅ 39s
(S3_File) Download Mode 3✅ 30s
[Redshift] Database tests 1⚪ 0ms
AWS_Credential 4✅ 7s
DataLinks to S3_File 13✅ 10⚪ 70s
S3 Path handling 7✅ 1s
S3_File reading 10✅ 17s
S3_File writing 21✅ 67s
S3.get_object 2✅ 15s
S3.head (bucket) 1✅ 9s
S3.head (object) 2✅ 8s
S3.list_buckets 4✅ 29s
S3.list_objects 4✅ 8s
S3.read_bucket 5✅ 9s

✅ /runner/_work/enso/enso/target/test-results/Base_Internal_Tests/JUnit.xml

35 tests were completed in 7s with 35 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
(Decimal_Constructor_Spec) conversions 1✅ 54ms
Host File values behaviour in Enso 2✅ 154ms
I/O Checks 2✅ 1s
Instrument @Tail_Call fibonacci 6✅ 2s
Instrument fibonacci 3✅ 2s
Object Comparator 9✅ 1s
Test Reporter running on GitHub 3✅ 170ms
Text_Utils 4✅ 911ms
to_display_text 5✅ 305ms

✅ /runner/_work/enso/enso/target/test-results/Base_Tests/JUnit.xml

3094 tests were completed in 402s with 3048 passed, 0 failed and 46 skipped.

Test suite Passed Failed Skipped Time
(Decimal_Spec) arithmetic 9✅ 261ms
(Decimal_Spec) BigDecimal internal representation methods 1✅ 4ms
(Decimal_Spec) comparison 12✅ 2s
(Decimal_Spec) construction 21✅ 235ms
(Decimal_Spec) conversions 14✅ 182ms
(Decimal_Spec) Decimal.set_scale 2✅ 6ms
(Decimal_Spec) div 1✅ 36ms
(Decimal_Spec) edge cases 2✅ 42ms
(Decimal_Spec) floor, ceil, truncate 4✅ 243ms
(Decimal_Spec) Integer/Float .to_decimal 2✅ 6ms
(Decimal_Spec) min/max 3✅ 80ms
(Decimal_Spec) pow 2✅ 34ms
(Decimal_Spec) remainder 3✅ 91ms
(Decimal_Spec) Rounding 19✅ 332ms
(Decimal_Spec) signs 3✅ 19ms
(Decimal_Spec) text conversion 4✅ 111ms
(Decimal_Spec) Text.to_decimal 3✅ 10ms
(File) Download Mode 3✅ 7s
Any.map_nothing 2✅ 154ms
Any's methods 3✅ 800ms
arithmetic 1✅ 79ms
Array_Proxy 5✅ 149ms
ArrayOverBuffer 1✅ 34ms
ASCII 4✅ 403ms
Asserts 5✅ 60ms
at/get 7✅ 415ms
Atom Constructors 4✅ 210ms
Atom with holes 9✅ 89ms
Auto_Detect 3✅ 51ms
Autoscoped Constructors 20✅ 445ms
Base_64 3✅ 338ms
BigInts 26✅ 1s
Booleans 6✅ 162ms
Bound 3✅ 13ms
Builder.new 11✅ 290ms
Bytes 3✅ 49ms
caching 1✅ 264ms
Callables 5✅ 502ms
Chain Multi Value 13✅ 87ms
Check Nothing and NaN 3✅ 6ms
children 2✅ 23ms
codepoints 2✅ 58ms
Compare functionality with Vector 1✅ 63ms
Compile 6✅ 186ms
Complex Multi Value 2✅ 16ms
const 1✅ 3ms
Contexts and Execution Environment 3✅ 20ms
Conversion 33✅ 1s
Convert Multi Value 5✅ 102ms
Correlation Statistics 6✅ 166ms
curry 1✅ 12ms
Data.read / File_Format 2✅ 3s
Data.read_many 8✅ 415ms
Dataflow Errors 11✅ 224ms
Dataflow Warnings 34✅ 2s
DataLinks in Enso Cloud 1⚪ 0ms
DataLinks to Enso Cloud 1⚪ 0ms
Date 42✅ 68s
Date date part tests 8✅ 925ms
Date_Range 11✅ 7s
Date_Time 46✅ 2⚪ 8s
Date_Time date part tests 8✅ 405ms
Date_Time equality 2✅ 45ms
Day_Of_Week conversions 9✅ 117ms
Debug 1✅ 3ms
Default comparator 5✅ 36ms
Default Encoding 10✅ 826ms
display text 1✅ 8ms
Duration 15✅ 1s
Empty errors 4✅ 35ms
Encoding object 4✅ 253ms
Enso Arrays 7✅ 674ms
Enso Cloud Audit Log 5✅ 1s
Enso Cloud Authentication 5✅ 2s
Enso Cloud Files 1⚪ 0ms
Enso Cloud Secrets 13✅ 3⚪ 5s
Enso Dictionaries 26✅ 499ms
Enso Hashset 7✅ 255ms
Enso_User 2✅ 1⚪ 318ms
Enso_User - local mock integration tests 2✅ 493ms
Enso_User - offline logic tests 1✅ 41ms
Enso: Common polyglot Dictionary operations 29✅ 7s
Environment 1✅ 65ms
Equals and hash 2✅ 160ms
Escape 1✅ 15ms
fetch 11✅ 1s
File Format 1✅ 66ms
File Operations 22✅ 1⚪ 923ms
flip 2✅ 8ms
Float.truncate 1✅ 36ms
Floats 6✅ 168ms
folder operations 9✅ 637ms
Format Detection in HTTP Fetch 3✅ 261ms
Formatting date/time values 6✅ 547ms
Fully Qualified Names 1✅ 4ms
Function Ascribed Parameters 12✅ 64ms
Functions 2✅ 36ms
Get by tag name 3✅ 72ms
Header 1✅ 31ms
Header resolution 7✅ 163ms
Headers 8✅ 611ms
Http Auth 2✅ 5s
HTTP client 4✅ 836ms
HTTP DataLink 11✅ 1s
Http Error handling 5✅ 1s
HTTP in Data.read 5✅ 364ms
HTTP_Method parse 3✅ 38ms
HTTP_Status_Code 1✅ 20ms
identity 3✅ 21ms
Inlining Helpers 2✅ 22ms
inner / outer xml 2✅ 48ms
Input Stream 5✅ 143ms
Integer.truncate 1✅ 7ms
Integers 26✅ 502ms
Interval 7✅ 128ms
Java case of 3✅ 16ms
Java FFI 6✅ 1⚪ 101ms
Java: Common polyglot Dictionary operations 29✅ 337ms
Java/Enso Date 2✅ 54ms
JavaDate 42✅ 35s
JavaDate date part tests 8✅ 187ms
JavaLocalTime 29✅ 754ms
JavaScript Objects, Arrays & Functions 8✅ 2s
JavaScript: Common polyglot Dictionary operations 29✅ 294ms
JavaScriptArrayWithADate 42✅ 40s
JavaScriptArrayWithADate date part tests 8✅ 642ms
JavascriptDataInArray 44✅ 4⚪ 4s
JavascriptDataInArray date part tests 8✅ 609ms
JavascriptDate 44✅ 4⚪ 6s
JavaScriptDate 42✅ 43s
JavascriptDate date part tests 8✅ 659ms
JavaScriptDate date part tests 8✅ 4s
JavaZonedDateTime 46✅ 2⚪ 5s
JavaZonedDateTime date part tests 8✅ 329ms
JavaZoneId 7✅ 44ms
JS_Object 5✅ 651ms
JSON 5✅ 155ms
JSON 1✅ 38ms
JSON Deserialization 10✅ 674ms
JSON Serialization 5✅ 393ms
JSON_Format 2✅ 168ms
Lazy 6✅ 142ms
Lazy Generator 1✅ 18ms
Lexicographic Order on Vectors 2✅ 32ms
List 32✅ 1s
Locale 13✅ 168ms
Looping Imports 1✅ 5ms
Lowercase Methods 5✅ 16ms
Managed_Resource 5✅ 5s
Match.end 4✅ 61ms
Match.groups 2✅ 45ms
Match.named_groups 3✅ 117ms
Match.span 4✅ 56ms
Match.start 4✅ 58ms
Match.text 6✅ 348ms
Match.to_display_text 1✅ 35ms
Match.utf_16_end 4✅ 87ms
Match.utf_16_span 4✅ 49ms
Match.utf_16_start 4✅ 78ms
Maybe 5✅ 39ms
Meta-Value Inspection 6✅ 44ms
Meta-Value Manipulation 33✅ 450ms
Meta.Type.find 4✅ 71ms
Methods 1✅ 1⚪ 3ms
Missing_Argument 3✅ 447ms
Multi Value as type refinement 15✅ 8⚪ 437ms
MultiValue Conversions 11✅ 721ms
Natural Order 4✅ 387ms
No Method Errors 1✅ 34ms
No_Such_Method 4✅ 258ms
non-linear inserts 11✅ 413ms
Number Conversions 10✅ 113ms
Numbers 15✅ 371ms
Operator == 17✅ 102ms
Ordering 6✅ 71ms
Pair 1✅ 2ms
Pair - from 2-Item JavaScript Array 14✅ 673ms
Pair - from 2-Item List 14✅ 309ms
Pair - from 2-Item Vector 14✅ 337ms
Pair - from Pair.new 14✅ 163ms
Pair - from Pair.Value 14✅ 110ms
Panics 22✅ 1s
parse 8✅ 325ms
Parsing date/time values 26✅ 1⚪ 2s
Parsing formats 4✅ 925ms
Path Operations 10✅ 1⚪ 285ms
Pattern Matches 19✅ 291ms
Pattern.find and .find_all 8✅ 883ms
Pattern.match and .match_all 8✅ 273ms
Pattern.matches 5✅ 63ms
Pattern.replace 8✅ 310ms
Pattern.split 6✅ 88ms
Pattern.tokenize 7✅ 1s
Period 8✅ 313ms
Plain_Text 3✅ 176ms
Polyglot 12✅ 157ms
Polyglot Argument 7✅ 100ms
Polyglot Argument with Inheritance 3✅ 41ms
Polyglot Conversion 14✅ 457ms
Polyglot hash maps 8✅ 511ms
Polyglot JS 21✅ 539ms
Polyglot keys and values 5✅ 289ms
Polyglot Operator == 7✅ 100ms
Polyglot Python 18✅ 271ms
Polyglot R 1⚪ 0ms
post 25✅ 3s
Private constructors 12✅ 100ms
Private methods 5✅ 8ms
Problem_Behavior 2✅ 93ms
Process 5✅ 131ms
Python: Common polyglot Dictionary operations 29✅ 418ms
PythonDate 1⚪ 0ms
PythonDate 43✅ 5⚪ 15s
PythonDate date part tests 8✅ 1s
PythonLocalTime 29✅ 5s
Qualified Names 3✅ 7ms
Random 14✅ 1s
Range 37✅ 4s
Rank Data 7✅ 65ms
Read XML 7✅ 258ms
read_bytes 5✅ 154ms
read_text 6✅ 302ms
Refs 6✅ 85ms
Regression 12✅ 144ms
ReportingStreamDecoder 6✅ 3s
ReportingStreamEncoder 8✅ 345ms
Request 10✅ 131ms
rounding 4✅ 54ms
Rounding 16✅ 549ms
should correctly evaluate documentation examples 8✅ 150ms
Sorting with multiple comparators 4✅ 2⚪ 123ms
Sorting with the default comparator 7✅ 3⚪ 253ms
Stack size 1✅ 12s
Stack traces 6✅ 604ms
State 5✅ 30ms
Statistics 16✅ 774ms
Statistics - empty Vector 3✅ 10ms
Statistics - invalid input 5✅ 26ms
Statistics - invalid input 1✅ 2ms
Statistics - NaN Vector 3✅ 17ms
Statistics - Nothing Vector 3✅ 22ms
System 2✅ 24ms
tag name 1✅ 11ms
take/drop Sample non-determinism 2✅ 32ms
take/drop Sample non-determinism 2✅ 14ms
take/drop Sample non-determinism 2✅ 7ms
take/drop Sample non-determinism 2✅ 22ms
take/drop Sample non-determinism 2✅ 6ms
Temporary_File facility 6✅ 1⚪ 1s
Text - general 85✅ 17s
text contents 1✅ 5ms
Text_Sub_Range_Data 2✅ 178ms
Text.cleanse 14✅ 368ms
Text.match 6✅ 91ms
Text.Regex splitting 3✅ 118ms
Text.Regex tokenizing 2✅ 81ms
Text.Regex: find and find_all 20✅ 1⚪ 591ms
Text.replace 28✅ 1s
Text.Span 3✅ 85ms
Text.substring 4✅ 30ms
the Self construct 6✅ 46ms
Time_Of_Day 29✅ 2s
Type Errors 11✅ 996ms
uncurry 1✅ 5ms
Unix epoch conversion 4✅ 123ms
Unresolved symbol 1✅ 19ms
URI 22✅ 3s
Use a slice of an array as vectors 104✅ 848ms
Use Array as vectors 104✅ 2s
Use Array_Proxy as vectors 104✅ 1s
Use Java ArrayList as vectors 104✅ 2s
Use Vector as vectors 104✅ 4s
UTF_16 BigEndian 5✅ 128ms
UTF_16 LittleEndian 5✅ 175ms
UTF_8 11✅ 409ms
Vector Slicing Helpers 1✅ 40ms
Vector.build 13✅ 191ms
Vector/Array equality 9✅ 100ms
Windows 1252 4✅ 204ms
Wrapped dataflow errors 8✅ 120ms
Wrapped errors 8✅ 408ms
write operations 23✅ 2s
Write XML 4✅ 291ms
Zone 9✅ 45ms

✅ /runner/_work/enso/enso/target/test-results/Examples_Tests/JUnit.xml

34 tests were completed in 81s with 34 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
Examples 32✅ 8s
Python Examples 1✅ 67s
Standard.Base Signature Checks 1✅ 7s

✅ /runner/_work/enso/enso/target/test-results/Geo_Tests/JUnit.xml

5 tests were completed in 521ms with 5 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
Geo Points 2✅ 172ms
GeoJSON to Table 3✅ 349ms

✅ /runner/_work/enso/enso/target/test-results/Image_Tests/JUnit.xml

175 tests were completed in 2s with 174 passed, 0 failed and 1 skipped.

Test suite Passed Failed Skipped Time
Data Links to Images 1⚪ 0ms
Image File_Format 2✅ 88ms
Image with 1 channel 19✅ 194ms
Image with 2 channels 19✅ 162ms
Image with 3 channels 19✅ 151ms
Image with 4 channels 19✅ 130ms
Image Write 2✅ 23ms
Image.read 9✅ 274ms
Matrix with 1 channel 21✅ 326ms
Matrix with 2 channels 21✅ 426ms
Matrix with 3 channels 21✅ 333ms
Matrix with 4 channels 21✅ 290ms
Matrix_Error 1✅ 9ms

✅ /runner/_work/enso/enso/target/test-results/Microsoft_Tests/JUnit.xml

583 tests were completed in 41s with 532 passed, 0 failed and 51 skipped.

Test suite Passed Failed Skipped Time
[SQLServer] (Nothing_Spec) between 45✅ 2s
[SQLServer] (Nothing_Spec) Comparisons 162✅ 5s
[SQLServer] (Nothing_Spec) is_nothing 9✅ 225ms
[SQLServer] (Nothing_Spec) not 1✅ 103ms
[SQLServer] (Nothing_Spec) sort 18✅ 504ms
[SQLServer] Audit Logs 3✅ 1⚪ 2s
[SQLServer] Column.map 1✅ 25ms
[SQLServer] Column.zip 1✅ 24ms
[SQLServer] Date-Time operations 20✅ 1⚪ 6s
[SQLServer] Date-Time support 3✅ 191ms
[SQLServer] Saving to Data Link 1⚪ 0ms
[SQLServer] Table.add_group_number 1✅ 608ms
[SQLServer] Table.add_row_number 1✅ 174ms
[SQLServer] Table.aggregate 3✅ 417ms
[SQLServer] Table.aggregate Concatenate 1⚪ 0ms
[SQLServer] Table.aggregate Count_Distinct 2✅ 2⚪ 818ms
[SQLServer] Table.aggregate First and Last 1⚪ 0ms
[SQLServer] Table.aggregate Mode 1⚪ 0ms
[SQLServer] Table.aggregate Shortest 1⚪ 0ms
[SQLServer] Table.aggregate should be able to group on multiple fields 6✅ 7⚪ 871ms
[SQLServer] Table.aggregate should be able to group on single field 6✅ 7⚪ 587ms
[SQLServer] Table.aggregate should correctly select result types 2✅ 2⚪ 218ms
[SQLServer] Table.aggregate should merge warnings when issues computing aggregation 1⚪ 0ms
[SQLServer] Table.aggregate should not summarize empty table when grouped 6✅ 5⚪ 375ms
[SQLServer] Table.aggregate should raise warnings when there are issues 7✅ 2s
[SQLServer] Table.aggregate should raise warnings when there are issues computing aggregation 1⚪ 0ms
[SQLServer] Table.aggregate should report unsupported operations but not block other aggregations in warning mode 6✅ 554ms
[SQLServer] Table.aggregate should report warnings and errors based on types 4✅ 392ms
[SQLServer] Table.aggregate should summarize empty table 6✅ 5⚪ 536ms
[SQLServer] Table.aggregate should summarize whole table 8✅ 8⚪ 2s
[SQLServer] Table.aggregate Standard_Deviation 1✅ 92ms
[SQLServer] Table.aggregate+Expressions 2✅ 282ms
[SQLServer] Table.coalesce 8✅ 355ms
[SQLServer] Table.cross_join 1✅ 61ms
[SQLServer] Table.cross_tab 1⚪ 0ms
[SQLServer] Table.distinct 1✅ 32ms
[SQLServer] Table.filter 24✅ 4s
[SQLServer] Table.filter by an expression 4✅ 1⚪ 365ms
[SQLServer] Table.from_union 1⚪ 0ms
[SQLServer] Table.join 38✅ 5s
[SQLServer] Table.make_table_from_dictionary/vectors 2✅ 26ms
[SQLServer] Table.merge 1✅ 114ms
[SQLServer] Table.offset 1✅ 31ms
[SQLServer] Table.remove_columns 13✅ 186ms
[SQLServer] Table.rename_columns 26✅ 1s
[SQLServer] Table.reorder_columns 11✅ 138ms
[SQLServer] Table.reorder_columns by type 1✅ 26ms
[SQLServer] Table.replace 1✅ 58ms
[SQLServer] Table.select_columns 16✅ 357ms
[SQLServer] Table.select_columns By_Type and Table.remove_columns By_Type 2✅ 71ms
[SQLServer] Table.sort 21✅ 715ms
[SQLServer] Table.sort_columns 4✅ 271ms
[SQLServer] Table.take/drop 2✅ 63ms
[SQLServer] Table.text_cleanse 1✅ 29ms
[SQLServer] Table.transpose 1⚪ 0ms
[SQLServer] Table.union 28✅ 1⚪ 2s
[SQLServer] Table.zip 1⚪ 0ms
[SQLServer] Temp column 2✅ 113ms

✅ /runner/_work/enso/enso/target/test-results/Snowflake_Tests/JUnit.xml

1 tests were completed in 0ms with 0 passed, 0 failed and 1 skipped.

Test suite Passed Failed Skipped Time
[Snowflake] Database tests 1⚪ 0ms

✅ /runner/_work/enso/enso/target/test-results/Table_Internal_Tests/JUnit.xml

1 tests were completed in 889ms with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
Autoconstructor Instrumentation 1✅ 889ms

✅ /runner/_work/enso/enso/target/test-results/Table_Tests/JUnit.xml

6800 tests were completed in 392s with 6616 passed, 0 failed and 184 skipped.
Report exceeded GitHub limit of 65535 bytes and has been trimmed

View more details on GitHub Actions