Skip to content

Add ability to print a summary of test failure/error reasons #213

@nickrobinson251

Description

@nickrobinson251

Feature request from a colleague:

I'm spending a lot of time downloading test logs and running them through a summary script like this:

% grep -A 1 "Got exception" /tmp/logz.txt | cut -b 23- | sort | uniq -c | sort -nr | more
 492 Got exception outside of a @test
 491 
 466 MethodError: no method matching lt(::TypeNormalization.VssTypeDescriptor{TypeNormalization.ByteString24}, ::Tuple{Int64, RAI_VariableSizeStrings.VariableSizeString}, ::Tuple{Int64, RAI_VariableSizeStrings.VariableSizeString})
  14 MethodError: no method matching ==(::Type{TypeNormalization.VssTuple}, ::Type{TypeNormalization.VssTuple})
   2 OutOfMemoryError()
   2 MethodError: no method matching typemax(::Type{TypeNormalization.VssTuple{TypeNormalization.ByteString24}})
   2 MethodError: no method matching typemax(::Type{TypeNormalization.VssTuple{TypeNormalization.ByteString16}})
   2 MethodError: no method matching normalize_values_tuple(::TypeNormalization.ValueTypeDescriptor{Tuple{}}, ::PagedDataStructures.BeMessageValue{Tuple{}})
   2 MethodError: no method matching normalize_values_tuple(::TypeNormalization.ValueTypeDescriptor{Tuple{TypeNormalization.ByteString8}}, ::PagedDataStructures.BeMessageValue{Tuple{Int64}})
   2 MethodError: no method matching normalize(::TypeNormalization.ByteString8)

It would be amazing if ReTestItems.jl could produce a little summary of exceptions / test failures like this.

Metadata

Metadata

Assignees

No one assigned

    Labels

    new featureA feature we would like to add

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions