Skip to content

Latest commit

 

History

History
108 lines (93 loc) · 5.08 KB

README.md

File metadata and controls

108 lines (93 loc) · 5.08 KB

Evaluation Workflow

workflow

  • We compare our tool, OBG-gen (Ontology-Based GraphQL Server Generation) in two versions (OBG-gen-rdb and OBG-gen-mix) wih three systems: Morph-rdb, Ontop, HyperGraphQL and UltraGraphQL.

Real Case Evaluation

  • An example query without filter expression is shown below. (List all structures including reduced formula.)
    {
        StructureList{
            hasComposition{
                ReducedFormula
            }
        }
    }
  • An example query with filter expression is shown below. (List all calculations including ID, output calculated property name and value, where ID in a given list of values.)
    {
      CalculationList(
        filter: { ID: { _in: ["6332", "8088", "21331", "mp-561628", "mp-614918"] } }
      ) {
        ID
        hasOutputCalculatedProperty {
          PropertyName
          numericalValue
        }
      }
    }

  • You can find all the 12 GraphQL queries at this folder.

    • Q1 (List all the structures containing the reduced formula of each structure's composition.)
    • Q2 (List all the calculations containing the reduced formula of each output structure's composition.)
    • Q3 (List all the calculations containing the name and value of each output calculated property.)
    • Q4 List all the calculations containing the name and value of each output calculated property, the reduced formula of each output structure's composition.)
    • Q5 (List all the calculations and structures)
    • Q6 (List all the calculations where the ID is in a given list of values.)
    • Q7 (List all the calculations where the ID is in a given list of values, and the reduced formula is in a given list of values.)
    • Q8 (List all the calculations where the ID is in a given list of values, and the reduced formula is in a given list A or B.)
    • Q9 (List all the calculations where the value of band gap property is higher than 5.)
    • Q10 (List all the calculations where the value of band gap property is higher than 5, and the reduced formula in a given list of values.)
    • Q11 (List all the calculations where the filter condition is complex that needs to be simplified.)
    • Q12 (List all the structures that contain Si element.)

  • Query Execution Time (QET) per data size on materials dataset for queries without filter conditions (Q1-Q5). entities

  • Query Execution Time (QET) per data size on materials dataset for queries with filter conditions (Q6-Q12). entities

  • Query Execution Time (QET) per query on materials dataset. entities

Synthetic Evaluation based on LinGBM

  • An example query is shown below.
    { 
      UniversityList (filter:{nr:{_eq:973}}) { 
        undergraduateDegreeObtainedBystudent{ 
          advisor { 
            worksFor{nr} 
          } 
        } 
      } 
    }

Synthetic Evaluation based on GTFS-Madrid-Bench

  • An example query is shown below.
    { 
      ShapeList { 
        shapePoint { 
          lat
          long
          pointSequence
        } 
      } 
    }