diff --git a/data/README.md b/data/README.md new file mode 100644 index 00000000..281b087e --- /dev/null +++ b/data/README.md @@ -0,0 +1,24 @@ +# Data repository for benchmarks + +## Introduction + +As part of the EESSI framework, the ReFrame testing infrastructure is set up. Through this framework, both +the functionality and performance of libraries and applications can be verified on different architectures. +For some of the application benchmarks we need reasonably large input data. This github repository will host the +different download scripts to pull this data into cvmfs and allow fast and consistent delivery during the benchmarks +without burdening the data hosting of the datasuppliers. + +## Layout + +example for WRF Conus 12km dataset: +``` data/w/WRF/bench_12km ``` +* data: data directory root +* w: hierarchy mapper +* WRF: application as identified in EasyConfigs +* bench_12km: benchmark name + +## Download script + +The download script is expected to download and expand the dataset into the same directory as the script, in such +way that the data is directly usable by the application. Additional steps that would require a copy such as unzipping \ +or untarring should not be needed to run the benchmarks. diff --git a/data/w/WRF/bench_12km.tar.bz2.md5 b/data/w/WRF/bench_12km.tar.bz2.md5 new file mode 100644 index 00000000..faaa1766 --- /dev/null +++ b/data/w/WRF/bench_12km.tar.bz2.md5 @@ -0,0 +1 @@ +a961ba09bd9ee8081b6d5ef764e7095b bench_12km.tar.bz2 diff --git a/data/w/WRF/download-bench_12km.sh b/data/w/WRF/download-bench_12km.sh new file mode 100755 index 00000000..1d58e21c --- /dev/null +++ b/data/w/WRF/download-bench_12km.sh @@ -0,0 +1,7 @@ +#!/bin/bash + +wget http://www2.mmm.ucar.edu/wrf/bench/conus12km_v3911/bench_12km.tar.bz2 +md5sum -c bench_12km.tar.bz2.md5 || exit +bunzip2 bench_12km.tar.bz2 +tar -xf bench_12km.tar +rm -rf bench_12km.tar diff --git a/data/w/WRF/license-bench_12km.txt b/data/w/WRF/license-bench_12km.txt new file mode 100644 index 00000000..f012d8c1 --- /dev/null +++ b/data/w/WRF/license-bench_12km.txt @@ -0,0 +1,3 @@ +To the extent that any materials published in a UCAR data repository are protected by copyright, you are hereby granted a license to use such material, unless otherwise stated, subject to the terms and conditions of the Creative Commons Attribution 4.0 International license (https://creativecommons.org/licenses/by/4.0/legalcode). To the extent that any materials published in a UCAR data repository are not protected by copyright, you are hereby granted permission to use such materials for any lawful purpose. When using any materials obtained from a UCAR data repository, you agree to use the recommended data citation format provided by that UCAR data repository. If you have questions concerning this recommendation please contact the user online help service at the UCAR data repository. + +ALL MATERIALS PUBLISHED IN A UCAR DATA REPOSITORY ARE PROVIDED “AS IS”. UCAR DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. IN NO EVENT SHALL UCAR BE LIABLE FOR ANY DAMAGES OF ANY NATURE SUFFERED BY YOU, ANY USER, OR ANY THIRD PARTY. IN NO EVENT SHALL UCAR BE LIABLE FOR ANY SPECIAL, INDIRECT PUNITIVE OR CONSEQUENTIAL DAMAGES OR ANY LOSS OR DAMAGES WHATSOEVER, INCLUDING, BUT NOT LIMITED TO, CLAIMS ASSOCIATED WITH THE LOSS OF DATA OR PROFITS THAT ARISE OUT OF OR IN CONNECTION WITH THE ACCESS, USE, CONTENT, PERFORMANCE OR RELIANCE ON THE DATA.