Skip to content

Commit 6dbfc0c

Browse files
New ETL written in Java (#85)
* Add new almighty dropbox Co-authored-by: jnnfr <[email protected]>
1 parent f3aafb5 commit 6dbfc0c

File tree

4 files changed

+34
-0
lines changed

4 files changed

+34
-0
lines changed

CHANGELOG.md

+5
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,10 @@
11
# Changelog
22

3+
# 1.10.0 2021-06-25
4+
5+
* Provides new ETL routine written in Java, that will replace all Jython scripts at some point [PR](https://github.com/qbicsoftware/etl-scripts/pull/85)
6+
* Support for nf-core pipeline result registration [PR](https://github.com/qbicsoftware/etl-scripts/pull/85)
7+
38
## 1.9.0 2021-05-18
49

510
* Provides metadata validation for imaging data (OMERO etl). [PR](https://github.com/qbicsoftware/etl-scripts/pull/83)
+16
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
# New ETL logic written in Java
2+
3+
Please find the source code of the ETL routine that this article is referring to in the
4+
[Java openBIS dropboxes](https://github.com/qbicsoftware/java-openbis-dropboxes) Github repository.
5+
6+
## Installation
7+
8+
Please provide the Java binaries as JAR from the [Java openBIS dropbox](https://github.com/qbicsoftware/java-openbis-dropboxes) in this directories
9+
folder `./lib`.
10+
11+
The DSS needs to be restarted in order to activate this dropbox.
12+
13+
## ETL routine
14+
15+
This dropbox expects a folder containing data and creates new openBIS dataset from it. For more information
16+
please visit [Java openBIS dropbox](https://github.com/qbicsoftware/java-openbis-dropboxes).
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
Put the compiled Java binaries as JARs in this directory in order
2+
to be loaded by the openBIS DSS class loader on DSS startup.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
#
2+
# Drop box for registering a fastq file as a data set
3+
#
4+
# Variables:
5+
# incoming-root-dir
6+
# Path to the directory which contains incoming directories for drop boxes.
7+
incoming-dir = ${incoming-root-dir}/QBiC-register-all-data
8+
incoming-data-completeness-condition = marker-file
9+
top-level-data-set-handler = ch.systemsx.cisd.etlserver.registrator.api.v2.JavaTopLevelDataSetHandlerV2
10+
program-class = life.qbic.registration.MainETL
11+
storage-processor = ch.systemsx.cisd.etlserver.DefaultStorageProcessor

0 commit comments

Comments
 (0)