Skip to content

Commit 1348292

Browse files
authored
Merge pull request #32 from ISISComputingGroup/rerpha-patch-1
Update Datastreaming.md
2 parents 9fb3744 + 34639e0 commit 1348292

File tree

2 files changed

+3
-0
lines changed

2 files changed

+3
-0
lines changed

doc/specific_iocs/dae/Datastreaming.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,8 @@ The datastreaming system is being built as part of in-kind work to ESS. It will
1313

1414
In general the system works by passing both neutron and SE data into [Kafka](https://kafka.apache.org/) and having clients that either view data live (like Mantid) or write the data to file, additional information can be found [here](http://accelconf.web.cern.ch/AccelConf/icalepcs2017/papers/tupha029.pdf) and [here](https://iopscience.iop.org/article/10.1088/1742-6596/1021/1/012013).
1515

16+
All data is passed into flatbuffers using [these schemas](https://github.com/ess-dmsc/streaming-data-types) - we have a tool called [saluki](https://github.com/ISISComputingGroup/saluki) which can deserialise these and make them human-readable after they've been put into Kafka.
17+
1618
The datastreaming layout proposed looks something like this, not including the Mantid steps or anything before event data is collected:
1719

1820
![](ESSDSLayout.png)

doc/spelling_wordlist.txt

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -192,6 +192,7 @@ deenergise
192192
dehex
193193
deprioritise
194194
dereferenced
195+
deserialise
195196
Det
196197
dev
197198
devsim

0 commit comments

Comments
 (0)