Skip to content
John Holt edited this page Aug 14, 2020 · 58 revisions

The dataweb service allows some information about each instrument to be viewed in a webpage from both inside and outside the ISIS network. This service already exists for SECI instruments.

The Overall Architecture

Architecture

The dataweb system consists of a number of parts running on each instrument:


The Archive Engine

The archive engine shown in the high level design produces internal webpages that provides live data on various PVs in HTML format:

The WebServer

The webserver is run as part of the BlockServer and provides all of the data on the current configuration in JSON format. This is the exact same data that is served on the GET_CURR_CONFIG_DETAILS PV. The webserver is currently serving the data on localhost:8008.


On the Dataweb Server

There are also parts of the system running on a central webserver, which provides external access.

JSON Bourne

The program collates all the data from the other sources, on all the EPICS instruments, such as putting the blocks and their values into the relevant groups as given by the configuration. This information is served as JSON to localhost:60000. This runs as a service on the central server and lives in C:\JSON_Bourne.

The Website

Currently a simple JS script takes the JSON created by JSON Bourne and provides a simple webpage for an external client to view. This can be accessed from http://dataweb.isis.rl.ac.uk/. The code for the website, both the html and javascript are located in the central server at C:\inetpub\wwwroot\DataWeb\IbexDataweb.

Deployment

To deploy on a new instrument see Deployment

To update the production version of the dashboard:

Development/Testing

Clone the repository at https://github.com/ISISComputingGroup/JSON_bourne

To test the blockserver webserver:

  • Start your instrument
  • Navigate to localhost:8008 in a browser

To test JSON_Bourne:

To test the front end on a developer machine:

  • Open default.html with the variable of ?Instrument=instrument-name e.g. go to file:///C:/Instrument/Dev/JSON_bourne/front_end/default.html?Instrument=larmor in a browser to view larmor's dashboard. Note that the path is dependant on where you have created the local JSON_bourne repository. This will use the JSON bourne instance running on NDAEXTWEB!

To test the front end and JSON bourne on a developer machine:

To be able to see your instrument as well:

  • Add your instrument to the inst_list dictionary in the InstList class in web_scrapper_manager.py (for example inst_list = {"my_device":"localhost"})
  • Run your instrument
  • Run JSON Bourne up as above

If you need to update the archive engine then you will need to:

  1. Run create_icp_binaries.bat
  2. make clean uninstall install in ..\EPICS\CSS\master

Troubleshooting

General Investigation

First look at the log to ensure that there are no issues. The log is held in C:\JSON_Bourne\log

Restart the Dataweb

As admin open the "Task Scheduler" and end and run the "JSON Bourne" task (in task scheduler library).

New Instrument with No Details

If the instrument archive has never been restarted then the dataweb will fail to show any information and claim that the server hasn't been started. To fix this simple restart the instrument archive.

Future Development Ideas

  • We need to improve the unit test coverage of this project. It would be worth looking into the requests-mock library as this would make it very easy to test server code which makes HTTP requests.

Overview page

http://dataweb.isis.rl.ac.uk/IbexDataweb/Overview/ibexOverview.html

Clone this wiki locally