Update hive and add notification

[advaita-saha]

Hive Update

hive updates have been merged, but this now creates a new way of feeding client data
which is --client-file

example format of the file

- client: nimbus-el
  dockerfile: git
  build_args:
    tag: master

So for the nightly run we would utilise the pre-build images and the yaml file to generate would look something like

- client: nimbus-el
  dockerfile:
  build_args:
    tag: master

For the manual runs we need to get in an additional parameter from the user in jenkins which would be dockerfile type which can be either git or empty. The tag in this file is the branch
looking like

- client: nimbus-el
  dockerfile: git
  build_args:
    tag: <branch-name>

For a 2 client run for example the ethereum/sync run, the file would look something like this

- client: nimbus-el
  dockerfile: 
  build_args:
    tag: master
- client: reth

Notifications

Since hive runs are stable now, this is one of the major goals of hive is to detect regressions as we keep developing nimbus-eth1. Now we have all the results posted at https://hive.nimbus.team but we often might overlook being busy with other stuff
An ideal thing would be to track differences in test case passing and issue a notification in discord
Example of a recent regression detected by hive

[siddarthkay]

@advaita-saha : regarding notifications: do you want a notification in discord when each run is completed and probably a link to said run? or do you want a notification in discord only when a regression is detected?

[advaita-saha]

Whenever there is a change i.e you detect a diff [ as shown in the picture ]
It can be a improvement or regression, we want to notified for change

[siddarthkay]

I updated and rebuilt hive to latest commit in master : ethereum/hive@874e7bc

jenkins@node-01:~/hive$ git log --oneline
874e7bc (HEAD -> master, origin/master, origin/HEAD) clients/nimbus-portal: name change of fluffy client to nimbus-portal (#1290)

jenkins@node-01:~/hive$ ll
total 28M
-rw-rw-r--  1 jenkins  422 Mar 13 12:16 AUTHORS
drwxrwxr-x 27 jenkins 4.0K May 22 07:29 clients
drwxrwxr-x  4 jenkins 4.0K Mar 13 12:16 cmd
-rw-rw-r--  1 jenkins  32K Mar 13 12:16 COPYING
drwxrwxr-x  3 jenkins 4.0K Mar 13 12:16 docs
-rw-rw-r--  1 jenkins   70 Mar 13 12:16 eth2.go.work
-rw-rw-r--  1 jenkins 3.5K Mar 13 12:16 go.mod
-rw-rw-r--  1 jenkins  30K Mar 13 12:16 go.sum
-rwxrwxr-x  1 jenkins  13M May 22 07:30 hive
-rw-rw-r--  1 jenkins 8.2K Mar 13 12:16 hive.go
drwxrwxr-x  3 jenkins 4.0K Mar 13 12:16 hiveproxy
drwxrwxr-x  2 jenkins 4.0K Mar 13 12:16 hivesim
drwxrwxr-x  3 jenkins 4.0K Mar 13 12:16 hivesim-rs
-rwxrwxr-x  1 jenkins  16M May 22 07:30 hiveview
drwxrwxr-x  6 jenkins 4.0K Mar 13 12:16 internal
-rw-rw-r--  1 jenkins 2.7K Mar 13 12:16 README.md
drwxrwxr-x  7 jenkins 4.0K Mar 13 12:16 simulators
-rw-rw-r--  1 jenkins 2.3K Mar 13 12:16 test.sh
drwxr-xr-x  3 jenkins 4.0K Mar 13 12:17 workspace

Strange , UI at https://hive.nimbus.team/ still shows older commit and timestamp

[siddarthkay]

was probably cached at my end but its updated now

[siddarthkay]

hive was updated to latest version which now includes : ethereum/hive#1297

[siddarthkay]

As discussed :
-> regression notifications to go to #hive-alerts in Nimbus Discord server.
-> I'll @ @advaita-saha and @jangko for those.

[siddarthkay]

I believe we could just use https://github.com/ethpandaops/panda-pulse to listen to our hive tests and ping our discord

[jakubgs]

Is this still relevant or can it be closed?

[advaita-saha]

Is this still relevant or can it be closed?

We still need the notification, but I am planning a wider change with @siddarthkay . Hope we can plan it out today or tomorrow
So we can create a detailed issue on that

In the mean time, we can close this one

[jakubgs]

Well, if it's still relevant then lets leave it open.