Grid Stack docker compose update for dashboard suite flist

[mik-tf]

Work Done

• adjusted the deployment process so it works with micro VM for flist on tfgrid
• Set tar with pv to get a status of the progress
  • Then we get status from rsync (already happening) and from tar (this PR)
• we print the process to log file, this is used on flist to show a wepage of the progress
• Detail: links for networks are e.g. mainnet, but for qanet it was qa_net, so I updated this too

Status

• This branch along with the PR on TF-Image for the dashboard suite flist (Dashboard Suite Flist (Grid Stack Suite Part 1 of 3) tf-images#277) are done as a first version. We can deploy on micro VM running on TFGrid all 4 networks: main, qa, dev, test, with env variables: SEED, DOMAIN and NETWORK

Detail

• The files are in xz not gzip, despite the gz file extension

Related Work

• This is in line with the grid stack dashboard suite flist: Dashboard Suite Flist (Grid Stack Suite Part 1 of 3) tf-images#277

References

• Work done with the collaboration of @scottyeager

[coesensbert]

Thanks a lot for the effort. I went over the commits which look fine only that once merged would break the current flow. We have currently no grid backend stacks running on the grid or in a vm, all are bare metal machines setup exactly the same. We want to keep it this way since only changing a path for example, involves a lot of work making changes on all the live deployments. What is in this repo is also live in production.

Since also changes like using zinit are in commits, I would suggest to make a separate branch (or some other git magic) to keep the code for our bare metal deployments separate from flist compatible code. Although I'm not sure how to do that.

Since this pull request we also made changes to extracting commands, so we would need to go over integrating pv again

[mik-tf]

Thanks for the feedback Bert.

So finally we won't use the flist images + dashboard apps, thus this PR is not necessary. We will do everything with docker compose, as we have already started to work on.

I will update the grid deployment project specs with this so it's clear. So I will close this PR and others that are not relevant anymore.