warn and or truncate logs larger than a certain threhold

[kinow]

Problem

Reported by @tiggi on Mattermost. Sometimes, users turn on debugging on climate models or other components which produce ridiculous amounts of data, that is not really used (maybe one chunk or member, but definitely not the logs in the whole simulation).

Autosubmit transfers the file anyway. Which impacts performance and disk space in the vm.

Proposed Solution

We can warn the user before transferring, or transfer anyway.

We can have a configurable limit.

We can truncate as in a rotating log.

Etc.