Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[New Feature]: Improve DISP-S1 status update and view #1093

Open
philipjyoon opened this issue Feb 19, 2025 · 1 comment
Open

[New Feature]: Improve DISP-S1 status update and view #1093

philipjyoon opened this issue Feb 19, 2025 · 1 comment
Assignees
Labels
enhancement New feature or request needs triage Issue that requires triage

Comments

@philipjyoon
Copy link
Contributor

Checked for duplicates

Yes - I've already checked

Alternatives considered

Yes - and alternatives don't suffice

Related problems

No response

Describe the feature request

Currently the DISP-S1 historical processing status view looks like the following:
Image

We should improve on two aspects:

  1. The frame completion percentage often never gets to 100% because it's simply a ratio between sensing dates submitted to the total number of sensing dates. Most frames will have number of sensing dates that aren't a multiple of k=15 so there will be some sensing dates that will never be submitted. For these we should just round them up to 100% after the very last run has been submitted.
  2. We should create a new column just to list all frames that have completed. Figuring this out is very manual process because we have to see if 1) whether that frames has fully been submitted and 2) if all SCIFLO jobs for that frame have completed. We can automate this by just checking to see if the last acquisition day index SCIFLO job is in completed state in Mozart.
@philipjyoon philipjyoon added enhancement New feature or request needs triage Issue that requires triage labels Feb 19, 2025
@philipjyoon philipjyoon self-assigned this Feb 19, 2025
philipjyoon added a commit that referenced this issue Feb 20, 2025
…column in pcm_batch.py view all to list all completed frames
@philipjyoon
Copy link
Contributor Author

philipjyoon commented Feb 20, 2025

Completed as described. The output looks like this now. Completion Percentages aren't updated as they should have been because they are updated by the batch demon and didn't want to swap that out while PST cluster was processing data.

Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request needs triage Issue that requires triage
Projects
None yet
Development

No branches or pull requests

1 participant