Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Take local filename from source URL instead of "title" field #118

Open
chrisacbr opened this issue Jun 15, 2019 · 0 comments
Open

Take local filename from source URL instead of "title" field #118

chrisacbr opened this issue Jun 15, 2019 · 0 comments

Comments

@chrisacbr
Copy link

During a discussion on the slack channel about replica files appearing on other nodes with invalid .nc_[0-9] suffixes [1] it became apparent that Synda appears to use the title field from the corresponding Solr document as the local filename (see code at [2]). However, it turns out that field is not actually a filename but rather a unique ID, which while it may sometimes be the same as the source filename it doesn't have to be. Given that and also the raison d'être of Synda is to replicate a dataset (in DRS compliant layout) from another node, it would seem a better idea to take the local filename from the source URL. Alternatively, the publisher would need to add another field to the Solr document with the actual filename which then Synda could rely on.

[1] https://esgf-chat.slack.com/archives/C803C3KSQ/p1560478499103600
[2] https://github.com/Prodiguer/synda/blob/sdt/3.9/sdt/bin/sdprepare_file_attr.py#L88

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant