Skip to content

Latest commit

 

History

History
393 lines (339 loc) · 27 KB

CHANGELOG.md

File metadata and controls

393 lines (339 loc) · 27 KB

Release Notes

September 2019

  • Improvement: Changes to showing files in datasets for selection
  • Improvement: REST API fixes and improvements
  • 💥 Fixed: Adding a DOI was referring to wrong fields causing inconsistent errors
  • 💥 Fixed: EZ Datacite link updated to point through doi.org
  • 💥 Fixed: Publish page was reseting page when a new author was added, losing previously entered data

August 2019

  • Improvement: Better handling of multiple file versions on moves and deletes
  • Improvement: Remove unused fields from experiments page
  • 💥 Fixed: Fixes to publishing datasets to globus to ensure all files are published
  • 💥 Fixed: Various fixes to file selection

July 2019

  • New Feature: Published datasets can be downloaded using Globus
  • New Feature: Publish private datasets to Globus
  • New Feature: Publish datasets moved to project level
  • Improvement: Added ability to delete unpublished datasets
  • 💥 Fixed: Creating an account with an existing email address didn't return an error
  • 💥 Fixed: Cancel button on login wasn't doing anything
  • 💥 Fixed: Demo projects button was not creating the demo project
  • 💥 Fixed: Hide demo button checkbox was ignoring selection
  • 💥 Fixed: File selection issues with files left in exlude/include list

June 2019

  • New Feature: Add support for ignoring columns in ETL
  • New Feature: Project level publishing allows recursive file selection
  • New Feature: New APIs to get and set Metadata on various objects in system
  • New Feature: Beta support for publishing datasets to a Globus endpoint
  • New Feature: Beta support for downloading published datasets using Globus
  • New Feature: Owners of projects can now transfer their project ownership to another project user
  • New Feature: Add API call to get all new files added to a project during a date range
  • Improvement: Add notes as an ignored keyword for spreadsheet processing

May 2019

  • New Feature: Add support for ignoring cells in ETL
  • New Feature: Add support for actions in ETL
  • New Feature: Beta simple search of matching samples by process attributes
  • New Feature: Add support for Files in ETL
  • New Feature: Add support for spreadsheets with no parent column
  • Improvement: Handle extra starting/trailing spaces in headers and value cells
  • 💥 Fixed: Various project level publishing fixes

April 2019

  • New Feature: Added backend support for new ETL process
  • New Feature: New ETL format in Beta
  • New Feature: New ETL a second format is now supported for reading a spreadsheet without specifying a workflow
  • New Feature: Set best measure on sample attributes
  • New Feature: Show experiments being loaded from a spreadsheet as in progress until they are done loading or error
  • Improvement: File details page now gives access to file versions
  • Improvement: File details page shows processes and samples
  • Improvement: Filter by samples in workflow now filters as you choose a sample
  • Improvement: Filter by samples in workflow allows search and filter on search
  • 💥 Fixed: DOI Publishing in project datasets now generates a DOI
  • 💥 Fixed: Workflow process outline did not have a scrollbar

March 2019

  • Improvement: Issue #1316 New interface for interacting with files
  • Improvement: ETL Processing now performed in a background task
  • Improvement: Lots of improvements and simplifications to the backend services
  • 💥 Fixed: Issue #1381 Deleting a file was leaving some artifacts in the database
  • 💥 Fixed: Issue #1392 ETL wasn't properly handling root files

Feb 2019

  • Improvement: Issue #1315 Add sort to all columns in samples table, except experiment and modification time (We already group by experiment)
  • Improvement: Issue #1363 Clicking on file in the details list of a directory brings up a modal displaying the file
  • Improvement: Issue #1311 Improvements to the Account Overview page
  • Improvement: Issue #1365 Improved adding papers to datasets
  • Improvement: Issue #1366 Improved adding authors to datasets
  • Improvement: Issue #1324 Show papers related to the dataset
  • Improvement: Issue #1325 Allow individual files to be downloaded from a dataset
  • Improvement: Issue #1370 Show counts of datasets at project level
  • Improvement: Issue #1306 Help user identify what their globus id is
  • Improvement: Issue #1286 Help user understand that datasets are for publishing
  • Improvement: Issue #1298 Open separate browser tabs without have to login again on each tab
  • Improvement: Issue #1335 Add ability to view raw json for various objects in the UI
  • Improvement: Issue #1287 Explains counts on create dataset popup
  • Improvement: Issue #1289 Improve explanation of what can change when publishing a dataset
  • Improvement: Issue #1378 Add processes to sidebar and implement a process overview page
  • Improvement: Issue #1377 Add a bunch of information to samples and turn into a full page
  • 💥 Fixed: Issue #1302 When creating a project level note for the first time the note wouldn't show up without doing a refresh
  • 💥 Fixed: Issue #1360 Files added directly to a dataset were not showing up
  • 💥 Fixed: Issue #1361 The view button in the workflow for a published dataset was not doing anything
  • 💥 Fixed: Issue #1362 Published datasets not showing file count
  • 💥 Fixed: Issue #1362 Published datasets not showing file count
  • 💥 Fixed: Issue #1317 Click on file in "experiment files" wouldn't display the file
  • 💥 Fixed: Issue #1359 Couldn't upload files into a project level dataset
  • 💥 Fixed: Issue #1327 No scrollbar on long lists of files in published datasets
  • 💥 Fixed: Issue #1330 "Show Process Details" menu item now shows all the process details
  • 💥 Fixed: Issue #1369 Projects REST API returning deprecated field
  • 💥 Fixed: Issue #1368 Reduce the amount of information sent about a user

Jan 2019

  • Improvement: Issue #1310 Change ? To "HELP" in Navbar
  • Improvement: Issue #1299 Show Project Id on project description page
  • Improvement: Issue #1313 Show a single list of projects (rather than 2 lists depending on owner/member)
  • Improvement: Issue #1281 Cleaned up help on login page to reference materials commons rather than the projects site
  • Improvement: Issue #1280 Allow users to choose which page to login to (projects or published data)
  • Improvement: Issue #1284 Allow clicking outside of dialog to close it
  • Improvement: Issue #1301 Sort users on collaborators page by last name

Nov 2018

  • Beta: Globus for Upload/Download without login.
  • Beta: ETL modified to work from files already uploaded to Project.
  • 💥 Fixed: Bug fixes and layout changes.

October 2018

  • Beta: Globus Upload/Download with user login.
  • Beta: ETL improvements and integration with Globus.
  • Beta: Publishing at the project level.

July 2018

  • Workshop: Changes in preparation for the workshop (publishing, ETL, Globus, Python API).
  • 💥 Fixed: Bug fixes and layout changes.

June 2018

  • Beta: Publishing at the Project Level.
  • Beta: ETL Improvement
  • 💥 Fixed: Bug fixes and layout changes.

May 2018

  • Alpha: Globus Integration.
  • Alpha: ETL.
  • Alpha: Publishing at the Project Level.
  • 💥 Fixed: Bug fixes and layout changes.

April 2018

  • Alpha: Globus Integration.
  • Alpha: Changes related to Python API.
  • 💥 Fixed: Bug fixes and layout changes.

March 2018

  • New Feature: Lots of behind the scenes work to prepare for automated spreadsheet upload and publishing improvements.
  • Improvement: Small changes to publishing to help guide a user when they can publish.
  • 💥 Fixed: Bug fixes and layout changes.

February 2018

  • New Feature: New navigation sidebar in the UI makes navigation much easier.
  • New Feature: Project notes and todos. The notes accept markdown syntax.
  • New Feature: The sidebar allows users to add top level directory shortcuts into the bar. It also includes 3 standard directories.
  • New Feature: New projects are now created with 3 default directories and shortcuts.
  • Improvement: Scrolling in the UI has been improved across all pages.
  • Improvement: A number of pages were changed in the UI to improve usability.
  • 💥 Fixed: A number of UI bugs were fixed.

January 2018

  • New Feature: We are doing a bunch of work behind the scenes to enable command line upload of data and workflow.
  • Improvements: A lot of work went into testing and squashing bugs.

November 2017

  • New Feature: Add comments section to public datasets.
  • New Feature: Add download and view statistics to public datasets.
  • Improvement: File upload easier to use. Now shows thumbnails of image files to be uploaded.
  • Improvement: Drag and drop for moving files improved.
  • Improvement: Multiple changes to UI state improved and fixed so that operations on files are displayed in the UI.
  • 💥 Fixed: Other miscellaneous bug fixes.

October 2017

  • New Feature: Merge experiments - Experiments can now be merged into a single experiment. This allows you to do your work in separate experiments then publish/view as a single whole. Original experiments are kept.
  • New Feature: Delete experiments - Experiments can now be deleted when using the web application.
  • New Feature: Delete projects - Projects can now be deleted when using the web application.
  • New Feature: Refresh view - Users can control when the want to refresh their projects with the latest information from the server.
  • Improvement: A number of performance improvments were made. Projects and experiments will now load much faster. Deletes are now nearly instantaneous.
  • Improvement: The details page for a public dataset has been reworked to reduce scrolling and make finding the different sections easier.
  • 💥 Fixed: Experiments with large numbers of files would appear to hang. Now they load very quickly.
  • 💥 Fixed: Clicking on tags in the public datasets didn't do anything. Now clicking on a tag takes you to all the datasets associated with that tag.
  • 💥 Fixed: Other miscellaneous bug fixes.

August 2017

Performance improvements and changes related to the upcoming Python API release and PRISMS workshop in August.

25 July 2017

This release integrated the Materials Commons Data and Materials Commons Projects sites together. The data site is now the home page for both sites. In addition this release made significant improvements to the workflow editor, and added the workflow graph and outline to the published data site. Lastly a first version of the template editor for creating and editing process templates is being released.

  • New Feature: Integrated the Projects and Data sites together. Data pages now share the same look and feel as the proojects site.
  • New Feature: Workflow Editor - Expand/Collapse nodes.
  • New Feature: Workflow Editor - Hide/Hide Other nodes.
  • New Feature: Workflow Editor - Added filter by samples.
  • New Feature: Workflow Editor - Added filter by processes.
  • New Feature: Workflow Editor - Added tooltips to nodes and edges.
  • New Feature: Workflow Editor - Added showing/hiding sidebar with details, filters, and add tab.
  • New Feature: Workflow Editor - Added sidebar tab to easily add multiple nodes to graph.
  • New Feature: Workflow Editor - Allow multiple nodes/edges to be selected by shift click and shift and draw box.
  • New Feature: Workflow Editor
  • New Feature: Workflow Editor
  • New Feature: Added workflow visualization to data site details.
  • New Feature: Template editor with the ability to create new templates. Admin users can edit any template.
  • Improvement: Workflow Editor - Edge names now indicate if there is more than one sample.
  • Improvement: Workflow Editor - Improved file/sample linking and showing the linked items.
  • Improvement: Upgraded cytoscape dependencies.
  • Improvement: Notes section now displays no notes in a more friendly way.
  • 💥 Fixed: Various reports that had blank fields for samples and files.
  • 💥 Fixed: Cannot delete datasets that have a DOI assigned to them.
  • 💥 Fixed: Other miscellaneous bug fixes.

26 June 2017

This release focused on improvments to the workflow editor.

  • New Feature: Reworked the process for picking templates to reduce clicks. Templates that are used, float to the top.
  • New Feature: Separated clone and add into separate buttons rather than in a drop down item to reduce clicks.
  • New Feature: Added right click to delete a workflow node.
  • New Feature: Added right click to add a child node and automatically bring over samples.
  • 💥 Fixed: Other miscellaneous bug fixes.

No changes. We are working on directly integrating the two materials commons sites together.

This release focused on documentation and upload speed. We are also exploring using the API to create scripts to automate workflow creation.

  • New Feature: Help pages available on API.
  • New Feature: Parallel file upload introduced to improve multi-file upload speeds.
  • Improvement: Other miscellaneous fixes and small features.

31 May 2017

This release focused on improvements to the publishing process. Support for DOIs was added to the system.

  • New Feature: DOI Support added to publishing datasets.
  • Improvement: Updates related to API support.
  • 💥 Fixed: Other bug fixes.

This release focused on improvements to the publishing process. Support for DOIs was added to the system.

  • New Feature: DOI Support added to publishing datasets.

28 April 2017

  • New Feature: A new template builder has been released to a limited set of beta users. The template builder will allow users to create new process templates and modify existing templates.
  • New Feature: Added the ability to rename projects.
  • New Feature: Office documents (Excel, Word, and PowerPoint) can now be viewed online as PDFs.
  • Improvement: The look and feel for account request and password reset emails was improved.
  • 💥 Fixed: Other bug fixes.
  • Improvement: The public data site now loads much faster.
  • Improvement: The site now gives feedback to the user when performing long operations.
  • Improvement: The look and feel for account request and password reset emails was improved.
  • 💥 Fixed: Other bug fixes.
  • New Feature: Added the ability to delete projects, experiments, files and other items.
  • Improvement: Added the ability to rename objects on the server.
  • 💥 Fixed: Other bug fixes.

31 March 2017

This release focused on ease of use and workflow improvements. Notably we added the ability to clone processes.

  • New Feature: Ability to clone a process. When cloning a process you have full control over files and samples.
  • New Feature: Added reminders to projects, this shows up in the new projects overview.
  • New Feature: Added description separate from overview for a project. This shows up in the projects overview.
  • New Feature: Added affiliation for users.
  • Improvement: UI now shows file and sample links.
  • Improvement: Improved linking files and samples by allowing a file to be linked to multiple samples.
  • Improvement: Changed look and feel of experiment overview in project home page. Additional information added to experiment overview.
  • Improvement: Change projects list to a table. Allowed sorting on columns. Added an overview for a project (more improvements will be added to overview).
  • Improvement: Demo project building added as button on projects page. You can also hide this without building a demo project. Demo project builder remains in window.
  • Improvement: Demo project building speed improved (from almost a minute down to seconds).
  • Improvement: Show user name rather than email address in various places (most notably in the navbar).
  • Improvement: Other small improvements.
  • 💥 Fixed: Processes with large numbers of files (thousands) causing problems. Now limited files display to 50 for now.
  • 💥 Fixed: Auto save was causing cursor to jump around. Increased timeout so this doesn't happen.
  • 💥 Fixed: Other bug fixes.

There were small changes made to the navigation bar.

  • Improvement: Added report a problem link to navbar.
  • Improvement: Other small changes to the navbar and bug fixes.

Materials Commons Python API

We are getting closer to an alpha release.

23 February 2017

This release added a bunch of new features to the graph workflow builder.

  • New Feature: The workflow graph can now be filtered by sample. This allows you to view only nodes associated with a set of samples.
  • New Feature: Added the ability to search within the graph workflow, showing only nodes that match the search.
  • New Feature: Added a right click handler to the graph. When over a node right click to view a 'Show Details' menu popup.
  • New Feature: Added a toolbar to the workflow containing useful tools.
  • New Feature: If a node is selected, when adding a new node, the default view for samples to choose from is now filtered to the samples available from the clicked node. You can still choose to see all the available samples.
  • New Feature: The dropdown menu under your username now allows you to create a demo project.
  • New Feature: Added the ability to create a birds eye view of your workflow and move around it easily.
  • Improvement: Increased the size of the graph workflow area.
  • Improvement: Updates to existing templates, as well as added a set of generic templates.
  • Improvement: Pan/Zoom and navigate have been improved in the graph view.
  • Improvement: Added description field to processes. The editor is fully featured and allows for rich data to be added to the process description.
  • Improvement: Improved various views to allow to view details, such as process and samples selection.
  • Deprecated: Removed the ability to set a process template for a task. This feature has been deprecated. Existing tasks with templates still work.
  • 💥 Fixed: Microsoft documents were treated as viewable, showing binary content. This has been fixed.
  • 💥 Fixed: Other bug fixes.

There were no changes made to Materials Commons Data in this release.

3 February 2017

This release of Materials Commons focused on stability and usability improvements.

  • Improvement: Names were added to the list of users (rather than just email addresses) when choosing users to give access to your project. The whole layout has been changed to improve usability.
  • Improvement: A help link was added to the projects navbar to make it easier to find.
  • Improvement: The way that pages scroll has been reworked in this release. This provides better support for small screens.
  • Improvement: Uploading files to a process has been improved to handle error conditions.
  • Improvement: The top menu bar now scales appropriately for the screen size.
  • Improvement: A new drop entry was added to the Heat Treatment template.
  • Improvement: A number of other miscellaneous usability improvements.
  • 💥 Fixed: Publishing datasets was failing. This has been fixed.
  • 💥 Fixed: Other bug fixes.

Materials Commons Python API

A lot of behind the scenes work was done on our Python library for Materials Commons (Not yet released). We are close to announcing a beta release.

There were no changes made to Materials Commons Data in this release.

21 December 2016

  • New Feature: First iteration of online help available. You can access this from within the UI. It's also available in the wiki on our repo.
  • New Feature: Files can now be directly uploaded into a workflow process.
  • New Feature: Additional process templates for PRISMS computational processes were added.
  • New Feature: The ability to add and update measurements and setup information for processes were added to the Python API.
  • Improvement: Reduced the number of steps to choose a template in tasks.
  • 💥 Fixed: Various updates to time/date handling.
  • 💥 Fixed: Composition wasn't being properly updated in the backend.
  • 💥 Fixed: Problem with setting units.
  • 💥 Fixed: Other bug fixes.

There were no changes made to Materials Commons Data in this release.

28 November 2016

  • New Feature: Materials Commons Python API (documentation coming) Repo.
  • New Feature: Files can be linked to samples.
  • Improvement: Performance improvements. Various pages now load much faster.
  • Improvement: Various backend changes to templates in preparation for future features.
  • 💥 Fixed: Updating dataset features was too restrictive.
  • 💥 Fixed: Other bug fixes.
  • 💥 Fixed: File counts for some datasets not displayed correctly.

31 October 2016

  • New Feature: Added template for sample sectioning
  • New Feature: Add reset password link so users who forgot their password can reset it.
  • New Feature: Completely redesigned the dataset interface. Added the ability to choose processes from a graph or outline.
  • New Feature: Added outline view to the workflow editor.
  • New Feature: Allow users to delete processes in the workflow editor. Ensure that the provenance graph is never made invalid.
  • 💥 Fixed: Various speed improvements.
  • 💥 Fixed: Deleting samples could leave provenance graph in an inconsistent state.
  • 💥 Fixed: Other bug fixes.
  • New Feature: Add reset password link so users who forgot their password can reset it.
  • 💥 Fixed: Dataset download files were not built correctly.
  • 💥 Fixed: Browse by tag wasn't showing all tags.
  • 💥 Fixed: Other bug fixes.

23 September 2016

  • New Feature: First release of the graphical workflow editor.
  • 💥 New Feature: Various bug fixes.
  • New Feature: MC Data now includes provenance details in an outline structure.
  • New Feature: Ability to search datasets on MC Data.
  • New Feature: Numerous updates to the details presented for a dataset on MC Data.
  • 💥 Fixed: Various bug fixes.

30 August 2016

  • New Feature: Datasets that have not been published can now be deleted.
  • New Feature: Introducing Materials Commons Data, a new site for publishing research data.
  • 💥 Fixed: Adding or changing composition on a sample was silently failing on the backend. It appeared to the user that the composition was being saved but then wasn't being displayed when viewing the sample.
  • 💥 Fixed: Dataset papers was not saving all fields of a paper on the backend. It would appear to the user that system was deleting old entries.
  • 💥 Fixed: Deleting a task would cause an error saying the note (for the deleted task) couldn't be updated. This error no longer occurs.

30 July 2016

  • New Feature: Tasks associated with a template couldn't be deleted. Now you can delete tasks with unused templates. A template is unused if it doesn't have any files or samples associated with it and isn't being used in a dataset.
  • New Feature: Change a tasks name or notes will now also update the corresponding process name or notes.
  • New Feature: Datasets can now be unpublished.
  • New Feature: A simple table layout was added that shows the files associated with a process.
  • 💥 Fixed: When clicking on a task sometimes the system would think you were trying to move the task to a different position, where that position is the same as the tasks current position. This would cause an error. Now the condition is checked and no move attempt is made if the task isn't actually being moved.
  • 💥 Fixed: When adding files to a process they would be saved, but wouldn't always be displayed. Now files are displayed.
  • 💥 Fixed: Datasets that are published had a link to view the published dataset. This was hard coded to the wrong URL (actually it pointed at Google). It now points at the correct URL.