Raw data and CryoSPARC data storage change

Data Management
1

Due to the insufficient storage space of CryoSPARC for processing data, I need to export all the original data, intermediate steps and result data that have been processed previously to a portable hard drive. How should I proceed to ensure that all data is securely transferred and can be re-accessed in cryoSPARC? Do I need to revert to the original location when viewing?

Thanks for your kind help!
@wtempel

2

Detach the project, tar the project directory, copy the archive to the new location, extract, reattach. Confirm everything is there, delete the original.

Not failed for me yet.

Just be sure to give CryoSPARC time to make sure it’s fully detached, and quite a lot of time to reattach - reattaching seems to take longer than I expect for everything to be populated again!

1 Like
3

Thank you for your answer. I will try it!

4

It is okay to attach the CryoSPARC project directory at a different path from the path where it was stored before detachment (guide).
Symbolic links inside the project directory to imported data (movies, imported particle stacks, etc.) may need to be adjusted if those imported data, which are stored outside the CryoSPARC project directory, are restored to a different path than before.

6

Thank you @wtempel for your reply. I have some questions:

  1. After I detach my project to a hard drive, can I delete all the folders? In other words, after detaching, what should I do?
  2. What is the difference between detach and archive?
7

Note: In this post, the term archive often refers to CryoSPARC’s Archive project action, which needs to be complemented by, but does not itself include, the preparation of an archival copy. The preparation of a archival copy is the responsibility of the CryoSPARC user.

Any copies of the project directories that may be required need to be prepared after the project has been detached or archived.
After a project has been detached or archived, the CryoSPARC instance no longer requires access to the project directory. At that point, deletion would not affect CryoSPARC processing in other projects that may remain attached to the CryoSPARC instance (but an intact copy of the project directory would be required for potential continuation of work in the project in the future). Once you have prepared any copy or copies of the project directory that you might need in the future, and are certain the copies are valid:

  • complete
  • on a destination filesystem or in an archival file format that enable future restoration to a functional project directory, including permissions, file ownerships and symbolic links.

you may delete the previously attached project directory.

Please review the Detach and Archive sections as well as Use Cases and Examples in the Data Management Guide.