Storage of raw data

Data Management
1

Hi
This may not necessarily be a data processing issue but i would like to have some suggestions.
I am currently using cryosparc on a standalone workstation and i have a 12TB hard drive as my work directory. The movies are backed up on a separate server. The movies transferred to and imported from this 12 TB drive. Once i have my particles extracted, can i delete the original movies? That will clear up a lot of storage space but will it hider the data processing?

Thanks!

2

Hi @aparvate,
Provided the raw movies are backed up elsewhere (as you mentioned they are), you can delete them from your workstation unless you want to use them as inputs for any further processing jobs. The job types in cryoSPARC that would require raw movies are: Import Movies and motion correction (any type). I hope this helps!

3

Hello,

Does this still hold true for the current version of CryoSPARC? I’m facing the same issue with limited space and would love to put the raw data elsewhere if I don’t need it. Do motion correction jobs create copies of the movies?

4

As of CryoSPARC v4.5.3:

  • Motion correction jobs do not create copies of the input movies.
  • During movie import, links to the movie files, but not copies, are created inside the Import Movies job directory.
5

Hi,

Thank you for your answer. So this means I cannot just move the raw data somewhere else and it must remain where it was initially when I started working with it, yes?

6

Raw data can be moved, but if you want to do anything requiring going back to the original movies, you’ll have to put them back exactly where they were.

7

Hi, thank you for your reply. How can I know what jobs require the original movies?

8

Patch Motion and Referenced Based Motion Correction will be the two you’re most likely to use. :slight_smile:

9

Hi, thank you. I was wondering if this still held true

Provided the raw movies are backed up elsewhere (as you mentioned they are), you can delete them from your workstation unless you want to use them as inputs for any further processing jobs. The job types in cryoSPARC that would require raw movies are: Import Movies and motion correction (any type). I hope this helps!

In the current version of CS, since this thread is already four years old, thank you for clarifying. It’s just a bit confusing as to what the computation is performed on if the raw movies are moved away and the motion correction jobs don’t create copies.

10

Motion correction jobs create motion corrected sums of the raw movies, from which particles are picked, extracted and everything else happens on.

1 Like
11

That clears it up! Thank you very much

12

@newbie In case you have access to the raw data, but not at their original path, you may adjust the relevant symbolic links.

1 Like