Submit "Import movies" to another (high-CPU) node?

Import and Export
1

Hi everyone,

we’ve started collecting datasets with eer movies and ~9k movies on each day, and the “Import movies” job takes ~12h for it at 8 CPUs. I have a high-CPU node on the cluster with 128 cores (the high-GPU ones have up to 18 CPU cores), and would really like to use it for “Import movies” job.

Is that possible? I can’t see queue options when submitting “Import movies” job, and hence the question.

2

Hi,

Perhaps the CRYOSPARC_DISABLE_IMPORT_ON_MASTER environment variable is what you’re after.

Cheers,
Yang

3

@leetleyang
is there a similar setting for exporting particles with Live Particle Export for cases when the stack is too large for a head node’s RAM?

4

Not that I familiar with. Perhaps @wtempel coud look into it for you.

Cheers,
Yang