Prefetch Files For Large Batch Processing Jobs

Much of our large data is stored on network attached storage which has a latency dozens of milliseconds to seconds. It would be nice if cryosparc could prefetch all the files needed to process the next micrograph while processing the current one especially when running large batch processing jobs. This would greatly speed up patch motion correction, patch CTF, Reference Motion Correction, and even Extract Micrographs. Our systems have plenty of ram to cache the movies/micrographs/metadata.

1 Like

Hi @breddy,

Thanks for raising this. We’ve noted the feature request.

–Harris