Slow reading of headers when importing large datasets




Importing large datasets of tif movies into cryosparc takes a very long time - ~30min to import 6000 movies. Most of this time seems to be taken up by reading the headers of each stack. Is this expected? Would it be possible to parallelize it to make it faster?



Hi Oli,

I had the same thought but after using an incorrectly-flipped gain reference during import I realized that the gain-correction is done during import. I wonder if this process (and not reading headers) is what takes so long.



I think it just does the gain correction for the first few movies (which are displayed in the log) - not the rest - because import is not generating gain corrected movies for the dataset (which would take up a ginormous amount of disk space)