The current version of cryosparc I’m using is 4.6.2; however, the processing is now very slow, for example, the files I synchronized from the electron microscope server are over four hundred, but only 60 or so have been processed.
Have any of you had similar problems? Or how can I check cryosparc?
Please can you describe the storage devices and protocols underlying the source and new folders, respectively:
df -h /path/to/source_folder
df -h /path/to/new_folder
We use the LoongStore file system, a more niche file system. Say I run cp /datapool/em-data/customerservice_20241224_151724_60 /datapool/em-data/customerservice_20241224_151724_60_backup and / datapool/em-data/customerservice_20241224_151724_60_backup as the input folder for the Directory to watch input box, then the speed will be normal to be able to very quickly find out how many exposures there are
Source and destination folders are under the same file system
Please can you point us to documentation for this filesystem, specifically relating to the (instant?) availability of data newly/recently imported to the filesystem.
How do I tell the docs to send you, I replaced the folder with /datapool/em-data/customerservice_20241224_151724_60_backup , and it recognizes all the files quickly, which I suspect has little relevance to the file system
I guess I may have solved it, I was previously copying from the electron microscope server to the cluster with the command /usr/bin/rsync -ac --partial --no-owner --no-group --remove-source-files --inplace, and I’ve found that the cp command finds the files quicker if I changed it to cp command to copy the data, and found the problem solved
