Experimental support for Relion's Bayesian polishing in csparc2star.py

I am trying to revive this topic. My particles in Cryosparc through Patch Motion > Patch CTF > … > Refinement.
I can convert everything well according to the guideline from pyem using Methods 2. Extracted the particles and did a test reconstruction, and everything looked good. So particle coordinates & orientations are well converted by pyem. But when I polished it, the output particles were not at the right location at all. Does anyone see anything similar?

Extracted the particles from the cryoSPARC micrographs, right? You have probably needed to invert the coordinates and flip the CTF values.

Hi Daniel,

So apparently, to polish, I need to invertY and flipY (flip CTF as you said). But to test reconstruction by extract from the coordinate and reconstruct, I would use not InvertY (with --inverty option). It is a bit confusing but it works.

In this case it’s because in your “new” extraction test the particles are coming from the same drift-corrected micrographs you’ve had all along in cryoSPARC. Then only when you run polishing are you getting something based on Relion looking into the movies directly.

If you would instead run motion correction from scratch in Relion, then those new drift-corrected micrographs in Relion would have the same conventions as the Relion polishing job. (And in that case, extracting & refining would really tell you if Relion is getting the right coordinates. It would also let you use definitely correct CTF and alignment parameters, instead of the ones converted by me from whatever was estimated in cryoSPARC, based on flipping the images. Finally, Relion would also be able to start the polishing trajectories from the local patch trajectories found during initial motion correction. For that reason this is my recommended approach).

I’m running into the same issue as other users (“There is no movie metadata STAR file for any micrographs!”) – apparently, in a bid to consolidate data and save storage space I deleted the files for the initial “Import Movies” job, so while I have motion-corrected .mrc files from the subsequent “Motion Correction” job, the corrected_particles.star file points to un-corrected .tif files from the Import job that do not exist anymore.

When I re-run or clone the import job, the generated .tif files have different prefixes (file names formatted as {prefix}_moviename.tif) so the file names are not identical to the previous files. Is there any way to remedy this issue beyond full reprocessing from the initial data import?

@forrest If the problem is that the path to the tif files has changed and you did not delete or otherwise modify the original Import Movies job, you may be able to update the targets of the

symbolic links inside that original Import Movies job’s imported/ subdirectory (guide).