Hi all,
I’ve encountered some issues with the web interface issues recently. There appears to be a lag for the operations. For example, when I delete a workspace W3, and then I move to another workspace, say W2. After I move to W2, it pops up the window asking me to confirm the deletion of W3, and then I hit confirm. However, instead of deleting W3, it deletes W2. I wonder whether this is a bug or if I have missed something.
I think this is mainly due to the web interface gets very laggy. It is the case even if I open the web browser on the local machine. I lost track of when this occurred. I wonder how I can debug and fix this issue.
Please let me know if any additional information is needed.
Thanks,
Wei
Hi @wxh180,
Thanks for the post. Are you running cryoSPARC in a single workstation configuration, meaning both the master components (web application, database, etc.) are running on the same machine as the jobs? If so, it may be possible that high CPU/memory or network load could cause the web application (and any other process running on the machine) to slow down or become unresponsive.
If you have a utility such as htop installed it can provide more insight into the various processes running on the machine and CPU/memory usage.
Additionally, please reply with the following logs if possible:
cryosparcm log command_core | tail -n 100
cryosparcm log database | tail -n 100
cryosparcm log webapp | tail -n 100
- Suhail
Hi @sdawood,
Here is a snapshot of htop:
Please find the log lines below:
##### command_core ######
2021-12-07 01:17:40,058 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 01:17:40,149 COMMAND.CORE run INFO | Completed task in 0.09137439727783203 seconds
2021-12-07 01:17:42,638 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 01:17:42,640 COMMAND.CORE run INFO | Completed task in 0.0019958019256591797 seconds
2021-12-07 01:17:42,641 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 01:17:42,654 COMMAND.CORE run INFO | Completed task in 0.013390779495239258 seconds
2021-12-07 01:17:42,654 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 01:17:42,753 COMMAND.CORE run INFO | Completed task in 0.09912729263305664 seconds
2021-12-07 01:17:42,754 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 01:17:42,847 COMMAND.CORE run INFO | Completed task in 0.09282255172729492 seconds
2021-12-07 01:17:49,015 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J120.var_filter_res with value 6 of python type <class 'int'> and param type number
2021-12-07 01:17:49,020 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 01:17:49,035 COMMAND.CORE run INFO | Completed task in 0.01497340202331543 seconds
2021-12-07 01:17:52,023 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J120.compute_use_ssd with value False of python type <class 'bool'> and param type boolean
2021-12-07 01:17:52,027 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 01:17:52,042 COMMAND.CORE run INFO | Completed task in 0.015138626098632812 seconds
2021-12-07 01:22:43,021 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 01:22:43,238 COMMAND.CORE run INFO | Completed task in 0.21461153030395508 seconds
2021-12-07 01:22:58,499 COMMAND.CORE scheduler_run_core INFO | Not a commercial instance - heartbeat set to 12 hours.
2021-12-07 01:26:09,780 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.update_location with value False of python type <class 'bool'> and param type boolean
2021-12-07 01:26:09,780 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.update_alignments3D with value False of python type <class 'bool'> and param type boolean
2021-12-07 01:26:09,780 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.update_alignments2D with value False of python type <class 'bool'> and param type boolean
2021-12-07 01:26:09,780 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.update_location with value False of python type <class 'bool'> and param type boolean
2021-12-07 01:26:09,780 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.update_alignments3D with value False of python type <class 'bool'> and param type boolean
2021-12-07 01:26:09,780 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.update_alignments2D with value False of python type <class 'bool'> and param type boolean
2021-12-07 01:26:09,785 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.box_size_pix with value 512 of python type <class 'int'> and param type number
2021-12-07 01:26:09,799 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.bin_size_pix with value 256 of python type <class 'int'> and param type number
2021-12-07 01:26:09,799 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.update_location with value True of python type <class 'bool'> and param type boolean
2021-12-07 01:26:09,800 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.update_alignments3D with value True of python type <class 'bool'> and param type boolean
2021-12-07 01:26:09,800 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.update_alignments2D with value True of python type <class 'bool'> and param type boolean
2021-12-07 01:26:09,800 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.update_location with value True of python type <class 'bool'> and param type boolean
2021-12-07 01:26:09,800 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.update_alignments3D with value True of python type <class 'bool'> and param type boolean
2021-12-07 01:26:09,800 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.update_alignments2D with value True of python type <class 'bool'> and param type boolean
2021-12-07 01:26:09,800 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.recenter_key with value alignments3D of python type <class 'str'> and param type string
2021-12-07 01:26:09,800 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.update_location with value True of python type <class 'bool'> and param type boolean
2021-12-07 01:26:09,800 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.update_alignments3D with value True of python type <class 'bool'> and param type boolean
2021-12-07 01:26:09,800 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.update_alignments2D with value True of python type <class 'bool'> and param type boolean
2021-12-07 01:26:09,800 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J121.recenter_key with value alignments3D of python type <class 'str'> and param type string
2021-12-07 01:26:09,808 COMMAND.CORE clone_job WARNING | SKIPPING background task dump_job_database with 2 and 0 kwargs - already scheduled
2021-12-07 01:26:13,271 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 01:26:13,297 COMMAND.CORE run INFO | Completed task in 0.02553272247314453 seconds
2021-12-07 01:26:13,297 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 01:26:13,408 COMMAND.CORE run INFO | Completed task in 0.11115860939025879 seconds
2021-12-07 01:26:13,408 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 01:26:13,520 COMMAND.CORE run INFO | Completed task in 0.11192011833190918 seconds
2021-12-07 01:29:10,920 COMMAND.CORE scheduler_run_core INFO | Not a commercial instance - heartbeat set to 12 hours.
2021-12-07 05:52:06,843 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 05:52:06,874 COMMAND.CORE run INFO | Completed task in 0.030347108840942383 seconds
2021-12-07 05:52:06,874 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 05:52:06,974 COMMAND.CORE run INFO | Completed task in 0.10025906562805176 seconds
2021-12-07 05:52:06,975 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 05:52:07,070 COMMAND.CORE run INFO | Completed task in 0.09537911415100098 seconds
2021-12-07 05:52:26,680 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 05:52:26,786 COMMAND.CORE run INFO | Completed task in 0.0985555648803711 seconds
2021-12-07 05:52:26,786 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 05:52:26,872 COMMAND.CORE run INFO | Completed task in 0.08607673645019531 seconds
2021-12-07 05:52:26,873 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 05:52:26,881 COMMAND.CORE run INFO | Completed task in 0.008316516876220703 seconds
2021-12-07 05:52:33,862 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 05:52:34,612 COMMAND.CORE run INFO | Completed task in 0.7497513294219971 seconds
2021-12-07 05:52:34,612 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 05:52:34,619 COMMAND.CORE run INFO | Completed task in 0.0062181949615478516 seconds
2021-12-07 05:52:34,619 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 05:52:34,705 COMMAND.CORE run INFO | Completed task in 0.08632659912109375 seconds
2021-12-07 05:52:34,705 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 05:52:34,797 COMMAND.CORE run INFO | Completed task in 0.09125041961669922 seconds
2021-12-07 05:52:34,962 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 05:52:35,530 COMMAND.CORE run INFO | Completed task in 0.5676262378692627 seconds
2021-12-07 05:52:35,530 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 05:52:35,537 COMMAND.CORE run INFO | Completed task in 0.007352590560913086 seconds
2021-12-07 05:52:35,537 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 05:52:35,627 COMMAND.CORE run INFO | Completed task in 0.09013843536376953 seconds
2021-12-07 05:52:35,628 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 05:52:35,718 COMMAND.CORE run INFO | Completed task in 0.09057331085205078 seconds
2021-12-07 05:52:47,512 COMMAND.CORE scheduler_run_core INFO | Not a commercial instance - heartbeat set to 12 hours.
2021-12-07 06:22:21,008 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 06:22:21,109 COMMAND.CORE run INFO | Completed task in 0.10140323638916016 seconds
2021-12-07 06:22:21,110 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 06:22:21,198 COMMAND.CORE run INFO | Completed task in 0.08809900283813477 seconds
2021-12-07 06:22:21,198 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 06:22:21,210 COMMAND.CORE run INFO | Completed task in 0.012330293655395508 seconds
2021-12-07 06:22:25,426 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 06:22:25,429 COMMAND.CORE run INFO | Completed task in 0.002452373504638672 seconds
2021-12-07 06:22:25,429 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 06:22:25,445 COMMAND.CORE run INFO | Completed task in 0.015936851501464844 seconds
2021-12-07 06:22:25,445 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 06:22:25,542 COMMAND.CORE run INFO | Completed task in 0.09715104103088379 seconds
2021-12-07 06:22:25,542 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 06:22:25,636 COMMAND.CORE run INFO | Completed task in 0.09426617622375488 seconds
2021-12-07 06:22:27,114 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 06:22:27,117 COMMAND.CORE run INFO | Completed task in 0.0020856857299804688 seconds
2021-12-07 06:22:27,117 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 06:22:27,133 COMMAND.CORE run INFO | Completed task in 0.015598535537719727 seconds
2021-12-07 06:22:27,133 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 06:22:27,224 COMMAND.CORE run INFO | Completed task in 0.09095406532287598 seconds
2021-12-07 06:22:27,224 COMMAND.CORE run INFO | Received task layout_tree with 4 args and 0 kwargs
2021-12-07 06:22:27,307 COMMAND.CORE run INFO | Completed task in 0.08329391479492188 seconds
2021-12-07 06:22:34,683 COMPUTE.COMMON param_set_spec_value INFO | Setting parameter J123.compute_use_ssd with value False of python type <class 'bool'> and param type boolean
2021-12-07 06:22:34,689 COMMAND.CORE run INFO | Received task dump_job_database with 2 args and 0 kwargs
2021-12-07 06:22:34,707 COMMAND.CORE run INFO | Completed task in 0.01761031150817871 seconds
Please let me know if any additional information is needed.
Thanks,
Wei
##### database ######
2021-12-07T00:55:39.100-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:47190 #743 (63 connections now open)
2021-12-07T00:55:39.101-0800 I NETWORK [conn743] received client metadata from 129.22.208.37:47190 conn743: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T00:55:39.115-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:47194 #744 (64 connections now open)
2021-12-07T00:55:39.115-0800 I NETWORK [conn744] received client metadata from 129.22.208.37:47194 conn744: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:04:08.350-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:47846 #745 (65 connections now open)
2021-12-07T01:04:08.350-0800 I NETWORK [conn745] received client metadata from 129.22.208.37:47846 conn745: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:04:08.369-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:47848 #746 (66 connections now open)
2021-12-07T01:04:08.369-0800 I NETWORK [conn746] received client metadata from 129.22.208.37:47848 conn746: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:04:13.358-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:47854 #747 (67 connections now open)
2021-12-07T01:04:13.359-0800 I NETWORK [conn747] received client metadata from 129.22.208.37:47854 conn747: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:04:13.400-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:47858 #748 (68 connections now open)
2021-12-07T01:04:13.400-0800 I NETWORK [conn748] received client metadata from 129.22.208.37:47858 conn748: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:06:07.255-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:48130 #749 (69 connections now open)
2021-12-07T01:06:07.256-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:48132 #750 (70 connections now open)
2021-12-07T01:06:07.256-0800 I NETWORK [conn749] received client metadata from 129.22.208.37:48130 conn749: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:06:07.256-0800 I NETWORK [conn750] received client metadata from 129.22.208.37:48132 conn750: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:06:12.264-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:48140 #751 (71 connections now open)
2021-12-07T01:06:12.264-0800 I NETWORK [conn751] received client metadata from 129.22.208.37:48140 conn751: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:06:12.285-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:48142 #752 (72 connections now open)
2021-12-07T01:06:12.285-0800 I NETWORK [conn752] received client metadata from 129.22.208.37:48142 conn752: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:06:44.164-0800 I - [conn750] end connection 129.22.208.37:48132 (72 connections now open)
2021-12-07T01:06:44.164-0800 I - [conn752] end connection 129.22.208.37:48142 (72 connections now open)
2021-12-07T01:06:52.923-0800 I - [conn751] end connection 129.22.208.37:48140 (70 connections now open)
2021-12-07T01:06:52.923-0800 I - [conn749] end connection 129.22.208.37:48130 (70 connections now open)
2021-12-07T01:08:43.008-0800 I - [conn748] end connection 129.22.208.37:47858 (68 connections now open)
2021-12-07T01:08:43.008-0800 I - [conn746] end connection 129.22.208.37:47848 (68 connections now open)
2021-12-07T01:08:48.460-0800 I - [conn747] end connection 129.22.208.37:47854 (66 connections now open)
2021-12-07T01:08:48.460-0800 I - [conn745] end connection 129.22.208.37:47846 (66 connections now open)
2021-12-07T01:09:13.586-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:48494 #753 (65 connections now open)
2021-12-07T01:09:13.587-0800 I NETWORK [conn753] received client metadata from 129.22.208.37:48494 conn753: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:09:13.587-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:48496 #754 (66 connections now open)
2021-12-07T01:09:13.588-0800 I NETWORK [conn754] received client metadata from 129.22.208.37:48496 conn754: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:09:18.595-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:48522 #755 (67 connections now open)
2021-12-07T01:09:18.595-0800 I NETWORK [conn755] received client metadata from 129.22.208.37:48522 conn755: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:09:18.619-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:48526 #756 (68 connections now open)
2021-12-07T01:09:18.619-0800 I NETWORK [conn756] received client metadata from 129.22.208.37:48526 conn756: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:12:14.141-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:48882 #757 (69 connections now open)
2021-12-07T01:12:14.141-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:48884 #758 (70 connections now open)
2021-12-07T01:12:14.142-0800 I NETWORK [conn757] received client metadata from 129.22.208.37:48882 conn757: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:12:14.142-0800 I NETWORK [conn758] received client metadata from 129.22.208.37:48884 conn758: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:12:19.149-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:48894 #759 (71 connections now open)
2021-12-07T01:12:19.150-0800 I NETWORK [conn759] received client metadata from 129.22.208.37:48894 conn759: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:12:19.175-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:48898 #760 (72 connections now open)
2021-12-07T01:12:19.175-0800 I NETWORK [conn760] received client metadata from 129.22.208.37:48898 conn760: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:15:46.303-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:49462 #761 (73 connections now open)
2021-12-07T01:15:46.304-0800 I NETWORK [conn761] received client metadata from 129.22.208.37:49462 conn761: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:15:46.306-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:49466 #762 (74 connections now open)
2021-12-07T01:15:46.306-0800 I NETWORK [conn762] received client metadata from 129.22.208.37:49466 conn762: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:15:51.313-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:49472 #763 (75 connections now open)
2021-12-07T01:15:51.314-0800 I NETWORK [conn763] received client metadata from 129.22.208.37:49472 conn763: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:15:51.333-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:49476 #764 (76 connections now open)
2021-12-07T01:15:51.333-0800 I NETWORK [conn764] received client metadata from 129.22.208.37:49476 conn764: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:22:42.969-0800 I - [conn755] end connection 129.22.208.37:48522 (76 connections now open)
2021-12-07T01:22:42.969-0800 I - [conn753] end connection 129.22.208.37:48494 (76 connections now open)
2021-12-07T01:22:43.134-0800 I - [conn754] end connection 129.22.208.37:48496 (74 connections now open)
2021-12-07T01:22:43.134-0800 I - [conn756] end connection 129.22.208.37:48526 (74 connections now open)
2021-12-07T01:23:19.545-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:50474 #765 (73 connections now open)
2021-12-07T01:23:19.545-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:50476 #766 (74 connections now open)
2021-12-07T01:23:19.545-0800 I NETWORK [conn765] received client metadata from 129.22.208.37:50474 conn765: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:23:19.545-0800 I NETWORK [conn766] received client metadata from 129.22.208.37:50476 conn766: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:23:24.553-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:50490 #767 (75 connections now open)
2021-12-07T01:23:24.553-0800 I NETWORK [conn767] received client metadata from 129.22.208.37:50490 conn767: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:23:24.574-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:50494 #768 (76 connections now open)
2021-12-07T01:23:24.574-0800 I NETWORK [conn768] received client metadata from 129.22.208.37:50494 conn768: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:29:02.172-0800 I - [conn744] end connection 129.22.208.37:47194 (76 connections now open)
2021-12-07T01:29:02.172-0800 I - [conn741] end connection 129.22.208.37:47180 (76 connections now open)
2021-12-07T01:29:07.874-0800 I - [conn743] end connection 129.22.208.37:47190 (74 connections now open)
2021-12-07T01:29:07.874-0800 I - [conn742] end connection 129.22.208.37:47184 (74 connections now open)
2021-12-07T01:29:31.976-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:51258 #769 (73 connections now open)
2021-12-07T01:29:31.977-0800 I NETWORK [conn769] received client metadata from 129.22.208.37:51258 conn769: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:29:31.977-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:51260 #770 (74 connections now open)
2021-12-07T01:29:31.978-0800 I NETWORK [conn770] received client metadata from 129.22.208.37:51260 conn770: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:29:36.985-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:51274 #771 (75 connections now open)
2021-12-07T01:29:36.985-0800 I NETWORK [conn771] received client metadata from 129.22.208.37:51274 conn771: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:29:37.009-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:51278 #772 (76 connections now open)
2021-12-07T01:29:37.009-0800 I NETWORK [conn772] received client metadata from 129.22.208.37:51278 conn772: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T01:51:12.973-0800 I - [conn758] end connection 129.22.208.37:48884 (76 connections now open)
2021-12-07T01:51:12.973-0800 I - [conn760] end connection 129.22.208.37:48898 (75 connections now open)
2021-12-07T01:51:19.360-0800 I - [conn759] end connection 129.22.208.37:48894 (74 connections now open)
2021-12-07T01:51:19.360-0800 I - [conn757] end connection 129.22.208.37:48882 (74 connections now open)
2021-12-07T01:54:21.487-0800 I - [conn761] end connection 129.22.208.37:49462 (72 connections now open)
2021-12-07T01:54:21.487-0800 I - [conn764] end connection 129.22.208.37:49476 (72 connections now open)
2021-12-07T01:54:26.969-0800 I - [conn763] end connection 129.22.208.37:49472 (70 connections now open)
2021-12-07T01:54:26.969-0800 I - [conn762] end connection 129.22.208.37:49466 (70 connections now open)
2021-12-07T02:51:29.590-0800 I - [conn769] end connection 129.22.208.37:51258 (68 connections now open)
2021-12-07T02:51:29.590-0800 I - [conn772] end connection 129.22.208.37:51278 (68 connections now open)
2021-12-07T02:51:35.474-0800 I - [conn771] end connection 129.22.208.37:51274 (66 connections now open)
2021-12-07T02:51:35.474-0800 I - [conn770] end connection 129.22.208.37:51260 (66 connections now open)
2021-12-07T05:53:08.688-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:39884 #773 (65 connections now open)
2021-12-07T05:53:08.689-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:39886 #774 (66 connections now open)
2021-12-07T05:53:08.689-0800 I NETWORK [conn773] received client metadata from 129.22.208.37:39884 conn773: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T05:53:08.689-0800 I NETWORK [conn774] received client metadata from 129.22.208.37:39886 conn774: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T05:53:13.697-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:39896 #775 (67 connections now open)
2021-12-07T05:53:13.697-0800 I NETWORK [conn775] received client metadata from 129.22.208.37:39896 conn775: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T05:53:13.719-0800 I NETWORK [thread1] connection accepted from 129.22.208.37:39898 #776 (68 connections now open)
2021-12-07T05:53:13.719-0800 I NETWORK [conn776] received client metadata from 129.22.208.37:39898 conn776: { driver: { name: "PyMongo", version: "3.11.0" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "3.10.0-1160.36.2.el7.x86_64" }, platform: "CPython 3.7.9.final.0" }
2021-12-07T05:56:33.957-0800 I - [conn774] end connection 129.22.208.37:39886 (68 connections now open)
2021-12-07T05:56:33.957-0800 I - [conn776] end connection 129.22.208.37:39898 (68 connections now open)
2021-12-07T05:56:39.704-0800 I - [conn775] end connection 129.22.208.37:39896 (66 connections now open)
2021-12-07T05:56:39.704-0800 I - [conn773] end connection 129.22.208.37:39884 (65 connections now open)
##### webapp #####
download result /data/cryosparc/P54/J114/cryosparc_P54_J114_class_01_00100_volume.mrc
==== [workspace] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [workspace] project query user 5f870d36ba6f831754907f85 Wei Huang true
delete_job
{"project_uid":"P54","job_uid":"J121"}
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [workspace] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
set_user_viewed_workspace
["5f870d36ba6f831754907f85","P54","W1"]
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [workspace] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
[PUB] job.events.checkpoints: { project_uid: 'P54', job_uid: 'J120', type: 'checkpoint' }
set_user_viewed_job
["5f870d36ba6f831754907f85","P54","W1","J120"]
[PUB] job.events: { project_uid: 'P54', job_uid: 'J120' } 100 0
[PUB] events.countAfterCheckpoint
[PUB] job.events: { project_uid: 'P54',
job_uid: 'J120',
created_at: { '$gt': 2021-12-07T10:51:00.920Z } } 100 0
[PUB] events.countAfterCheckpoint
create_new_job
{"job_type":"var_3D_disp","project_uid":"P54","workspace_uid":"W1","created_by_user_id":"5f870d36ba6f831754907f85"}
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
job_connect_group
{"project_uid":"P54","source_group":"J120.particles","dest_group":"J122.particles"}
job_connect_group
{"project_uid":"P54","source_group":"J120.volume","dest_group":"J122.volume"}
enqueue_job
{"project_uid":"P54","job_uid":"J122","lane":"default"}
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [workspace] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
[PUB] job.events.checkpoints: { project_uid: 'P54', job_uid: 'J122', type: 'checkpoint' }
[PUB] job.events: { project_uid: 'P54', job_uid: 'J122' } 100 0
[PUB] events.countAfterCheckpoint
==== [workspace] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [workspace] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
[PUB] job.events.checkpoints: { project_uid: 'P54', job_uid: 'J114', type: 'checkpoint' }
set_user_viewed_job
["5f870d36ba6f831754907f85","P54","W1","J114"]
[PUB] job.events: { project_uid: 'P54', job_uid: 'J114' } 100 0
[PUB] events.countAfterCheckpoint
[PUB] job.events: { project_uid: 'P54',
job_uid: 'J114',
created_at: { '$gt': 2021-12-07T13:59:42.814Z } } 100 0
[PUB] events.countAfterCheckpoint
create_new_job
{"job_type":"nonuniform_refine_new","project_uid":"P54","workspace_uid":"W1","created_by_user_id":"5f870d36ba6f831754907f85"}
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
job_connect_group
{"project_uid":"P54","source_group":"J114.particles_class_1","dest_group":"J123.particles"}
job_connect_group
{"project_uid":"P54","source_group":"J114.volume_class_1","dest_group":"J123.volume"}
job_set_param
["P54","J123","compute_use_ssd",false]
enqueue_job
{"project_uid":"P54","job_uid":"J123","lane":"default"}
[PUB] job.events: { project_uid: 'P54',
job_uid: 'J114',
created_at: { '$gt': 2021-12-07T13:59:42.814Z } } 200 0
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [workspace] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
[PUB] job.events.checkpoints: { project_uid: 'P54', job_uid: 'J123', type: 'checkpoint' }
[PUB] job.events: { project_uid: 'P54', job_uid: 'J123' } 200 0
[PUB] events.countAfterCheckpoint
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
==== [jobs] project query user 5f870d36ba6f831754907f85 Wei Huang true
[PUB] job.events.checkpoints: { project_uid: 'P54', job_uid: 'J114', type: 'checkpoint' }
set_user_viewed_job
["5f870d36ba6f831754907f85","P54","W1","J114"]
[PUB] job.events: { project_uid: 'P54', job_uid: 'J114' } 100 0
[PUB] events.countAfterCheckpoint
[PUB] job.events: { project_uid: 'P54',
job_uid: 'J114',
created_at: { '$gt': 2021-12-07T13:59:42.814Z } } 100 0
[PUB] events.countAfterCheckpoint
[PUB] job.events: { project_uid: 'P54',
job_uid: 'J114',
created_at: { '$gt': 2021-12-07T13:59:42.814Z } } 200 0
[PUB] job.events: { project_uid: 'P54',
job_uid: 'J114',
created_at: { '$gt': 2021-12-07T13:59:42.814Z } } 223 0
#### END #####
Hi @wxh180
Thank you for the screenshot and log files. I don’t see anything that would suggest an issue in any of them. The next time you experience a lag in the user interface, could you please report if there are any errors in the browser console? To see this, right click anywhere in the web application, select ‘Inspect Element’ and select the ‘Console’ tab within the browser development tools that opens up.
- Suhail