Cryosparc won't start after migrating the database to a new location

Yehuda · April 9, 2024, 4:24pm

After I moved the database from a 100% full disk to a new location by
rsync -r --links /home/cryosparc_user/cryosparc_database /data/sparc/
cryosparc does not start

cryosparcm start
Starting cryoSPARC System master process…
CryoSPARC is not already running.
configuring database
Warning: Could not get database status (attempt 1/3)
Warning: Could not get database status (attempt 2/3)
Warning: Could not get database status (attempt 3/3)
Traceback (most recent call last):
File “”, line 1, in
File “/home/cryosparc_user/cryosparc_master/cryosparc_compute/database_management.py”, line 49, in configure_mongo
initialize_replica_set()
File “/home/cryosparc_user/cryosparc_master/cryosparc_compute/database_management.py”, line 88, in initialize_replica_set
admin_db = try_get_pymongo_db(mongo_client)
File “/home/cryosparc_user/cryosparc_master/cryosparc_compute/database_management.py”, line 251, in try_get_pymongo_db
admin_db.command(({‘serverStatus’: 1}))
File “/home/cryosparc_user/cryosparc_master/deps/anaconda/envs/cryosparc_master_env/lib/python3.8/site-packages/pymongo/database.py”, line 827, in command
with self.__client._socket_for_reads(read_preference, session) as (sock_info, secondary_ok):
File “/home/cryosparc_user/cryosparc_master/deps/anaconda/envs/cryosparc_master_env/lib/python3.8/contextlib.py”, line 113, in enter
return next(self.gen)
File “/home/cryosparc_user/cryosparc_master/deps/anaconda/envs/cryosparc_master_env/lib/python3.8/site-packages/pymongo/mongo_client.py”, line 1478, in _socket_for_reads
server = self._select_server(read_preference, session)
File “/home/cryosparc_user/cryosparc_master/deps/anaconda/envs/cryosparc_master_env/lib/python3.8/site-packages/pymongo/mongo_client.py”, line 1436, in _select_server
server = topology.select_server(server_selector)
File “/home/cryosparc_user/cryosparc_master/deps/anaconda/envs/cryosparc_master_env/lib/python3.8/site-packages/pymongo/topology.py”, line 250, in select_server
return random.choice(self.select_servers(selector, server_selection_timeout, address))
File “/home/cryosparc_user/cryosparc_master/deps/anaconda/envs/cryosparc_master_env/lib/python3.8/site-packages/pymongo/topology.py”, line 211, in select_servers
server_descriptions = self._select_servers_loop(selector, server_timeout, address)
File “/home/cryosparc_user/cryosparc_master/deps/anaconda/envs/cryosparc_master_env/lib/python3.8/site-packages/pymongo/topology.py”, line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:39001: [Errno 111] Connection refused, Timeout: 20.0s, Topology Description: <TopologyDescription id: 66156a50df82c3da4d5d510a, topology_type: Single, servers: [<ServerDescription (‘localhost’, 39001) server_type: Unknown, rtt: None, error=AutoReconnect(‘localhost:39001: [Errno 111] Connection refused’)>]>
[2024-04-09T12:19:35-0400] Error configuring database. Most recent database log lines:
mongod(wiredtiger_open+0x1BBA) [0x563c29656c8a]
mongod(_ZN5mongo18WiredTigerKVEngineC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mmbbbb+0x8D6) [0x563c29623cf6]
mongod(+0xA25AEC) [0x563c29605aec]
mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x266) [0x563c29815fb6]
mongod(+0xA025B8) [0x563c295e25b8]
mongod(ZN5mongo11mongoDbMainEiPPcS1+0x26C) [0x563c295e563c]
mongod(main+0x9) [0x563c2956bbc9]
libc.so.6(__libc_start_main+0xF5) [0x7f6c1be333d5]
mongod(+0x9ED741) [0x563c295cd741]
----- END BACKTRACE -----

Please advise.

Thank you,

Yehuda

wtempel · April 9, 2024, 4:32pm

@Yehuda Please can you also post the output of the command

cryosparcm log database | tail -n 40

Yehuda · April 9, 2024, 4:35pm

cryosparcm log database | tail -n 40
2024-04-09T12:18:22.169-0400 F - [initandlisten] Got signal: 6 (Aborted).

0x563c2ae85f21 0x563c2ae85139 0x563c2ae8561d 0x7f6c1c1ed5d0 0x7f6c1be47207 0x7f6c1be488f8 0x563c29569dec 0x563c29644d76 0x563c296b6ad1 0x563c29506a94 0x563c29506eb4 0x563c2976d3b5 0x563c2978bd6f 0x563c2978c2cb 0x563c297886b5 0x563c2976ca57 0x563c296ded5e 0x563c296583f2 0x563c296b53bd 0x563c296b599d 0x563c296b5c2c 0x563c29727e52 0x563c296b0ec8 0x563c2967797e 0x563c29677a5b 0x563c29656c8a 0x563c29623cf6 0x563c29605aec 0x563c29815fb6 0x563c295e25b8 0x563c295e563c 0x563c2956bbc9 0x7f6c1be333d5 0x563c295cd741
----- BEGIN BACKTRACE -----
{“backtrace”:[{“b”:“563C28BE0000”,“o”:“22A5F21”,“s”:“_ZN5mongo15printStackTraceERSo”},{“b”:“563C28BE0000”,“o”:“22A5139”},{“b”:“563C28BE0000”,“o”:“22A561D”},{“b”:“7F6C1C1DE000”,“o”:“F5D0”},{“b”:“7F6C1BE11000”,“o”:“36207”,“s”:“gsignal”},{“b”:“7F6C1BE11000”,“o”:“378F8”,“s”:“abort”},{“b”:“563C28BE0000”,“o”:“989DEC”,“s”:“_ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj”},{“b”:“563C28BE0000”,“o”:“A64D76”},{“b”:“563C28BE0000”,“o”:“AD6AD1”},{“b”:“563C28BE0000”,“o”:“926A94”,“s”:“__wt_err_func”},{“b”:“563C28BE0000”,“o”:“926EB4”,“s”:“__wt_panic”},{“b”:“563C28BE0000”,“o”:“B8D3B5”,“s”:“__wt_block_read_off”},{“b”:“563C28BE0000”,“o”:“BABD6F”,“s”:“__wt_block_extlist_read”},{“b”:“563C28BE0000”,“o”:“BAC2CB”,“s”:“__wt_block_extlist_read_avail”},{“b”:“563C28BE0000”,“o”:“BA86B5”,“s”:“__wt_block_checkpoint_load”},{“b”:“563C28BE0000”,“o”:“B8CA57”},{“b”:“563C28BE0000”,“o”:“AFED5E”,“s”:“__wt_btree_open”},{“b”:“563C28BE0000”,“o”:“A783F2”,“s”:“__wt_conn_dhandle_open”},{“b”:“563C28BE0000”,“o”:“AD53BD”,“s”:“__wt_session_get_dhandle”},{“b”:“563C28BE0000”,“o”:“AD599D”,“s”:“__wt_session_get_dhandle”},{“b”:“563C28BE0000”,“o”:“AD5C2C”,“s”:“__wt_session_get_btree_ckpt”},{“b”:“563C28BE0000”,“o”:“B47E52”,“s”:“__wt_curfile_open”},{“b”:“563C28BE0000”,“o”:“AD0EC8”},{“b”:“563C28BE0000”,“o”:“A9797E”,“s”:“__wt_metadata_cursor_open”},{“b”:“563C28BE0000”,“o”:“A97A5B”,“s”:“__wt_metadata_cursor”},{“b”:“563C28BE0000”,“o”:“A76C8A”,“s”:“wiredtiger_open”},{“b”:“563C28BE0000”,“o”:“A43CF6”,“s”:“_ZN5mongo18WiredTigerKVEngineC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mmbbbb”},{“b”:“563C28BE0000”,“o”:“A25AEC”},{“b”:“563C28BE0000”,“o”:“C35FB6”,“s”:“_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv”},{“b”:“563C28BE0000”,“o”:“A025B8”},{“b”:“563C28BE0000”,“o”:“A0563C”,“s”:“ZN5mongo11mongoDbMainEiPPcS1”},{“b”:“563C28BE0000”,“o”:“98BBC9”,“s”:“main”},{“b”:“7F6C1BE11000”,“o”:“223D5”,“s”:“__libc_start_main”},{“b”:“563C28BE0000”,“o”:“9ED741”}],“processInfo”:{ “mongodbVersion” : “3.6.23”, “gitVersion” : “d352e6a4764659e0d0350ce77279de3c1f243e5c”, “compiledModules” : , “uname” : { “sysname” : “Linux”, “release” : “3.10.0-957.12.2.el7.x86_64”, “version” : “#1 SMP Tue May 14 21:24:32 UTC 2019”, “machine” : “x86_64” }, “somap” : [ { “b” : “563C28BE0000”, “elfType” : 3, “buildId” : “B0818C001F2B63D4533D208F68F08AE2A599CA9E” }, { “b” : “7FFCBA0F8000”, “elfType” : 3, “buildId” : “D149FABD4DF969958863221F946E26C130432B47” }, { “b” : “7F6C1CF37000”, “path” : “/home/cryosparc_user/cryosparc_master/deps/anaconda/envs/cryosparc_master_env/lib/libpython3.8.so”, “elfType” : 3 }, { “b” : “7F6C1CD1E000”, “path” : “/lib64/libresolv.so.2”, “elfType” : 3, “buildId” : “C444AE61E7CBB716FD9C18A0B46A7FE8F4FCF3E5” }, { “b” : “7F6C1CB16000”, “path” : “/lib64/librt.so.1”, “elfType” : 3, “buildId” : “EFDE2029C9A4A20BE5B8D8AE7E6551FF9B5755D2” }, { “b” : “7F6C1C912000”, “path” : “/lib64/libdl.so.2”, “elfType” : 3, “buildId” : “357693C8F1F49D93010C4E31529C07CDD2BD3D08” }, { “b” : “7F6C1C610000”, “path” : “/lib64/libm.so.6”, “elfType” : 3, “buildId” : “5B14BE4D749631673523A61074C10959D50F5455” }, { “b” : “7F6C1C3FA000”, “path” : “/lib64/libgcc_s.so.1”, “elfType” : 3, “buildId” : “179F202998E429AA1215907F6D4C5C1BB9C90136” }, { “b” : “7F6C1C1DE000”, “path” : “/lib64/libpthread.so.0”, “elfType” : 3, “buildId” : “96900CB0FF25B26F2BBDF247DE1408242E4773D8” }, { “b” : “7F6C1BE11000”, “path” : “/lib64/libc.so.6”, “elfType” : 3, “buildId” : “EB9F22A3891E5FD3494DFD9ED199E20AE71BB08D” }, { “b” : “7F6C1D289000”, “path” : “/lib64/ld-linux-x86-64.so.2”, “elfType” : 3, “buildId” : “A527FE72908703C5972AE384E78D1850D1881EE7” }, { “b” : “7F6C1BC0E000”, “path” : “/lib64/libutil.so.1”, “elfType” : 3, “buildId” : “BFB22A176189006BBF996A7664CCC6BDB2EB9BD9” } ] }}
mongod(_ZN5mongo15printStackTraceERSo+0x41) [0x563c2ae85f21]
mongod(+0x22A5139) [0x563c2ae85139]
mongod(+0x22A561D) [0x563c2ae8561d]
libpthread.so.0(+0xF5D0) [0x7f6c1c1ed5d0]
libc.so.6(gsignal+0x37) [0x7f6c1be47207]
libc.so.6(abort+0x148) [0x7f6c1be488f8]
mongod(_ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj+0x0) [0x563c29569dec]
mongod(+0xA64D76) [0x563c29644d76]
mongod(+0xAD6AD1) [0x563c296b6ad1]
mongod(__wt_err_func+0x90) [0x563c29506a94]
mongod(__wt_panic+0x3F) [0x563c29506eb4]
mongod(__wt_block_read_off+0x585) [0x563c2976d3b5]
mongod(__wt_block_extlist_read+0x8F) [0x563c2978bd6f]
mongod(__wt_block_extlist_read_avail+0x2B) [0x563c2978c2cb]
mongod(__wt_block_checkpoint_load+0x275) [0x563c297886b5]
mongod(+0xB8CA57) [0x563c2976ca57]
mongod(__wt_btree_open+0xD7E) [0x563c296ded5e]
mongod(__wt_conn_dhandle_open+0x352) [0x563c296583f2]
mongod(__wt_session_get_dhandle+0xED) [0x563c296b53bd]
mongod(__wt_session_get_dhandle+0x6CD) [0x563c296b599d]
mongod(__wt_session_get_btree_ckpt+0x14C) [0x563c296b5c2c]
mongod(__wt_curfile_open+0x52) [0x563c29727e52]
mongod(+0xAD0EC8) [0x563c296b0ec8]
mongod(__wt_metadata_cursor_open+0x6E) [0x563c2967797e]
mongod(__wt_metadata_cursor+0x4B) [0x563c29677a5b]
mongod(wiredtiger_open+0x1BBA) [0x563c29656c8a]
mongod(_ZN5mongo18WiredTigerKVEngineC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mmbbbb+0x8D6) [0x563c29623cf6]
mongod(+0xA25AEC) [0x563c29605aec]
mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x266) [0x563c29815fb6]
mongod(+0xA025B8) [0x563c295e25b8]
mongod(ZN5mongo11mongoDbMainEiPPcS1+0x26C) [0x563c295e563c]
mongod(main+0x9) [0x563c2956bbc9]
libc.so.6(__libc_start_main+0xF5) [0x7f6c1be333d5]
mongod(+0x9ED741) [0x563c295cd741]
----- END BACKTRACE -----

wtempel · April 9, 2024, 4:48pm

Thanks.

Please can you additionally post the database log entries from around that precede the line

within a few seconds and that should include a specific error.

Yehuda · April 9, 2024, 5:01pm

00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2024-04-09T12:18:22.148-0400 E STORAGE [initandlisten] WiredTiger error (-31802) [1712679502:148267][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_block_read_off, 302: WiredTiger.wt: fatal read error: WT_ERROR: non-specific WiredTiger error Raw: [1712679502:148267][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_block_read_off, 302: WiredTiger.wt: fatal read error: WT_ERROR: non-specific WiredTiger error
2024-04-09T12:18:22.148-0400 E STORAGE [initandlisten] WiredTiger error (-31804) [1712679502:148275][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_panic, 523: the process must exit and restart: WT_PANIC: WiredTiger library panic Raw: [1712679502:148275][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_panic, 523: the process must exit and restart: WT_PANIC: WiredTiger library panic
2024-04-09T12:18:22.148-0400 F - [initandlisten] Fatal Assertion 50853 at src/mongo/db/storage/wiredtiger/wiredtiger_util.cpp 420
2024-04-09T12:18:22.148-0400 F - [initandlisten] \n\n***aborting after fassert() failure\n\n
2024-04-09T12:18:22.169-0400 F - [initandlisten] Got signal: 6 (Aborted).

wtempel · April 9, 2024, 7:12pm

@Yehuda Is there additional relevant information above that (possibly long) sequence of zeroes?

Yehuda · April 9, 2024, 8:32pm

2024-04-09T12:18:21.543-0400 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=353970M,cache_overflow=(file_max=0M),session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),compatibility=(release=“3.0”,require_max=“3.0”),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),statistics_log=(wait=0),verbose=(recovery_progress),
2024-04-09T12:18:22.147-0400 E STORAGE [initandlisten] WiredTiger error (0) [1712679502:147596][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_block_read_off, 291: WiredTiger.wt: read checksum error for 4096B block at offset 147456: block header checksum of 809334881 doesn’t match expected checksum of 2553729618 Raw: [1712679502:147596][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_block_read_off, 291: WiredTiger.wt: read checksum error for 4096B block at offset 147456: block header checksum of 809334881 doesn’t match expected checksum of 2553729618
2024-04-09T12:18:22.147-0400 E STORAGE [initandlisten] WiredTiger error (0) [1712679502:147775][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_bm_corrupt_dump, 144: {147456, 4096, 2553729618}: (chunk 1 of 4): 63 61 63 68 65 5f 73 69 7a 65 3d 66 61 6c 73 65 2c 69 6e 74 65 72 6e 61 6c 5f 69 74 65 6d 5f 6d 61 78 3d 30 2c 69 6e 74 65 72 6e 61 6c 5f 6b 65 79 5f 6d 61 78 3d 30 2c 69 6e 74 65 72 6e 61 6c 5f 6b 65 79 5f 74 72 75 6e 63 61 74 65 3d 74 72 75 65 2c 69 6e 74 65 72 6e 61 6c 5f 70 61 67 65 5f 6d 61 78 3d 31 36 6b 2c 6b 65 79 5f 66 6f 72 6d 61 74 3d 75 2c 6b 65 79 5f 67 61 70 3d 31 30 2c 6c 65 61 66 5f 69 74 65 6d 5f 6d 61 78 3d 30 2c 6c 65 61 66 5f 6b 65 79 5f 6d 61 78 3d 30 2c 6c 65 61 66 5f 70 61 67 65 5f 6d 61 78 3d 31 36 6b 2c 6c 65 61 66 5f 76 61 6c 75 65 5f 6d 61 78 3d 30 2c 6c 6f 67 3d 28 65 6e 61 62 6c 65 64 3d 74 72 75 65 29 2c 6d 65 6d 6f 72 79 5f 70 61 67 65 5f 6d 61 78 3d 35 4d 42 2c 6f 73 5f 63 61 63 68 65 5f 64 69 72 74 79 5f 6d 61 78 3d 30 2c 6f 73 5f 63 61 63 68 65 5f 6d 61 78 3d 30 2c 70 72 65 66 69 78 5f 63 6f 6d 70 72 65 73 73 69 6f 6e 3d 74 72 75 65 2c 70 72 65 66 69 78 5f 63 6f 6d 70 72 65 73 73 69 6f 6e 5f 6d 69 6e 3d 34 2c 73 70 6c 69 74 5f 64 65 65 70 65 6e 5f 6d 69 6e 5f 63 68 69 6c 64 3d 30 2c 73 70 6c 69 74 5f 64 65 65 70 65 6e 5f 70 65 72 5f 63 68 69 6c 64 3d 30 2c 73 70 6c 69 74 5f 70 63 74 3d 39 30 2c 76 61 6c 75 65 5f 66 6f 72 6d 61 74 3d 75 2c 76 65 72 73 69 6f 6e 3d 28 6d 61 6a 6f 72 3d 31 2c 6d 69 6e 6f 72 3d 31 29 00 95 66 69 6c 65 3a 69 6e 64 65 78 2d 34 36 2d 31 38 31 38 34 38 31 35 36 37 30 34 38 37 39 36 32 31 39 2e 77 74 00 80 c3 5c 61 63 63 65 73 73 5f 70 61 74 74 65 72 6e 5f 68 69 6e 74 3d 6e 6f 6e 65 2c 61 6c 6c 6f 63 61 74 69 6f 6e 5f 73 69 7a 65 3d 34 4b 42 2c 61 70 70 5f 6d 65 74 61 64 61 74 61 3d 28 66 6f 72 6d 61 74 56 65 72 73 69 6f 6e 3d 38 2c 69 6e 66 6f 4f 62 6a 3d 7b 20 22 76 22 20 3a 20 32 2c 20 22 75 6e 69 71 75 65 22 20 3a 20 74 72 75 65 2c 20 22 6b 65 79 22 20 3a 20 7b 20 22 68 6f 73 74 6e 61 6d 65 22 20 3a 20 31 2c 20 22 6b 65 79 22 20 3a 20 31 20 7d 2c 20 22 6e 61 6d 65 22 20 3a 20 22 68 6f 73 74 6e 61 6d 65 5f 31 5f 6b 65 79 5f 31 22 2c 20 22 6e 73 22 20 3a 20 22 6d 65 74 65 6f 72 2e 63 61 63 68 65 5f 66 69 6c 65 73 22 20 7d 29 2c 62 6c 6f 63 6b 5f 61 6c 6c 6f 63 61 74 69 6f 6e 3d 62 65 73 74 2c 62 6c 6f 63 6b 5f 63 6f 6d 70 72 65 73 73 6f 72 3d 2c 63 61 63 68 65 5f 72 65 73 69 64 65 6e 74 3d 66 61 6c 73 65 2c 63 68 65 63 6b 70 6f 69 6e 74 3d 28 57 69 72 65 64 54 69 67 65 72 43 68 65 63 6b 70 6f 69 6e 74 2e 31 3d 28 61 64 64 72 3d 22 30 31 38 30 38 30 38 30 38 30 38 30 38 30 38 30 38 30 38 30 38 30 38 30 38 30 63 66 63 30 38 30 22 2c 6f 72 64 65 72 3d 31 2c 74 69 6d 65 3d 31 36 31 34 36 33 35 32 33 38 2c 73 69 7a 65 3d 30 2c 77 72 69 74 65 5f 67 65 6e 3d 30 29 29 2c 63 68 65 63 6b 70 6f 69 6e 74 5f 6c 73 6e 3d 28 34 32 39 34 39 36 37 32 39 35 2c 32 31 34 37 34 38 33 36 34 37 29 2c 63 68 65 63 6b 73 75 6d 3d 6f 6e 2c 63 6f 6c 6c 61 74 6f 72 3d 2c 63 6f 6c 75 6d 6e 73 3d 2c 64 69 63 74 69 6f 6e 61 72 79 3d 30 2c 65 6e 63 72 79 70 74 69 6f 6e 3d 28 6b 65 79 69 64 3d 2c 6e 61 6d 65 3d 29 2c 66 6f 72 6d 61 74 3d 62 74 72 65 65 2c 68 75 66 66 6d 61 6e 5f 6b 65 79 3d 2c 68 75 66 66 6d 61 6e 5f 76 61 6c 75 65 3d 2c 69 64 3d 35 30 2c 69 67 6e 6f 72 65 5f 69 6e 5f 6d 65 Raw: [1712679502:147775][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_bm_corrupt_dump, 144: {147456, 4096, 2553729618}: (chunk 1 of 4): 63 61 63 68 65 5f 73 69 7a 65 3d 66 61 6c 73 65 2c 69 6e 74 65 72 6e 61 6c 5f 69 74 65 6d 5f 6d 61 78 3d 30 2c 69 6e 74 65 72 6e 61 6c 5f 6b 65 79 5f 6d 61 78 3d 30 2c 69 6e 74 65 72 6e 61 6c 5f 6b 65 79 5f 74 72 75 6e 63 61 74 65 3d 74 72 75 65 2c 69 6e 74 65 72 6e 61 6c 5f 70 61 67 65 5f 6d 61 78 3d 31 36 6b 2c 6b 65 79 5f 66 6f 72 6d 61 74 3d 75 2c 6b 65 79 5f 67 61 70 3d 31 30 2c 6c 65 61 66 5f 69 74 65 6d 5f 6d 61 78 3d 30 2c 6c 65 61 66 5f 6b 65 79 5f 6d 61 78 3d 30 2c 6c 65 61 66 5f 70 61 67 65 5f 6d 61 78 3d 31 36 6b 2c 6c 65 61 66 5f 76 61 6c 75 65 5f 6d 61 78 3d 30 2c 6c 6f 67 3d 28 65 6e 61 62 6c 65 64 3d 74 72 75 65 29 2c 6d 65 6d 6f 72 79 5f 70 61 67 65 5f 6d 61 78 3d 35 4d 42 2c 6f 73 5f 63 61 63 68 65 5f 64 69 72 74 79 5f 6d 61 78 3d 30 2c 6f 73 5f 63 61 63 68 65 5f 6d 61 78 3d 30 2c 70 72 65 66 69 78 5f 63 6f 6d 70 72 65 73 73 69 6f 6e 3d 74 72 75 65 2c 70 72 65 66 69 78 5f 63 6f 6d 70 72 65 73 73 69 6f 6e 5f 6d 69 6e 3d 34 2c 73 70 6c 69 74 5f 64 65 65 70 65 6e 5f 6d 69 6e 5f 63 68 69 6c 64 3d 30 2c 73 70 6c 69 74 5f 64 65 65 70 65 6e 5f 70 65 72 5f 63 68 69 6c 64 3d 30 2c 73 70 6c 69 74 5f 70 63 74 3d 39 30 2c 76 61 6c 75 65 5f 66 6f 72 6d 61 74 3d 75 2c 76 65 72 73 69 6f 6e 3d 28 6d 61 6a 6f 72 3d 31 2c 6d 69 6e 6f 72 3d 31 29 00 95 66 69 6c 65 3a 69 6e 64 65 78 2d 34 36 2d 31 38 31 38 34 38 31 35 36 37 30 34 38 37 39 36 32 31 39 2e 77 74 00 80 c3 5c 61 63 63 65 73 73 5f 70 61 74 74 65 72 6e 5f 68 69 6e 74 3d 6e 6f 6e 65 2c 61 6c 6c 6f 63 61 74 69 6f 6e 5f 73 69 7a 65 3d 34 4b 42 2c 61 70 70 5f 6d 65 74 61 64 61 74 61 3d 28 66 6f 72 6d 61 74 56 65 72 73 69 6f 6e 3d 38 2c 69 6e 66 6f 4f 62 6a 3d 7b 20 22 76 22 20 3a 20 32 2c 20 22 75 6e 69 71 75 65 22 20 3a 20 74 72 75 65 2c 20 22 6b 65 79 22 20 3a 20 7b 20 22 68 6f 73 74 6e 61 6d 65 22 20 3a 20 31 2c 20 22 6b 65 79 22 20 3a 20 31 20 7d 2c 20 22 6e 61 6d 65 22 20 3a 20 22 68 6f 73 74 6e 61 6d 65 5f 31 5f 6b 65 79 5f 31 22 2c 20 22 6e 73 22 20 3a 20 22 6d 65 74 65 6f 72 2e 63 61 63 68 65 5f 66 69 6c 65 73 22 20 7d 29 2c 62 6c 6f 63 6b 5f 61 6c 6c 6f 63 61 74 69 6f 6e 3d 62 65 73 74 2c 62 6c 6f 63 6b 5f 63 6f 6d 70 72 65 73 73 6f 72 3d 2c 63 61 63 68 65 5f 72 65 73 69 64 65 6e 74 3d 66 61 6c 73 65 2c 63 68 65 63 6b 70 6f 69 6e 74 3d 28 57 69 72 65 64 54 69 67 65 72 43 68 65 63 6b 70 6f 69 6e 74 2e 31 3d 28 61 64 64 72 3d 22 30 31 38 30 38 30 38 30 38 30 38 30 38 30 38 30 38 30 38 30 38 30 38 30 38 30 63 66 63 30 38 30 22 2c 6f 72 64 65 72 3d 31 2c 74 69 6d 65 3d 31 36 31 34 36 33 35 32 33 38 2c 73 69 7a 65 3d 30 2c 77 72 69 74 65 5f 67 65 6e 3d 30 29 29 2c 63 68 65 63 6b 70 6f 69 6e 74 5f 6c 73 6e 3d 28 34 32 39 34 39 36 37 32 39 35 2c 32 31 34 37 34 38 33 36 34 37 29 2c 63 68 65 63 6b 73 75 6d 3d 6f 6e 2c 63 6f 6c 6c 61 74 6f 72 3d 2c 63 6f 6c 75 6d 6e 73 3d 2c 64 69 63 74 69 6f 6e 61 72 79 3d 30 2c 65 6e 63 72 79 70 74 69 6f 6e 3d 28 6b 65 79 69 64 3d 2c 6e 61 6d 65 3d 29 2c 66 6f 72 6d 61 74 3d 62 74 72 65 65 2c 68 75 66 66 6d 61 6e 5f 6b 65 79 3d 2c 68 75 66 66 6d 61 6e 5f 76 61 6c 75 65 3d 2c 69 64 3d 35 30 2c 69 67 6e 6f 72 65 5f 69 6e 5f 6d 65
2024-04-09T12:18:22.147-0400 E STORAGE [initandlisten] WiredTiger error (0) [1712679502:147945][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_bm_corrupt_dump, 144: {147456, 4096, 2553729618}: (chunk 2 of 4): 6d 6f 72 79 5f 63 61 63 68 65 5f 73 69 7a 65 3d 66 61 6c 73 65 2c 69 6e 74 65 72 6e 61 6c 5f 69 74 65 6d 5f 6d 61 78 3d 30 2c 69 6e 74 65 72 6e 61 6c 5f 6b 65 79 5f 6d 61 78 3d 30 2c 69 6e 74 65 72 6e 61 6c 5f 6b 65 79 5f 74 72 75 6e 63 61 74 65 3d 74 72 75 65 2c 69 6e 74 65 72 6e 61 6c 5f 70 61 67 65 5f 6d 61 78 3d 31 36 6b 2c 6b 65 79 5f 66 6f 72 6d 61 74 3d 75 2c 6b 65 79 5f 67 61 70 3d 31 30 2c 6c 65 61 66 5f 69 74 65 6d 5f 6d 61 78 3d 30 2c 6c 65 61 66 5f 6b 65 79 5f 6d 61 78 3d 30 2c 6c 65 61 66 5f 70 61 67 65 5f 6d 61 78 3d 31 36 6b 2c 6c 65 61 66 5f 76 61 6c 75 65 5f 6d 61 78 3d 30 2c 6c 6f 67 3d 28 65 6e 61 62 6c 65 64 3d 74 72 75 65 29 2c 6d 65 6d 6f 72 79 5f 70 61 67 65 5f 6d 61 78 3d 35 4d 42 2c 6f 73 5f 63 61 63 68 65 5f 64 69 72 74 79 5f 6d 61 78 3d 30 2c 6f 73 5f 63 61 63 68 65 5f 6d 61 78 3d 30 2c 70 72 65 66 69 78 5f 63 6f 6d 70 72 65 73 73 69 6f 6e 3d 74 72 75 65 2c 70 72 65 66 69 78 5f 63 6f 6d 70 72 65 73 73 69 6f 6e 5f 6d 69 6e 3d 34 2c 73 70 6c 69 74 5f 64 65 65 70 65 6e 5f 6d 69 6e 5f 63 68 69 6c 64 3d 30 2c 73 70 6c 69 74 5f 64 65 65 70 65 6e 5f 70 65 72 5f 63 68 69 6c 64 3d 30 2c 73 70 6c 69 74 5f 70 63 74 3d 39 30 2c 76 61 6c 75 65 5f 66 6f 72 6d 61 74 3d 75 2c 76 65 72 73 69 6f 6e 3d 28 6d 61 6a 6f 72 3d 31 2c 6d 69 6e 6f 72 3d 31 29 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 Raw: [1712679502:147945][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_bm_corrupt_dump, 144: {147456, 4096, 2553729618}: (chunk 2 of 4): 6d 6f 72 79 5f 63 61 63 68 65 5f 73 69 7a 65 3d 66 61 6c 73 65 2c 69 6e 74 65 72 6e 61 6c 5f 69 74 65 6d 5f 6d 61 78 3d 30 2c 69 6e 74 65 72 6e 61 6c 5f 6b 65 79 5f 6d 61 78 3d 30 2c 69 6e 74 65 72 6e 61 6c 5f 6b 65 79 5f 74 72 75 6e 63 61 74 65 3d 74 72 75 65 2c 69 6e 74 65 72 6e 61 6c 5f 70 61 67 65 5f 6d 61 78 3d 31 36 6b 2c 6b 65 79 5f 66 6f 72 6d 61 74 3d 75 2c 6b 65 79 5f 67 61 70 3d 31 30 2c 6c 65 61 66 5f 69 74 65 6d 5f 6d 61 78 3d 30 2c 6c 65 61 66 5f 6b 65 79 5f 6d 61 78 3d 30 2c 6c 65 61 66 5f 70 61 67 65 5f 6d 61 78 3d 31 36 6b 2c 6c 65 61 66 5f 76 61 6c 75 65 5f 6d 61 78 3d 30 2c 6c 6f 67 3d 28 65 6e 61 62 6c 65 64 3d 74 72 75 65 29 2c 6d 65 6d 6f 72 79 5f 70 61 67 65 5f 6d 61 78 3d 35 4d 42 2c 6f 73 5f 63 61 63 68 65 5f 64 69 72 74 79 5f 6d 61 78 3d 30 2c 6f 73 5f 63 61 63 68 65 5f 6d 61 78 3d 30 2c 70 72 65 66 69 78 5f 63 6f 6d 70 72 65 73 73 69 6f 6e 3d 74 72 75 65 2c 70 72 65 66 69 78 5f 63 6f 6d 70 72 65 73 73 69 6f 6e 5f 6d 69 6e 3d 34 2c 73 70 6c 69 74 5f 64 65 65 70 65 6e 5f 6d 69 6e 5f 63 68 69 6c 64 3d 30 2c 73 70 6c 69 74 5f 64 65 65 70 65 6e 5f 70 65 72 5f 63 68 69 6c 64 3d 30 2c 73 70 6c 69 74 5f 70 63 74 3d 39 30 2c 76 61 6c 75 65 5f 66 6f 72 6d 61 74 3d 75 2c 76 65 72 73 69 6f 6e 3d 28 6d 61 6a 6f 72 3d 31 2c 6d 69 6e 6f 72 3d 31 29 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2024-04-09T12:18:22.148-0400 E STORAGE [initandlisten] WiredTiger error (0) [1712679502:148091][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_bm_corrupt_dump, 144: {147456, 4096, 2553729618}: (chunk 3 of 4): 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 Raw: [1712679502:148091][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_bm_corrupt_dump, 144: {147456, 4096, 2553729618}: (chunk 3 of 4): 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2024-04-09T12:18:22.148-0400 E STORAGE [initandlisten] WiredTiger error (0) [1712679502:148236][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_bm_corrupt_dump, 144: {147456, 4096, 2553729618}: (chunk 4 of 4): 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 Raw: [1712679502:148236][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_bm_corrupt_dump, 144: {147456, 4096, 2553729618}: (chunk 4 of 4): 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2024-04-09T12:18:22.148-0400 E STORAGE [initandlisten] WiredTiger error (-31802) [1712679502:148267][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_block_read_off, 302: WiredTiger.wt: fatal read error: WT_ERROR: non-specific WiredTiger error Raw: [1712679502:148267][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_block_read_off, 302: WiredTiger.wt: fatal read error: WT_ERROR: non-specific WiredTiger error
2024-04-09T12:18:22.148-0400 E STORAGE [initandlisten] WiredTiger error (-31804) [1712679502:148275][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_panic, 523: the process must exit and restart: WT_PANIC: WiredTiger library panic Raw: [1712679502:148275][48208:0x7f6c1d489a40], file:WiredTiger.wt, connection: __wt_panic, 523: the process must exit and restart: WT_PANIC: WiredTiger library panic
2024-04-09T12:18:22.148-0400 F - [initandlisten] Fatal Assertion 50853 at

Yehuda · April 12, 2024, 12:39am

Bump. Any suggestions?

wtempel · April 12, 2024, 1:32pm

Given the evidence of database corruption, I recommend

a confirmed shutdown of CryoSPARC
a database rebuild
Warning: Could not get database status (attempt 1/3) - issue after storage outage
1. updating the CRYOSPARC_DB_PATH= definition inside /XXX/cryosparc_master/config.sh with a new, suitable path.
2. then running
  cryosparcm start
  which should start CryoSPARC with a blank database.
3. re-creating CryoSPARC users in the database with
  cryosparcm createuser
  commands (guide )
4. registering CryoSPARC workers in the database with
  cryosparcw connect commands (on the worker(s), guide ) or
  cryosparcm cluster connect command(s) (guide ), as applicable.
5. attaching project directories. You may have to delete the cs.lock file from any given project directory before attachment because the instance id stored in the new, blank database differs from the old instance id stored in the old database. This is an exception from the rule that cs.lock files should generally not be deleted.
Before project attachment (step 5. in the quoted instructions): If your CryoSPARC version is below 4.3, I recommend upgrading. If your CryoSPARC version is 4.3.*, I recommend appending to the file
/path/to/cryosparc_master/config.sh the line
```
export CRYOSPARC_MONGO_EXTRA_FLAGS=" "
```
(the space between the quotes is important). Upgrade to v4.4 or, in v4.3, setting CRYOSPARC_MONGO_EXTRA_FLAGS would enable database journalling that should increase the new database’s robustness against corruption. I CryoSPARC restart is required to activate changes of /path/to/cryosparc_master/config.sh.
continuous monitoring of the available capacity of the filesystem that holds the database
regular database backups via
cryosparcm backup (guide) or, once database journalling is enabled, filesystem snapshots.

Yehuda · April 15, 2024, 8:04pm

Thank you. I am having trouble That is what the old database -bash-4.2$ ls -l /data/sparc/cryos total 74371688
-rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel drwxr-xr-x 2 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel drwx------ 2 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel -rw------- 1 cryosparc_user patel -rw-r–r-- 1 cryosparc_user patel attaching projects.
looks like. Where are the ptojects:
parc_database
6 Apr 9 11:14 Bmongod.lock
192512 Apr 9 11:07 collection-0-1770953415308285490.wt
49152 Apr 9 11:07 collection-0-1818481567048796219.wt
16384 Apr 9 11:07 collection-0–5144076334988684332.wt
36864 Apr 9 11:07 collection-0–5614198511938432935.wt
9248768 Apr 9 11:07 collection-0–8765026622364969654.wt
36864 Apr 9 11:07 collection-0–9111847711681301366.wt
36864 Apr 9 11:14 collection-12-1818481567048796219.wt
270336 Apr 9 11:14 collection-14-1818481567048796219.wt
4096 Apr 9 11:14 collection-14–3178558673491431138.wt
patel 75119120384 Apr 9 11:14 collection-1–4344890024644045722.wt
4096 Apr 9 11:14 collection-15-5195854931486965224.wt
36864 Apr 9 11:14 collection-16-1818481567048796219.wt
61440 Apr 9 11:14 collection-18-1818481567048796219.wt
86016 Apr 9 11:14 collection-21-1818481567048796219.wt
32768 Apr 9 11:14 collection-21-5195854931486965224.wt
32768 Apr 9 11:14 collection-2-1818481567048796219.wt
36864 Apr 9 11:14 collection-22–3178558673491431138.wt
40960 Apr 9 11:14 collection-23-5195854931486965224.wt
16384 Apr 9 11:14 collection-2–5144076334988684332.wt
53248 Apr 9 11:14 collection-25–3178558673491431138.wt
36864 Apr 9 11:14 collection-2–5614198511938432935.wt
197070848 Apr 9 11:14 collection-26-1818481567048796219.wt
545796096 Apr 9 11:14 collection-35-1818481567048796219.wt
50601984 Apr 9 11:14 collection-41-1818481567048796219.wt
29978624 Apr 9 11:14 collection-4-1818481567048796219.wt
4096 Apr 9 11:14 collection-44-1818481567048796219.wt
36864 Apr 9 11:14 collection-4–5144076334988684332.wt
16691200 Apr 9 11:14 collection-50-1818481567048796219.wt
16384 Apr 9 11:14 collection-5-1818481567048796219.wt
4096 Apr 9 11:14 collection-5–3178558673491431138.wt
4096 Apr 9 11:14 collection-55-1818481567048796219.wt
4096 Apr 9 11:14 collection-58-1818481567048796219.wt
147456 Apr 9 11:14 collection-61-1818481567048796219.wt
45056 Apr 9 11:14 collection-63-1818481567048796219.wt
36864 Apr 9 11:14 collection-6–5144076334988684332.wt
36864 Apr 9 11:14 collection-7-1818481567048796219.wt
4096 Apr 9 11:14 collection-72-1818481567048796219.wt
4096 Apr 9 11:14 collection-77-1818481567048796219.wt
4096 Apr 9 11:14 collection-8–3178558673491431138.wt
36864 Apr 9 11:14 collection-9-1818481567048796219.wt
4096 Apr 9 11:14 diagnostic.data
36864 Apr 9 11:14 index-0–3178558673491431138.wt
15331328 Apr 9 11:14 index-0–4344890024644045722.wt
36864 Apr 9 11:14 index-0-5195854931486965224.wt
32768 Apr 9 11:14 index-10-1818481567048796219.wt
4096 Apr 9 11:14 index-10–3178558673491431138.wt
90112 Apr 9 11:14 index-10-5195854931486965224.wt
36864 Apr 9 11:14 index-11-1818481567048796219.wt
4096 Apr 9 11:14 index-11–3178558673491431138.wt
61440 Apr 9 11:14 index-11-5195854931486965224.wt
16384 Apr 9 11:14 index-1-1770953415308285490.wt
36864 Apr 9 11:14 index-1-1818481567048796219.wt
4096 Apr 9 11:14 index-12–3178558673491431138.wt
4096 Apr 9 11:14 index-12-5195854931486965224.wt
36864 Apr 9 11:14 index-1–3178558673491431138.wt
16384 Apr 9 11:14 index-13-1818481567048796219.wt
4096 Apr 9 11:14 index-13–3178558673491431138.wt
4096 Apr 9 11:14 index-13-5195854931486965224.wt
53248 Apr 9 11:14 index-14-5195854931486965224.wt
16384 Apr 9 11:14 index-1–5144076334988684332.wt
36864 Apr 9 11:14 index-15-1818481567048796219.wt
36864 Apr 9 11:14 index-1-5195854931486965224.wt
4096 Apr 9 11:14 index-15–3178558673491431138.wt
36864 Apr 9 11:14 index-1–5614198511938432935.wt
4096 Apr 9 11:14 index-16–3178558673491431138.wt
4096 Apr 9 11:14 index-16-5195854931486965224.wt
16384 Apr 9 11:14 index-17-1818481567048796219.wt
4096 Apr 9 11:14 index-17–3178558673491431138.wt
4096 Apr 9 11:14 index-17-5195854931486965224.wt
4096 Apr 9 11:14 index-18–3178558673491431138.wt
4096 Apr 9 11:14 index-18-5195854931486965224.wt
294912 Apr 9 11:14 index-1–8765026622364969654.wt
36864 Apr 9 11:14 index-1–9111847711681301366.wt
36864 Apr 9 11:14 index-19-1818481567048796219.wt
4096 Apr 9 11:14 index-19–3178558673491431138.wt
36864 Apr 9 11:14 index-20-1818481567048796219.wt
4096 Apr 9 11:14 index-20–3178558673491431138.wt
4096 Apr 9 11:14 index-21–3178558673491431138.wt
36864 Apr 9 11:14 index-22-1818481567048796219.wt
32768 Apr 9 11:14 index-22-5195854931486965224.wt
36864 Apr 9 11:14 index-2–3178558673491431138.wt
36864 Apr 9 11:14 index-23-1818481567048796219.wt
36864 Apr 9 11:14 index-23–3178558673491431138.wt
36864 Apr 9 11:14 index-24-1818481567048796219.wt
36864 Apr 9 11:14 index-24–3178558673491431138.wt
8634368 Apr 9 11:14 index-2–4344890024644045722.wt
32768 Apr 9 11:14 index-24-5195854931486965224.wt
36864 Apr 9 11:14 index-25-1818481567048796219.wt
36864 Apr 9 11:14 index-2-5195854931486965224.wt
36864 Apr 9 11:14 index-26–3178558673491431138.wt
126976 Apr 9 11:14 index-27-1818481567048796219.wt
98304 Apr 9 11:14 index-28-1818481567048796219.wt
1200128 Apr 9 11:14 index-2–8765026622364969654.wt
86016 Apr 9 11:14 index-29-1818481567048796219.wt
61440 Apr 9 11:14 index-30-1818481567048796219.wt
61440 Apr 9 11:14 index-31-1818481567048796219.wt
32768 Apr 9 11:14 index-3-1818481567048796219.wt
36864 Apr 9 11:14 index-3–3178558673491431138.wt
61440 Apr 9 11:14 index-33-1818481567048796219.wt
94208 Apr 9 11:14 index-34-1818481567048796219.wt
9363456 Apr 9 11:14 index-3–4344890024644045722.wt
16384 Apr 9 11:14 index-3–5144076334988684332.wt
36864 Apr 9 11:14 index-3-5195854931486965224.wt
36864 Apr 9 11:14 index-3–5614198511938432935.wt
80064512 Apr 9 11:14 index-36-1818481567048796219.wt
135168 Apr 9 11:14 index-3–8765026622364969654.wt
56623104 Apr 9 11:14 index-40-1818481567048796219.wt
8581120 Apr 9 11:14 index-42-1818481567048796219.wt
73728 Apr 9 11:14 index-4–3178558673491431138.wt
2510848 Apr 9 11:14 index-43-1818481567048796219.wt
4096 Apr 9 11:14 index-45-1818481567048796219.wt
36864 Apr 9 11:14 index-4-5195854931486965224.wt
40960 Apr 9 11:14 index-4–5614198511938432935.wt
4096 Apr 9 11:14 index-46-1818481567048796219.wt
4096 Apr 9 11:14 index-47-1818481567048796219.wt
4096 Apr 9 11:14 index-49-1818481567048796219.wt
102400 Apr 9 11:14 index-51-1818481567048796219.wt
65536 Apr 9 11:14 index-52-1818481567048796219.wt
73728 Apr 9 11:14 index-53-1818481567048796219.wt
53248 Apr 9 11:14 index-54-1818481567048796219.wt
36864 Apr 9 11:14 index-5–5144076334988684332.wt
61440 Apr 9 11:14 index-5-5195854931486965224.wt
4096 Apr 9 11:14 index-5–5614198511938432935.wt
4096 Apr 9 11:14 index-56-1818481567048796219.wt
4096 Apr 9 11:14 index-57-1818481567048796219.wt
4096 Apr 9 11:14 index-59-1818481567048796219.wt
4096 Apr 9 11:14 index-60-1818481567048796219.wt
16384 Apr 9 11:14 index-6-1818481567048796219.wt
94208 Apr 9 11:14 index-62-1818481567048796219.wt
4096 Apr 9 11:14 index-6–3178558673491431138.wt
36864 Apr 9 11:14 index-64-1818481567048796219.wt
4096 Apr 9 11:14 index-65-1818481567048796219.wt
98304 Apr 9 11:14 index-6-5195854931486965224.wt
4096 Apr 9 11:14 index-6–5614198511938432935.wt
36864 Apr 9 11:14 index-66-1818481567048796219.wt
36864 Apr 9 11:14 index-67-1818481567048796219.wt
4096 Apr 9 11:14 index-68-1818481567048796219.wt
4096 Apr 9 11:14 index-69-1818481567048796219.wt
36864 Apr 9 11:14 index-70-1818481567048796219.wt
4096 Apr 9 11:14 index-71-1818481567048796219.wt
4096 Apr 9 11:14 index-7–3178558673491431138.wt
4096 Apr 9 11:14 index-73-1818481567048796219.wt
4096 Apr 9 11:14 index-74-1818481567048796219.wt
16384 Apr 9 11:14 index-7–5144076334988684332.wt
4096 Apr 9 11:14 index-75-1818481567048796219.wt
65536 Apr 9 11:14 index-7-5195854931486965224.wt
4096 Apr 9 11:14 index-76-1818481567048796219.wt
4096 Apr 9 11:14 index-78-1818481567048796219.wt
4096 Apr 9 11:14 index-79-1818481567048796219.wt
16384 Apr 9 11:14 index-8-1818481567048796219.wt
16384 Apr 9 11:14 index-8–5144076334988684332.wt
94208 Apr 9 11:14 index-8-5195854931486965224.wt
4096 Apr 9 11:14 index-9–3178558673491431138.wt
102400 Apr 9 11:14 index-9-5195854931486965224.wt
206 Apr 9 11:18 journal
53248 Apr 9 11:07 _mdb_catalog.wt
0 Apr 9 11:49 mongod.lock
36864 Apr 9 11:14 sizeStorer.wt
95 Apr 9 11:14 storage.bson
49 Apr 9 11:07 WiredTiger
4096 Apr 9 11:07 WiredTigerLAS.wt
21 Apr 9 11:07 WiredTiger.lock
1053 Apr 9 11:18 WiredTiger.turtle
548864 Apr 9 11:07 WiredTiger.wt

wtempel · April 15, 2024, 8:48pm

Please post the errors you observe.

Unfortunately, I am not familiar with the internal workings of the mongo storage engine.

Yehuda · April 15, 2024, 9:19pm

The error shows momentarily in two pop-up window and then disappears:
Unable to import project: directory /data/sparc/backup/collection-1–4344890024644045722.wt does not exist

Close

Unable to attach project: ServerError: [IMPORT_PROJECT] : Directory /data/sparc/backup/collection-1–4344890024644045722.wt does not exist

wtempel · April 15, 2024, 9:46pm

To attach a project, please specify a valid project directory. A valid project directory would include job directories, such as J1/, J2/, etc and files such as project.json.