Max level shown:
12025-06-10T18:22:55.874ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::c]:35139
22025-06-10T18:22:55.874ZINFOcrucible-agent (datafile): region 9631da83-f2b7-4c1d-8b46-620dbdd19fcd state: Requested
32025-06-10T18:22:55.879ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-06-10T18:22:55.879ZINFOcrucible-agent (dropshot): request completed latency_us = 5235 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:35139 req_id = c78c6f35-53fb-4321-8179-ec0c70e655f5 response_code = 200 uri = /crucible/0/regions
52025-06-10T18:22:55.891ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_bd594fd6-7b7e-420b-841f-70c28eb41fe9/crucible/regions/9631da83-f2b7-4c1d-8b46-620dbdd19fcd
62025-06-10T18:22:55.891ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_bd594fd6-7b7e-420b-841f-70c28eb41fe9/crucible/regions/9631da83-f2b7-4c1d-8b46-620dbdd19fcd
72025-06-10T18:22:55.943ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9631da83-f2b7-4c1d-8b46-620dbdd19fcd"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9631da83-f2b7-4c1d-8b46-620dbdd19fcd" region = 9631da83-f2b7-4c1d-8b46-620dbdd19fcd
82025-06-10T18:22:55.945ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9631da83-f2b7-4c1d-8b46-620dbdd19fcd" "--data" "/data/regions/9631da83-f2b7-4c1d-8b46-620dbdd19fcd" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 9631da83-f2b7-4c1d-8b46-620dbdd19fcd
92025-06-10T18:22:56.075ZINFOcrucible-agent (worker): region files created ok region = 9631da83-f2b7-4c1d-8b46-620dbdd19fcd
102025-06-10T18:22:56.075ZINFOcrucible-agent (datafile): region 9631da83-f2b7-4c1d-8b46-620dbdd19fcd state: Requested -> Created
112025-06-10T18:22:56.075ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-06-10T18:22:56.095ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9631da83-f2b7-4c1d-8b46-620dbdd19fcd
132025-06-10T18:22:56.106ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9631da83-f2b7-4c1d-8b46-620dbdd19fcd
142025-06-10T18:22:56.118ZINFOcrucible-agent (worker): creating config property group
152025-06-10T18:22:56.121ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9631da83-f2b7-4c1d-8b46-620dbdd19fcd
162025-06-10T18:22:56.121ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9631da83-f2b7-4c1d-8b46-620dbdd19fcd
172025-06-10T18:22:56.121ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-06-10T18:22:56.121ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
192025-06-10T18:22:56.121ZINFOcrucible-agent (worker): commit
202025-06-10T18:22:56.125ZINFOcrucible-agent (worker): ok!
212025-06-10T18:22:56.130ZINFOcrucible-agent (worker): SMF ok!
222025-06-10T18:22:56.153ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:35139 req_id = 3ce64dbf-0df7-4a4e-b08f-a6579197d66e response_code = 200 uri = /crucible/0/regions
232025-06-10T18:22:57.106ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:35139 req_id = cb074f1f-21ef-4ff5-9b59-2b9771b12a9d response_code = 200 uri = /crucible/0/regions/042f022d-1222-49a9-819d-ef7cc15c63ea
242025-06-10T18:22:57.109ZINFOcrucible-agent (datafile): path is "/data/regions/042f022d-1222-49a9-819d-ef7cc15c63ea"
252025-06-10T18:22:57.119ZINFOcrucible-agent (datafile): dataset is oxp_bd594fd6-7b7e-420b-841f-70c28eb41fe9/crucible/regions/042f022d-1222-49a9-819d-ef7cc15c63ea
262025-06-10T18:22:57.127ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_bd594fd6-7b7e-420b-841f-70c28eb41fe9/crucible/regions/042f022d-1222-49a9-819d-ef7cc15c63ea@a4700145-a2b0-4ddd-a1ad-15d5bcebb447
272025-06-10T18:22:57.127ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_bd594fd6-7b7e-420b-841f-70c28eb41fe9/crucible/regions/042f022d-1222-49a9-819d-ef7cc15c63ea", "a4700145-a2b0-4ddd-a1ad-15d5bcebb447"]
282025-06-10T18:22:57.139ZINFOcrucible-agent (dropshot): request completed latency_us = 29770 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:35139 req_id = ea1ba56d-b1a5-41cb-8c7a-112283caf97f response_code = 200 uri = /crucible/0/regions/042f022d-1222-49a9-819d-ef7cc15c63ea/snapshots/a4700145-a2b0-4ddd-a1ad-15d5bcebb447
292025-06-10T18:22:57.145ZINFOcrucible-agent (datafile): path is "/data/regions/042f022d-1222-49a9-819d-ef7cc15c63ea"
302025-06-10T18:22:57.152ZINFOcrucible-agent (datafile): dataset is oxp_bd594fd6-7b7e-420b-841f-70c28eb41fe9/crucible/regions/042f022d-1222-49a9-819d-ef7cc15c63ea
312025-06-10T18:22:57.161ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_bd594fd6-7b7e-420b-841f-70c28eb41fe9/crucible/regions/042f022d-1222-49a9-819d-ef7cc15c63ea@a4700145-a2b0-4ddd-a1ad-15d5bcebb447
322025-06-10T18:22:57.161ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_bd594fd6-7b7e-420b-841f-70c28eb41fe9/crucible/regions/042f022d-1222-49a9-819d-ef7cc15c63ea", "a4700145-a2b0-4ddd-a1ad-15d5bcebb447"]
332025-06-10T18:22:57.170ZINFOcrucible-agent (datafile): requesting running snapshot 042f022d-1222-49a9-819d-ef7cc15c63ea-a4700145-a2b0-4ddd-a1ad-15d5bcebb447 state: Requested
342025-06-10T18:22:57.170ZINFOcrucible-agent (worker): applying SMF actions for region 042f022d-1222-49a9-819d-ef7cc15c63ea running snapshot a4700145-a2b0-4ddd-a1ad-15d5bcebb447 (state Requested)...
352025-06-10T18:22:57.170ZINFOcrucible-agent (dropshot): request completed latency_us = 25856 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:35139 req_id = 9193502e-8e16-4f73-8f46-1f8dd98b9d07 response_code = 200 uri = /crucible/0/regions/042f022d-1222-49a9-819d-ef7cc15c63ea/snapshots/a4700145-a2b0-4ddd-a1ad-15d5bcebb447/run
362025-06-10T18:22:57.173ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-042f022d-1222-49a9-819d-ef7cc15c63ea-a4700145-a2b0-4ddd-a1ad-15d5bcebb447
372025-06-10T18:22:57.176ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-042f022d-1222-49a9-819d-ef7cc15c63ea-a4700145-a2b0-4ddd-a1ad-15d5bcebb447
382025-06-10T18:22:57.186ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-042f022d-1222-49a9-819d-ef7cc15c63ea-a4700145-a2b0-4ddd-a1ad-15d5bcebb447
392025-06-10T18:22:57.186ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/042f022d-1222-49a9-819d-ef7cc15c63ea/.zfs/snapshot/a4700145-a2b0-4ddd-a1ad-15d5bcebb447
402025-06-10T18:22:57.187ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-06-10T18:22:57.187ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-06-10T18:22:57.187ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
432025-06-10T18:22:57.187ZINFOcrucible-agent (worker): commit
442025-06-10T18:22:57.190ZINFOcrucible-agent (worker): ok!
452025-06-10T18:22:57.194ZINFOcrucible-agent (worker): SMF ok!
462025-06-10T18:22:57.194ZINFOcrucible-agent (datafile): region 042f022d-1222-49a9-819d-ef7cc15c63ea running snapshot a4700145-a2b0-4ddd-a1ad-15d5bcebb447 state: Requested -> Created
472025-06-10T18:22:57.394ZINFOcrucible-agent (datafile): path is "/data/regions/042f022d-1222-49a9-819d-ef7cc15c63ea"
482025-06-10T18:22:57.403ZINFOcrucible-agent (datafile): dataset is oxp_bd594fd6-7b7e-420b-841f-70c28eb41fe9/crucible/regions/042f022d-1222-49a9-819d-ef7cc15c63ea
492025-06-10T18:22:57.412ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_bd594fd6-7b7e-420b-841f-70c28eb41fe9/crucible/regions/042f022d-1222-49a9-819d-ef7cc15c63ea@a4700145-a2b0-4ddd-a1ad-15d5bcebb447
502025-06-10T18:22:57.412ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_bd594fd6-7b7e-420b-841f-70c28eb41fe9/crucible/regions/042f022d-1222-49a9-819d-ef7cc15c63ea", "a4700145-a2b0-4ddd-a1ad-15d5bcebb447"]
512025-06-10T18:22:57.420ZINFOcrucible-agent (dropshot): request completed latency_us = 26187 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:35139 req_id = 47c8cb51-42e5-477f-9d51-e27e5a120019 response_code = 200 uri = /crucible/0/regions/042f022d-1222-49a9-819d-ef7cc15c63ea/snapshots/a4700145-a2b0-4ddd-a1ad-15d5bcebb447/run