Max level shown:
12026-05-01T20:24:21.439ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:52412
22026-05-01T20:24:21.440ZINFOcrucible-agent (datafile): region 2759c2f3-98cd-45ac-a845-aec2ba7fef94 state: Requested
32026-05-01T20:24:21.441ZINFOcrucible-agent (dropshot): request completed latency_us = 1079 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52412 req_id = 7965c829-51cd-451c-bbb8-b7d730ab8614 response_code = 200 uri = /crucible/0/regions
42026-05-01T20:24:21.441ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-05-01T20:24:21.451ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ff4de67a-e3c2-4d1d-8b26-14ae4a7394c1/crucible/regions/2759c2f3-98cd-45ac-a845-aec2ba7fef94
62026-05-01T20:24:21.451ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ff4de67a-e3c2-4d1d-8b26-14ae4a7394c1/crucible/regions/2759c2f3-98cd-45ac-a845-aec2ba7fef94
72026-05-01T20:24:21.516ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2759c2f3-98cd-45ac-a845-aec2ba7fef94"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2759c2f3-98cd-45ac-a845-aec2ba7fef94" region = 2759c2f3-98cd-45ac-a845-aec2ba7fef94
82026-05-01T20:24:21.516ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2759c2f3-98cd-45ac-a845-aec2ba7fef94" "--data" "/data/regions/2759c2f3-98cd-45ac-a845-aec2ba7fef94" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2759c2f3-98cd-45ac-a845-aec2ba7fef94
92026-05-01T20:24:21.591ZINFOcrucible-agent (worker): region files created ok region = 2759c2f3-98cd-45ac-a845-aec2ba7fef94
102026-05-01T20:24:21.591ZINFOcrucible-agent (datafile): region 2759c2f3-98cd-45ac-a845-aec2ba7fef94 state: Requested -> Created
112026-05-01T20:24:21.591ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-05-01T20:24:21.592ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2759c2f3-98cd-45ac-a845-aec2ba7fef94
132026-05-01T20:24:21.601ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2759c2f3-98cd-45ac-a845-aec2ba7fef94
142026-05-01T20:24:21.620ZINFOcrucible-agent (worker): creating config property group
152026-05-01T20:24:21.623ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2759c2f3-98cd-45ac-a845-aec2ba7fef94
162026-05-01T20:24:21.623ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2759c2f3-98cd-45ac-a845-aec2ba7fef94
172026-05-01T20:24:21.623ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-05-01T20:24:21.623ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
192026-05-01T20:24:21.623ZINFOcrucible-agent (worker): commit
202026-05-01T20:24:21.628ZINFOcrucible-agent (worker): ok!
212026-05-01T20:24:21.644ZINFOcrucible-agent (worker): SMF ok!
222026-05-01T20:24:21.738ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52412 req_id = d2005d27-2670-4e8e-9d46-87ec7789ed19 response_code = 200 uri = /crucible/0/regions
232026-05-01T20:24:23.603ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52412 req_id = 2c52b32a-d2e8-48cc-83c2-470150002098 response_code = 200 uri = /crucible/0/regions/7c9983c4-f929-4011-8675-106aa0b4a5de
242026-05-01T20:24:23.606ZINFOcrucible-agent (datafile): path is "/data/regions/7c9983c4-f929-4011-8675-106aa0b4a5de"
252026-05-01T20:24:23.613ZINFOcrucible-agent (datafile): dataset is oxp_ff4de67a-e3c2-4d1d-8b26-14ae4a7394c1/crucible/regions/7c9983c4-f929-4011-8675-106aa0b4a5de
262026-05-01T20:24:23.618ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ff4de67a-e3c2-4d1d-8b26-14ae4a7394c1/crucible/regions/7c9983c4-f929-4011-8675-106aa0b4a5de@1daa339c-e17f-429e-82c2-817cb9caf564
272026-05-01T20:24:23.618ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ff4de67a-e3c2-4d1d-8b26-14ae4a7394c1/crucible/regions/7c9983c4-f929-4011-8675-106aa0b4a5de", "1daa339c-e17f-429e-82c2-817cb9caf564"]
282026-05-01T20:24:23.625ZINFOcrucible-agent (dropshot): request completed latency_us = 18691 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52412 req_id = be87ca11-c7f6-4235-af72-eea9df867fbb response_code = 200 uri = /crucible/0/regions/7c9983c4-f929-4011-8675-106aa0b4a5de/snapshots/1daa339c-e17f-429e-82c2-817cb9caf564
292026-05-01T20:24:23.629ZINFOcrucible-agent (datafile): path is "/data/regions/7c9983c4-f929-4011-8675-106aa0b4a5de"
302026-05-01T20:24:23.636ZINFOcrucible-agent (datafile): dataset is oxp_ff4de67a-e3c2-4d1d-8b26-14ae4a7394c1/crucible/regions/7c9983c4-f929-4011-8675-106aa0b4a5de
312026-05-01T20:24:23.642ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ff4de67a-e3c2-4d1d-8b26-14ae4a7394c1/crucible/regions/7c9983c4-f929-4011-8675-106aa0b4a5de@1daa339c-e17f-429e-82c2-817cb9caf564
322026-05-01T20:24:23.642ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ff4de67a-e3c2-4d1d-8b26-14ae4a7394c1/crucible/regions/7c9983c4-f929-4011-8675-106aa0b4a5de", "1daa339c-e17f-429e-82c2-817cb9caf564"]
332026-05-01T20:24:23.651ZINFOcrucible-agent (datafile): requesting running snapshot 7c9983c4-f929-4011-8675-106aa0b4a5de-1daa339c-e17f-429e-82c2-817cb9caf564 state: Requested
342026-05-01T20:24:23.651ZINFOcrucible-agent (dropshot): request completed latency_us = 22625 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52412 req_id = 10512a5c-959e-43fa-a553-0ec23a69e7c9 response_code = 200 uri = /crucible/0/regions/7c9983c4-f929-4011-8675-106aa0b4a5de/snapshots/1daa339c-e17f-429e-82c2-817cb9caf564/run
352026-05-01T20:24:23.651ZINFOcrucible-agent (worker): applying SMF actions for region 7c9983c4-f929-4011-8675-106aa0b4a5de running snapshot 1daa339c-e17f-429e-82c2-817cb9caf564 (state Requested)...
362026-05-01T20:24:23.656ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-7c9983c4-f929-4011-8675-106aa0b4a5de-1daa339c-e17f-429e-82c2-817cb9caf564
372026-05-01T20:24:23.665ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-7c9983c4-f929-4011-8675-106aa0b4a5de-1daa339c-e17f-429e-82c2-817cb9caf564
382026-05-01T20:24:23.675ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-7c9983c4-f929-4011-8675-106aa0b4a5de-1daa339c-e17f-429e-82c2-817cb9caf564
392026-05-01T20:24:23.675ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7c9983c4-f929-4011-8675-106aa0b4a5de/.zfs/snapshot/1daa339c-e17f-429e-82c2-817cb9caf564
402026-05-01T20:24:23.675ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-05-01T20:24:23.676ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-05-01T20:24:23.676ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
432026-05-01T20:24:23.676ZINFOcrucible-agent (worker): commit
442026-05-01T20:24:23.679ZINFOcrucible-agent (worker): ok!
452026-05-01T20:24:23.684ZINFOcrucible-agent (worker): SMF ok!
462026-05-01T20:24:23.684ZINFOcrucible-agent (datafile): region 7c9983c4-f929-4011-8675-106aa0b4a5de running snapshot 1daa339c-e17f-429e-82c2-817cb9caf564 state: Requested -> Created
472026-05-01T20:24:23.942ZINFOcrucible-agent (datafile): path is "/data/regions/7c9983c4-f929-4011-8675-106aa0b4a5de"
482026-05-01T20:24:23.948ZINFOcrucible-agent (datafile): dataset is oxp_ff4de67a-e3c2-4d1d-8b26-14ae4a7394c1/crucible/regions/7c9983c4-f929-4011-8675-106aa0b4a5de
492026-05-01T20:24:23.955ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ff4de67a-e3c2-4d1d-8b26-14ae4a7394c1/crucible/regions/7c9983c4-f929-4011-8675-106aa0b4a5de@1daa339c-e17f-429e-82c2-817cb9caf564
502026-05-01T20:24:23.955ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ff4de67a-e3c2-4d1d-8b26-14ae4a7394c1/crucible/regions/7c9983c4-f929-4011-8675-106aa0b4a5de", "1daa339c-e17f-429e-82c2-817cb9caf564"]
512026-05-01T20:24:23.961ZINFOcrucible-agent (dropshot): request completed latency_us = 19239 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52412 req_id = 2461bd4e-17ea-4cb5-8edd-e9db32512590 response_code = 200 uri = /crucible/0/regions/7c9983c4-f929-4011-8675-106aa0b4a5de/snapshots/1daa339c-e17f-429e-82c2-817cb9caf564/run