Max level shown:
12026-05-15T01:00:00.730ZINFOcrucible-agent (datafile): path is "/data/regions/f94b39c3-6eff-487e-836e-611b15c2670c"
22026-05-15T01:00:00.741ZINFOcrucible-agent (datafile): dataset is oxp_9dd3cc15-546f-4c4c-812b-a8e419198d85/crucible/regions/f94b39c3-6eff-487e-836e-611b15c2670c
32026-05-15T01:00:00.751ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_9dd3cc15-546f-4c4c-812b-a8e419198d85/crucible/regions/f94b39c3-6eff-487e-836e-611b15c2670c@40d18132-118a-41a9-b884-2a22a44278b1
42026-05-15T01:00:00.751ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_9dd3cc15-546f-4c4c-812b-a8e419198d85/crucible/regions/f94b39c3-6eff-487e-836e-611b15c2670c", "40d18132-118a-41a9-b884-2a22a44278b1"]
52026-05-15T01:00:00.762ZINFOcrucible-agent (dropshot): request completed latency_us = 32245 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33750 req_id = 116fc938-5826-4567-ab3e-fe72aa6ec9ef response_code = 200 uri = /crucible/0/regions/f94b39c3-6eff-487e-836e-611b15c2670c/snapshots/40d18132-118a-41a9-b884-2a22a44278b1/run
62026-05-15T01:00:05.777ZINFOcrucible-agent (datafile): region c147bdce-990b-45e4-8fd7-45de70408d58 state: Requested
72026-05-15T01:00:05.778ZINFOcrucible-agent (dropshot): request completed latency_us = 228 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33750 req_id = 8b20ec27-d6cd-44e4-bfbc-d7075a4dda63 response_code = 200 uri = /crucible/0/regions
82026-05-15T01:00:05.778ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
92026-05-15T01:00:05.784ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9dd3cc15-546f-4c4c-812b-a8e419198d85/crucible/regions/c147bdce-990b-45e4-8fd7-45de70408d58
102026-05-15T01:00:05.784ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9dd3cc15-546f-4c4c-812b-a8e419198d85/crucible/regions/c147bdce-990b-45e4-8fd7-45de70408d58
112026-05-15T01:00:05.828ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c147bdce-990b-45e4-8fd7-45de70408d58"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c147bdce-990b-45e4-8fd7-45de70408d58" region = c147bdce-990b-45e4-8fd7-45de70408d58
122026-05-15T01:00:05.828ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c147bdce-990b-45e4-8fd7-45de70408d58" "--data" "/data/regions/c147bdce-990b-45e4-8fd7-45de70408d58" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c147bdce-990b-45e4-8fd7-45de70408d58
132026-05-15T01:00:05.891ZINFOcrucible-agent (worker): region files created ok region = c147bdce-990b-45e4-8fd7-45de70408d58
142026-05-15T01:00:05.891ZINFOcrucible-agent (datafile): region c147bdce-990b-45e4-8fd7-45de70408d58 state: Requested -> Created
152026-05-15T01:00:05.891ZINFOcrucible-agent (worker): applying SMF actions post create...
162026-05-15T01:00:05.892ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c147bdce-990b-45e4-8fd7-45de70408d58
172026-05-15T01:00:05.894ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c147bdce-990b-45e4-8fd7-45de70408d58
182026-05-15T01:00:05.898ZINFOcrucible-agent (worker): creating config property group
192026-05-15T01:00:05.899ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c147bdce-990b-45e4-8fd7-45de70408d58
202026-05-15T01:00:05.899ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c147bdce-990b-45e4-8fd7-45de70408d58
212026-05-15T01:00:05.899ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
222026-05-15T01:00:05.899ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
232026-05-15T01:00:05.899ZINFOcrucible-agent (worker): commit
242026-05-15T01:00:05.901ZINFOcrucible-agent (worker): ok!
252026-05-15T01:00:05.904ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/f94b39c3-6eff-487e-836e-611b15c2670c
262026-05-15T01:00:05.905ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
272026-05-15T01:00:05.905ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::16
282026-05-15T01:00:05.905ZINFOcrucible-agent (worker): reconfig required
292026-05-15T01:00:05.905ZINFOcrucible-agent (worker): using existing config property group
302026-05-15T01:00:05.905ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f94b39c3-6eff-487e-836e-611b15c2670c
312026-05-15T01:00:05.907ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f94b39c3-6eff-487e-836e-611b15c2670c
322026-05-15T01:00:05.908ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
332026-05-15T01:00:05.908ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
342026-05-15T01:00:05.908ZINFOcrucible-agent (worker): commit
352026-05-15T01:00:05.910ZINFOcrucible-agent (worker): ok!
362026-05-15T01:00:05.911ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33750 req_id = f94cd33b-5b58-493f-b2c6-f0c2746babeb response_code = 200 uri = /crucible/0/regions
372026-05-15T01:00:05.912ZINFOcrucible-agent (worker): SMF ok!
382026-05-15T01:00:29.684ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33750 req_id = 33a5d98a-681e-4f82-b9cf-caee4876d202 response_code = 200 uri = /crucible/0/regions/c147bdce-990b-45e4-8fd7-45de70408d58
392026-05-15T01:00:29.688ZINFOcrucible-agent (datafile): path is "/data/regions/c147bdce-990b-45e4-8fd7-45de70408d58"
402026-05-15T01:00:29.697ZINFOcrucible-agent (datafile): dataset is oxp_9dd3cc15-546f-4c4c-812b-a8e419198d85/crucible/regions/c147bdce-990b-45e4-8fd7-45de70408d58
412026-05-15T01:00:29.704ZINFOcrucible-agent (datafile): region c147bdce-990b-45e4-8fd7-45de70408d58 state: Created -> Tombstoned
422026-05-15T01:00:29.704ZINFOcrucible-agent (worker): applying SMF actions before removal...
432026-05-15T01:00:29.704ZINFOcrucible-agent (dropshot): request completed latency_us = 16821 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:33750 req_id = d780a2a8-4f79-40c4-be19-badee00b88ce response_code = 204 uri = /crucible/0/regions/c147bdce-990b-45e4-8fd7-45de70408d58
442026-05-15T01:00:29.706ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-c147bdce-990b-45e4-8fd7-45de70408d58 (instance states: (Some(Online), None))
452026-05-15T01:00:29.708ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33750 req_id = 605ace3f-42fa-4d69-8c72-8cae71de6325 response_code = 200 uri = /crucible/0/regions/c147bdce-990b-45e4-8fd7-45de70408d58
462026-05-15T01:00:29.709ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/f94b39c3-6eff-487e-836e-611b15c2670c
472026-05-15T01:00:29.709ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
482026-05-15T01:00:29.709ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::16
492026-05-15T01:00:29.710ZINFOcrucible-agent (worker): reconfig required
502026-05-15T01:00:29.710ZINFOcrucible-agent (worker): using existing config property group
512026-05-15T01:00:29.710ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f94b39c3-6eff-487e-836e-611b15c2670c
522026-05-15T01:00:29.710ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f94b39c3-6eff-487e-836e-611b15c2670c
532026-05-15T01:00:29.710ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
542026-05-15T01:00:29.710ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
552026-05-15T01:00:29.710ZINFOcrucible-agent (worker): commit
562026-05-15T01:00:29.712ZINFOcrucible-agent (worker): ok!
572026-05-15T01:00:29.714ZINFOcrucible-agent (worker): SMF ok!
582026-05-15T01:00:29.722ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_9dd3cc15-546f-4c4c-812b-a8e419198d85/crucible/regions/c147bdce-990b-45e4-8fd7-45de70408d58" region = c147bdce-990b-45e4-8fd7-45de70408d58
592026-05-15T01:00:29.766ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33750 req_id = 247f38c2-5d1d-4b5e-99cc-cb67a76b3f39 response_code = 200 uri = /crucible/0/regions/c147bdce-990b-45e4-8fd7-45de70408d58
602026-05-15T01:00:29.772ZINFOcrucible-agent (datafile): region c147bdce-990b-45e4-8fd7-45de70408d58 state: Tombstoned -> Destroyed
612026-05-15T01:00:29.915ZINFOcrucible-agent (dropshot): request completed latency_us = 39 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33750 req_id = be23fe72-b268-44eb-a25a-ee905300ffb6 response_code = 200 uri = /crucible/0/regions/c147bdce-990b-45e4-8fd7-45de70408d58