Max level shown:
12026-09-05T00:36:14.347ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:50816
22026-09-05T00:36:14.347ZINFOcrucible-agent (datafile): region ca5d3afc-1ceb-4745-8a89-fdb2bff6a2e2 state: Requested
32026-09-05T00:36:14.348ZINFOcrucible-agent (dropshot): request completed latency_us = 892 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50816 req_id = 049174e9-ebc1-4762-a506-3213a2a722a2 response_code = 200 uri = /crucible/0/regions
42026-09-05T00:36:14.348ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-09-05T00:36:14.356ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9093df70-a250-469c-a5d4-721c97d7d8fc/crucible/regions/ca5d3afc-1ceb-4745-8a89-fdb2bff6a2e2
62026-09-05T00:36:14.356ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9093df70-a250-469c-a5d4-721c97d7d8fc/crucible/regions/ca5d3afc-1ceb-4745-8a89-fdb2bff6a2e2
72026-09-05T00:36:14.400ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ca5d3afc-1ceb-4745-8a89-fdb2bff6a2e2"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ca5d3afc-1ceb-4745-8a89-fdb2bff6a2e2" region = ca5d3afc-1ceb-4745-8a89-fdb2bff6a2e2
82026-09-05T00:36:14.400ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ca5d3afc-1ceb-4745-8a89-fdb2bff6a2e2" "--data" "/data/regions/ca5d3afc-1ceb-4745-8a89-fdb2bff6a2e2" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ca5d3afc-1ceb-4745-8a89-fdb2bff6a2e2
92026-09-05T00:36:14.450ZINFOcrucible-agent (worker): region files created ok region = ca5d3afc-1ceb-4745-8a89-fdb2bff6a2e2
102026-09-05T00:36:14.450ZINFOcrucible-agent (datafile): region ca5d3afc-1ceb-4745-8a89-fdb2bff6a2e2 state: Requested -> Created
112026-09-05T00:36:14.450ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-09-05T00:36:14.458ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ca5d3afc-1ceb-4745-8a89-fdb2bff6a2e2
132026-09-05T00:36:14.459ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ca5d3afc-1ceb-4745-8a89-fdb2bff6a2e2
142026-09-05T00:36:14.465ZINFOcrucible-agent (worker): creating config property group
152026-09-05T00:36:14.466ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ca5d3afc-1ceb-4745-8a89-fdb2bff6a2e2
162026-09-05T00:36:14.467ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ca5d3afc-1ceb-4745-8a89-fdb2bff6a2e2
172026-09-05T00:36:14.467ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-09-05T00:36:14.467ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
192026-09-05T00:36:14.467ZINFOcrucible-agent (worker): commit
202026-09-05T00:36:14.469ZINFOcrucible-agent (worker): ok!
212026-09-05T00:36:14.471ZINFOcrucible-agent (worker): SMF ok!
222026-09-05T00:36:14.656ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50816 req_id = ba7b1092-6791-495e-ab43-a1d9ce1ec415 response_code = 200 uri = /crucible/0/regions
232026-09-05T00:36:15.606ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:50816 req_id = be89a496-6e9a-4893-a4a5-ce1099314401 response_code = 200 uri = /crucible/0/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197
242026-09-05T00:36:15.610ZINFOcrucible-agent (datafile): path is "/data/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197"
252026-09-05T00:36:15.617ZINFOcrucible-agent (datafile): dataset is oxp_9093df70-a250-469c-a5d4-721c97d7d8fc/crucible/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197
262026-09-05T00:36:15.623ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_9093df70-a250-469c-a5d4-721c97d7d8fc/crucible/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197@100b5b94-94f1-45b6-ab13-c5a4cdf0432e
272026-09-05T00:36:15.623ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_9093df70-a250-469c-a5d4-721c97d7d8fc/crucible/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197", "100b5b94-94f1-45b6-ab13-c5a4cdf0432e"]
282026-09-05T00:36:15.633ZINFOcrucible-agent (dropshot): request completed latency_us = 22966 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:50816 req_id = cdf423f7-ca1b-4038-bb68-3be952680b16 response_code = 200 uri = /crucible/0/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197/snapshots/100b5b94-94f1-45b6-ab13-c5a4cdf0432e
292026-09-05T00:36:15.644ZINFOcrucible-agent (datafile): path is "/data/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197"
302026-09-05T00:36:15.651ZINFOcrucible-agent (datafile): dataset is oxp_9093df70-a250-469c-a5d4-721c97d7d8fc/crucible/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197
312026-09-05T00:36:15.657ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_9093df70-a250-469c-a5d4-721c97d7d8fc/crucible/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197@100b5b94-94f1-45b6-ab13-c5a4cdf0432e
322026-09-05T00:36:15.657ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_9093df70-a250-469c-a5d4-721c97d7d8fc/crucible/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197", "100b5b94-94f1-45b6-ab13-c5a4cdf0432e"]
332026-09-05T00:36:15.665ZINFOcrucible-agent (datafile): requesting running snapshot b2210eea-cad6-4fa0-98b7-5b9a16ca2197-100b5b94-94f1-45b6-ab13-c5a4cdf0432e state: Requested
342026-09-05T00:36:15.671ZINFOcrucible-agent (worker): applying SMF actions for region b2210eea-cad6-4fa0-98b7-5b9a16ca2197 running snapshot 100b5b94-94f1-45b6-ab13-c5a4cdf0432e (state Requested)...
352026-09-05T00:36:15.671ZINFOcrucible-agent (dropshot): request completed latency_us = 26685 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50816 req_id = c3212ec3-f83b-4541-94e2-b5c8009b23b3 response_code = 200 uri = /crucible/0/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197/snapshots/100b5b94-94f1-45b6-ab13-c5a4cdf0432e/run
362026-09-05T00:36:15.673ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-b2210eea-cad6-4fa0-98b7-5b9a16ca2197-100b5b94-94f1-45b6-ab13-c5a4cdf0432e
372026-09-05T00:36:15.676ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-b2210eea-cad6-4fa0-98b7-5b9a16ca2197-100b5b94-94f1-45b6-ab13-c5a4cdf0432e
382026-09-05T00:36:15.680ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-b2210eea-cad6-4fa0-98b7-5b9a16ca2197-100b5b94-94f1-45b6-ab13-c5a4cdf0432e
392026-09-05T00:36:15.680ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197/.zfs/snapshot/100b5b94-94f1-45b6-ab13-c5a4cdf0432e
402026-09-05T00:36:15.681ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-09-05T00:36:15.681ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-09-05T00:36:15.681ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
432026-09-05T00:36:15.681ZINFOcrucible-agent (worker): commit
442026-09-05T00:36:15.684ZINFOcrucible-agent (worker): ok!
452026-09-05T00:36:15.691ZINFOcrucible-agent (worker): SMF ok!
462026-09-05T00:36:15.691ZINFOcrucible-agent (datafile): region b2210eea-cad6-4fa0-98b7-5b9a16ca2197 running snapshot 100b5b94-94f1-45b6-ab13-c5a4cdf0432e state: Requested -> Created
472026-09-05T00:36:15.871ZINFOcrucible-agent (datafile): path is "/data/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197"
482026-09-05T00:36:15.878ZINFOcrucible-agent (datafile): dataset is oxp_9093df70-a250-469c-a5d4-721c97d7d8fc/crucible/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197
492026-09-05T00:36:15.884ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_9093df70-a250-469c-a5d4-721c97d7d8fc/crucible/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197@100b5b94-94f1-45b6-ab13-c5a4cdf0432e
502026-09-05T00:36:15.884ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_9093df70-a250-469c-a5d4-721c97d7d8fc/crucible/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197", "100b5b94-94f1-45b6-ab13-c5a4cdf0432e"]
512026-09-05T00:36:15.892ZINFOcrucible-agent (dropshot): request completed latency_us = 20520 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50816 req_id = ff45cb60-31f6-4c0f-b2dd-46021127986c response_code = 200 uri = /crucible/0/regions/b2210eea-cad6-4fa0-98b7-5b9a16ca2197/snapshots/100b5b94-94f1-45b6-ab13-c5a4cdf0432e/run