Max level shown:
12026-01-30T21:15:02.864ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41957 req_id = 1a91d821-712e-439f-8a32-b4eb77fab0af response_code = 200 uri = /crucible/0/regions
22026-01-30T21:26:32.392ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:43865
32026-01-30T21:26:32.393ZINFOcrucible-agent (datafile): region 2c3a7724-289a-4b39-86cc-056c0e29e866 state: Requested
42026-01-30T21:26:32.393ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-01-30T21:26:32.393ZINFOcrucible-agent (dropshot): request completed latency_us = 861 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43865 req_id = 11e6e4fb-b30b-4ee4-aaaa-95e0e1218b40 response_code = 200 uri = /crucible/0/regions
62026-01-30T21:26:32.401ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1db5e01e-4368-4dc3-b6d6-8beb6b0397a4/crucible/regions/2c3a7724-289a-4b39-86cc-056c0e29e866
72026-01-30T21:26:32.401ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1db5e01e-4368-4dc3-b6d6-8beb6b0397a4/crucible/regions/2c3a7724-289a-4b39-86cc-056c0e29e866
82026-01-30T21:26:32.451ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2c3a7724-289a-4b39-86cc-056c0e29e866"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2c3a7724-289a-4b39-86cc-056c0e29e866" region = 2c3a7724-289a-4b39-86cc-056c0e29e866
92026-01-30T21:26:32.451ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2c3a7724-289a-4b39-86cc-056c0e29e866" "--data" "/data/regions/2c3a7724-289a-4b39-86cc-056c0e29e866" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2c3a7724-289a-4b39-86cc-056c0e29e866
102026-01-30T21:26:32.548ZINFOcrucible-agent (worker): region files created ok region = 2c3a7724-289a-4b39-86cc-056c0e29e866
112026-01-30T21:26:32.548ZINFOcrucible-agent (datafile): region 2c3a7724-289a-4b39-86cc-056c0e29e866 state: Requested -> Created
122026-01-30T21:26:32.548ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-01-30T21:26:32.567ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2c3a7724-289a-4b39-86cc-056c0e29e866
142026-01-30T21:26:32.574ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2c3a7724-289a-4b39-86cc-056c0e29e866
152026-01-30T21:26:32.584ZINFOcrucible-agent (worker): creating config property group
162026-01-30T21:26:32.586ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2c3a7724-289a-4b39-86cc-056c0e29e866
172026-01-30T21:26:32.587ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2c3a7724-289a-4b39-86cc-056c0e29e866
182026-01-30T21:26:32.587ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-01-30T21:26:32.587ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202026-01-30T21:26:32.587ZINFOcrucible-agent (worker): commit
212026-01-30T21:26:32.591ZINFOcrucible-agent (worker): ok!
222026-01-30T21:26:32.595ZINFOcrucible-agent (worker): SMF ok!
232026-01-30T21:26:32.686ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43865 req_id = 4a73b243-5366-440c-bb71-e0814f14a0ff response_code = 200 uri = /crucible/0/regions
242026-01-30T21:26:34.598ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43865 req_id = f384575b-6528-4cb8-9baa-508174f13510 response_code = 200 uri = /crucible/0/regions/1dbe230f-293e-43df-b146-359fa3674b04
252026-01-30T21:26:34.602ZINFOcrucible-agent (datafile): path is "/data/regions/1dbe230f-293e-43df-b146-359fa3674b04"
262026-01-30T21:26:34.609ZINFOcrucible-agent (datafile): dataset is oxp_1db5e01e-4368-4dc3-b6d6-8beb6b0397a4/crucible/regions/1dbe230f-293e-43df-b146-359fa3674b04
272026-01-30T21:26:34.617ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1db5e01e-4368-4dc3-b6d6-8beb6b0397a4/crucible/regions/1dbe230f-293e-43df-b146-359fa3674b04@27eb188d-9d22-462d-b2a2-e898021fd1f0
282026-01-30T21:26:34.617ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1db5e01e-4368-4dc3-b6d6-8beb6b0397a4/crucible/regions/1dbe230f-293e-43df-b146-359fa3674b04", "27eb188d-9d22-462d-b2a2-e898021fd1f0"]
292026-01-30T21:26:34.625ZINFOcrucible-agent (dropshot): request completed latency_us = 23264 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43865 req_id = 2dbc22f2-760e-4a3c-9ece-ef6a6178620b response_code = 200 uri = /crucible/0/regions/1dbe230f-293e-43df-b146-359fa3674b04/snapshots/27eb188d-9d22-462d-b2a2-e898021fd1f0
302026-01-30T21:26:34.629ZINFOcrucible-agent (datafile): path is "/data/regions/1dbe230f-293e-43df-b146-359fa3674b04"
312026-01-30T21:26:34.635ZINFOcrucible-agent (datafile): dataset is oxp_1db5e01e-4368-4dc3-b6d6-8beb6b0397a4/crucible/regions/1dbe230f-293e-43df-b146-359fa3674b04
322026-01-30T21:26:34.642ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1db5e01e-4368-4dc3-b6d6-8beb6b0397a4/crucible/regions/1dbe230f-293e-43df-b146-359fa3674b04@27eb188d-9d22-462d-b2a2-e898021fd1f0
332026-01-30T21:26:34.642ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1db5e01e-4368-4dc3-b6d6-8beb6b0397a4/crucible/regions/1dbe230f-293e-43df-b146-359fa3674b04", "27eb188d-9d22-462d-b2a2-e898021fd1f0"]
342026-01-30T21:26:34.650ZINFOcrucible-agent (datafile): requesting running snapshot 1dbe230f-293e-43df-b146-359fa3674b04-27eb188d-9d22-462d-b2a2-e898021fd1f0 state: Requested
352026-01-30T21:26:34.650ZINFOcrucible-agent (dropshot): request completed latency_us = 21368 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43865 req_id = 0e0090c7-d5c0-487f-af36-27bf095713c8 response_code = 200 uri = /crucible/0/regions/1dbe230f-293e-43df-b146-359fa3674b04/snapshots/27eb188d-9d22-462d-b2a2-e898021fd1f0/run
362026-01-30T21:26:34.650ZINFOcrucible-agent (worker): applying SMF actions for region 1dbe230f-293e-43df-b146-359fa3674b04 running snapshot 27eb188d-9d22-462d-b2a2-e898021fd1f0 (state Requested)...
372026-01-30T21:26:34.655ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-1dbe230f-293e-43df-b146-359fa3674b04-27eb188d-9d22-462d-b2a2-e898021fd1f0
382026-01-30T21:26:34.665ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-1dbe230f-293e-43df-b146-359fa3674b04-27eb188d-9d22-462d-b2a2-e898021fd1f0
392026-01-30T21:26:34.675ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-1dbe230f-293e-43df-b146-359fa3674b04-27eb188d-9d22-462d-b2a2-e898021fd1f0
402026-01-30T21:26:34.675ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1dbe230f-293e-43df-b146-359fa3674b04/.zfs/snapshot/27eb188d-9d22-462d-b2a2-e898021fd1f0
412026-01-30T21:26:34.675ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-01-30T21:26:34.675ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-01-30T21:26:34.675ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
442026-01-30T21:26:34.675ZINFOcrucible-agent (worker): commit
452026-01-30T21:26:34.679ZINFOcrucible-agent (worker): ok!
462026-01-30T21:26:34.683ZINFOcrucible-agent (worker): SMF ok!
472026-01-30T21:26:34.683ZINFOcrucible-agent (datafile): region 1dbe230f-293e-43df-b146-359fa3674b04 running snapshot 27eb188d-9d22-462d-b2a2-e898021fd1f0 state: Requested -> Created
482026-01-30T21:26:34.972ZINFOcrucible-agent (datafile): path is "/data/regions/1dbe230f-293e-43df-b146-359fa3674b04"
492026-01-30T21:26:34.979ZINFOcrucible-agent (datafile): dataset is oxp_1db5e01e-4368-4dc3-b6d6-8beb6b0397a4/crucible/regions/1dbe230f-293e-43df-b146-359fa3674b04
502026-01-30T21:26:34.986ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1db5e01e-4368-4dc3-b6d6-8beb6b0397a4/crucible/regions/1dbe230f-293e-43df-b146-359fa3674b04@27eb188d-9d22-462d-b2a2-e898021fd1f0
512026-01-30T21:26:34.986ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1db5e01e-4368-4dc3-b6d6-8beb6b0397a4/crucible/regions/1dbe230f-293e-43df-b146-359fa3674b04", "27eb188d-9d22-462d-b2a2-e898021fd1f0"]
522026-01-30T21:26:34.992ZINFOcrucible-agent (dropshot): request completed latency_us = 19929 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43865 req_id = 846aa61f-3410-46f1-ad77-a4a354f0bf66 response_code = 200 uri = /crucible/0/regions/1dbe230f-293e-43df-b146-359fa3674b04/snapshots/27eb188d-9d22-462d-b2a2-e898021fd1f0/run