Max level shown:
12026-10-15T20:04:58.624ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::c]:35935
22026-10-15T20:04:58.624ZINFOcrucible-agent (datafile): region 2453b2ea-fac1-45ce-99e6-beb77e76c5ec state: Requested
32026-10-15T20:04:58.625ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-10-15T20:04:58.625ZINFOcrucible-agent (dropshot): request completed latency_us = 671 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:35935 req_id = ef1bc968-eba1-44d7-9d99-9acd3e819485 response_code = 200 uri = /crucible/0/regions
52026-10-15T20:04:58.636ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d98953b0-00d5-4387-8cc9-96a712a0c2d4/crucible/regions/2453b2ea-fac1-45ce-99e6-beb77e76c5ec
62026-10-15T20:04:58.636ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d98953b0-00d5-4387-8cc9-96a712a0c2d4/crucible/regions/2453b2ea-fac1-45ce-99e6-beb77e76c5ec
72026-10-15T20:04:58.676ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2453b2ea-fac1-45ce-99e6-beb77e76c5ec"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2453b2ea-fac1-45ce-99e6-beb77e76c5ec" region = 2453b2ea-fac1-45ce-99e6-beb77e76c5ec
82026-10-15T20:04:58.676ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2453b2ea-fac1-45ce-99e6-beb77e76c5ec" "--data" "/data/regions/2453b2ea-fac1-45ce-99e6-beb77e76c5ec" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2453b2ea-fac1-45ce-99e6-beb77e76c5ec
92026-10-15T20:04:58.726ZINFOcrucible-agent (worker): region files created ok region = 2453b2ea-fac1-45ce-99e6-beb77e76c5ec
102026-10-15T20:04:58.726ZINFOcrucible-agent (datafile): region 2453b2ea-fac1-45ce-99e6-beb77e76c5ec state: Requested -> Created
112026-10-15T20:04:58.726ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-10-15T20:04:58.727ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2453b2ea-fac1-45ce-99e6-beb77e76c5ec
132026-10-15T20:04:58.735ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2453b2ea-fac1-45ce-99e6-beb77e76c5ec
142026-10-15T20:04:58.748ZINFOcrucible-agent (worker): creating config property group
152026-10-15T20:04:58.749ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2453b2ea-fac1-45ce-99e6-beb77e76c5ec
162026-10-15T20:04:58.750ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2453b2ea-fac1-45ce-99e6-beb77e76c5ec
172026-10-15T20:04:58.750ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-10-15T20:04:58.750ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
192026-10-15T20:04:58.750ZINFOcrucible-agent (worker): commit
202026-10-15T20:04:58.751ZINFOcrucible-agent (worker): ok!
212026-10-15T20:04:58.755ZINFOcrucible-agent (worker): SMF ok!
222026-10-15T20:04:58.865ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:35935 req_id = 41c23095-fc55-4d7c-bc0b-202b4cdaa27e response_code = 200 uri = /crucible/0/regions
232026-10-15T20:04:59.814ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:35935 req_id = 715b6f09-4bf5-4f57-b6f5-f2ba97703812 response_code = 200 uri = /crucible/0/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a
242026-10-15T20:04:59.821ZINFOcrucible-agent (datafile): path is "/data/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a"
252026-10-15T20:04:59.827ZINFOcrucible-agent (datafile): dataset is oxp_d98953b0-00d5-4387-8cc9-96a712a0c2d4/crucible/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a
262026-10-15T20:04:59.833ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d98953b0-00d5-4387-8cc9-96a712a0c2d4/crucible/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a@811a09af-5489-45b1-85ac-782958bf2ebf
272026-10-15T20:04:59.833ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d98953b0-00d5-4387-8cc9-96a712a0c2d4/crucible/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a", "811a09af-5489-45b1-85ac-782958bf2ebf"]
282026-10-15T20:04:59.844ZINFOcrucible-agent (dropshot): request completed latency_us = 26306 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:35935 req_id = 032acd34-d28d-41da-b39c-0e4a72484c0f response_code = 200 uri = /crucible/0/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a/snapshots/811a09af-5489-45b1-85ac-782958bf2ebf
292026-10-15T20:04:59.853ZINFOcrucible-agent (datafile): path is "/data/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a"
302026-10-15T20:04:59.861ZINFOcrucible-agent (datafile): dataset is oxp_d98953b0-00d5-4387-8cc9-96a712a0c2d4/crucible/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a
312026-10-15T20:04:59.868ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d98953b0-00d5-4387-8cc9-96a712a0c2d4/crucible/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a@811a09af-5489-45b1-85ac-782958bf2ebf
322026-10-15T20:04:59.868ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d98953b0-00d5-4387-8cc9-96a712a0c2d4/crucible/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a", "811a09af-5489-45b1-85ac-782958bf2ebf"]
332026-10-15T20:04:59.876ZINFOcrucible-agent (datafile): requesting running snapshot 3b2410cd-0c24-4552-8b1e-b3bfc2ad538a-811a09af-5489-45b1-85ac-782958bf2ebf state: Requested
342026-10-15T20:04:59.876ZINFOcrucible-agent (worker): applying SMF actions for region 3b2410cd-0c24-4552-8b1e-b3bfc2ad538a running snapshot 811a09af-5489-45b1-85ac-782958bf2ebf (state Requested)...
352026-10-15T20:04:59.876ZINFOcrucible-agent (dropshot): request completed latency_us = 22792 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:35935 req_id = 90ffc465-72bd-495f-91da-bf94620dcc05 response_code = 200 uri = /crucible/0/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a/snapshots/811a09af-5489-45b1-85ac-782958bf2ebf/run
362026-10-15T20:04:59.878ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-3b2410cd-0c24-4552-8b1e-b3bfc2ad538a-811a09af-5489-45b1-85ac-782958bf2ebf
372026-10-15T20:04:59.882ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-3b2410cd-0c24-4552-8b1e-b3bfc2ad538a-811a09af-5489-45b1-85ac-782958bf2ebf
382026-10-15T20:04:59.887ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-3b2410cd-0c24-4552-8b1e-b3bfc2ad538a-811a09af-5489-45b1-85ac-782958bf2ebf
392026-10-15T20:04:59.887ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a/.zfs/snapshot/811a09af-5489-45b1-85ac-782958bf2ebf
402026-10-15T20:04:59.887ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-10-15T20:04:59.887ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-10-15T20:04:59.887ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
432026-10-15T20:04:59.887ZINFOcrucible-agent (worker): commit
442026-10-15T20:04:59.890ZINFOcrucible-agent (worker): ok!
452026-10-15T20:04:59.892ZINFOcrucible-agent (worker): SMF ok!
462026-10-15T20:04:59.892ZINFOcrucible-agent (datafile): region 3b2410cd-0c24-4552-8b1e-b3bfc2ad538a running snapshot 811a09af-5489-45b1-85ac-782958bf2ebf state: Requested -> Created
472026-10-15T20:05:00.019ZINFOcrucible-agent (datafile): path is "/data/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a"
482026-10-15T20:05:00.027ZINFOcrucible-agent (datafile): dataset is oxp_d98953b0-00d5-4387-8cc9-96a712a0c2d4/crucible/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a
492026-10-15T20:05:00.034ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d98953b0-00d5-4387-8cc9-96a712a0c2d4/crucible/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a@811a09af-5489-45b1-85ac-782958bf2ebf
502026-10-15T20:05:00.034ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d98953b0-00d5-4387-8cc9-96a712a0c2d4/crucible/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a", "811a09af-5489-45b1-85ac-782958bf2ebf"]
512026-10-15T20:05:00.042ZINFOcrucible-agent (dropshot): request completed latency_us = 22558 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:35935 req_id = 52248d08-3540-4498-91ab-2224e75ae8e1 response_code = 200 uri = /crucible/0/regions/3b2410cd-0c24-4552-8b1e-b3bfc2ad538a/snapshots/811a09af-5489-45b1-85ac-782958bf2ebf/run