Max level shown:
12026-02-10T18:51:52.952ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:55280
22026-02-10T18:51:52.952ZINFOcrucible-agent (datafile): region 3d713fd4-8d98-4d2a-9272-ac291631c372 state: Requested
32026-02-10T18:51:52.953ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-02-10T18:51:52.953ZINFOcrucible-agent (dropshot): request completed latency_us = 612 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55280 req_id = 8c8fbc9d-0bda-4403-ada3-63d8b9fec162 response_code = 200 uri = /crucible/0/regions
52026-02-10T18:51:52.962ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6b0d905e-93d2-4846-b0e5-85e714d0079f/crucible/regions/3d713fd4-8d98-4d2a-9272-ac291631c372
62026-02-10T18:51:52.962ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6b0d905e-93d2-4846-b0e5-85e714d0079f/crucible/regions/3d713fd4-8d98-4d2a-9272-ac291631c372
72026-02-10T18:51:53.009ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3d713fd4-8d98-4d2a-9272-ac291631c372"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3d713fd4-8d98-4d2a-9272-ac291631c372" region = 3d713fd4-8d98-4d2a-9272-ac291631c372
82026-02-10T18:51:53.009ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3d713fd4-8d98-4d2a-9272-ac291631c372" "--data" "/data/regions/3d713fd4-8d98-4d2a-9272-ac291631c372" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3d713fd4-8d98-4d2a-9272-ac291631c372
92026-02-10T18:51:53.088ZINFOcrucible-agent (worker): region files created ok region = 3d713fd4-8d98-4d2a-9272-ac291631c372
102026-02-10T18:51:53.088ZINFOcrucible-agent (datafile): region 3d713fd4-8d98-4d2a-9272-ac291631c372 state: Requested -> Created
112026-02-10T18:51:53.088ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-02-10T18:51:53.089ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3d713fd4-8d98-4d2a-9272-ac291631c372
132026-02-10T18:51:53.099ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3d713fd4-8d98-4d2a-9272-ac291631c372
142026-02-10T18:51:53.121ZINFOcrucible-agent (worker): creating config property group
152026-02-10T18:51:53.125ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3d713fd4-8d98-4d2a-9272-ac291631c372
162026-02-10T18:51:53.125ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3d713fd4-8d98-4d2a-9272-ac291631c372
172026-02-10T18:51:53.125ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-02-10T18:51:53.125ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
192026-02-10T18:51:53.125ZINFOcrucible-agent (worker): commit
202026-02-10T18:51:53.129ZINFOcrucible-agent (worker): ok!
212026-02-10T18:51:53.144ZINFOcrucible-agent (worker): SMF ok!
222026-02-10T18:51:53.258ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55280 req_id = c275333d-fbe6-4ed5-acd4-7324fe8db3d7 response_code = 200 uri = /crucible/0/regions
232026-02-10T18:51:54.682ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:55280 req_id = 93b14570-7d85-44e2-8578-bfaeae9546d7 response_code = 200 uri = /crucible/0/regions/e18be93f-1a5a-4878-8dde-94997f8056dc
242026-02-10T18:51:54.686ZINFOcrucible-agent (datafile): path is "/data/regions/e18be93f-1a5a-4878-8dde-94997f8056dc"
252026-02-10T18:51:54.692ZINFOcrucible-agent (datafile): dataset is oxp_6b0d905e-93d2-4846-b0e5-85e714d0079f/crucible/regions/e18be93f-1a5a-4878-8dde-94997f8056dc
262026-02-10T18:51:54.699ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6b0d905e-93d2-4846-b0e5-85e714d0079f/crucible/regions/e18be93f-1a5a-4878-8dde-94997f8056dc@0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4
272026-02-10T18:51:54.699ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6b0d905e-93d2-4846-b0e5-85e714d0079f/crucible/regions/e18be93f-1a5a-4878-8dde-94997f8056dc", "0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4"]
282026-02-10T18:51:54.707ZINFOcrucible-agent (dropshot): request completed latency_us = 21723 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:55280 req_id = 04ef2ac3-3427-48e6-a157-8becb66c4b96 response_code = 200 uri = /crucible/0/regions/e18be93f-1a5a-4878-8dde-94997f8056dc/snapshots/0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4
292026-02-10T18:51:54.711ZINFOcrucible-agent (datafile): path is "/data/regions/e18be93f-1a5a-4878-8dde-94997f8056dc"
302026-02-10T18:51:54.716ZINFOcrucible-agent (datafile): dataset is oxp_6b0d905e-93d2-4846-b0e5-85e714d0079f/crucible/regions/e18be93f-1a5a-4878-8dde-94997f8056dc
312026-02-10T18:51:54.722ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6b0d905e-93d2-4846-b0e5-85e714d0079f/crucible/regions/e18be93f-1a5a-4878-8dde-94997f8056dc@0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4
322026-02-10T18:51:54.722ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6b0d905e-93d2-4846-b0e5-85e714d0079f/crucible/regions/e18be93f-1a5a-4878-8dde-94997f8056dc", "0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4"]
332026-02-10T18:51:54.730ZINFOcrucible-agent (datafile): requesting running snapshot e18be93f-1a5a-4878-8dde-94997f8056dc-0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4 state: Requested
342026-02-10T18:51:54.730ZINFOcrucible-agent (dropshot): request completed latency_us = 19315 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55280 req_id = 2c08faaf-cfb7-4574-8a1d-95696ced8da0 response_code = 200 uri = /crucible/0/regions/e18be93f-1a5a-4878-8dde-94997f8056dc/snapshots/0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4/run
352026-02-10T18:51:54.730ZINFOcrucible-agent (worker): applying SMF actions for region e18be93f-1a5a-4878-8dde-94997f8056dc running snapshot 0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4 (state Requested)...
362026-02-10T18:51:54.734ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-e18be93f-1a5a-4878-8dde-94997f8056dc-0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4
372026-02-10T18:51:54.747ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-e18be93f-1a5a-4878-8dde-94997f8056dc-0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4
382026-02-10T18:51:54.758ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-e18be93f-1a5a-4878-8dde-94997f8056dc-0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4
392026-02-10T18:51:54.758ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e18be93f-1a5a-4878-8dde-94997f8056dc/.zfs/snapshot/0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4
402026-02-10T18:51:54.758ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-02-10T18:51:54.758ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-02-10T18:51:54.758ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
432026-02-10T18:51:54.758ZINFOcrucible-agent (worker): commit
442026-02-10T18:51:54.763ZINFOcrucible-agent (worker): ok!
452026-02-10T18:51:54.767ZINFOcrucible-agent (worker): SMF ok!
462026-02-10T18:51:54.767ZINFOcrucible-agent (datafile): region e18be93f-1a5a-4878-8dde-94997f8056dc running snapshot 0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4 state: Requested -> Created
472026-02-10T18:51:54.898ZINFOcrucible-agent (datafile): path is "/data/regions/e18be93f-1a5a-4878-8dde-94997f8056dc"
482026-02-10T18:51:54.904ZINFOcrucible-agent (datafile): dataset is oxp_6b0d905e-93d2-4846-b0e5-85e714d0079f/crucible/regions/e18be93f-1a5a-4878-8dde-94997f8056dc
492026-02-10T18:51:54.909ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6b0d905e-93d2-4846-b0e5-85e714d0079f/crucible/regions/e18be93f-1a5a-4878-8dde-94997f8056dc@0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4
502026-02-10T18:51:54.909ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6b0d905e-93d2-4846-b0e5-85e714d0079f/crucible/regions/e18be93f-1a5a-4878-8dde-94997f8056dc", "0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4"]
512026-02-10T18:51:54.916ZINFOcrucible-agent (dropshot): request completed latency_us = 18135 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55280 req_id = a650ef16-281d-45c9-a568-5a1eec796b17 response_code = 200 uri = /crucible/0/regions/e18be93f-1a5a-4878-8dde-94997f8056dc/snapshots/0b52460a-e5cc-43ee-8f3d-fa0bb651cfc4/run