Max level shown:
12025-12-18T21:33:16.206ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::b]:53478
22025-12-18T21:33:16.207ZINFOcrucible-agent (datafile): region 1aff98d8-0d5b-4b07-b67a-387e29e3672f state: Requested
32025-12-18T21:33:16.207ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-12-18T21:33:16.207ZINFOcrucible-agent (dropshot): request completed latency_us = 597 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:53478 req_id = b3426f70-bed0-4af0-80f3-0192b264241a response_code = 200 uri = /crucible/0/regions
52025-12-18T21:33:16.215ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_423d57ae-147d-4dfc-b0f3-47c12f517139/crucible/regions/1aff98d8-0d5b-4b07-b67a-387e29e3672f
62025-12-18T21:33:16.215ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_423d57ae-147d-4dfc-b0f3-47c12f517139/crucible/regions/1aff98d8-0d5b-4b07-b67a-387e29e3672f
72025-12-18T21:33:16.260ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1aff98d8-0d5b-4b07-b67a-387e29e3672f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1aff98d8-0d5b-4b07-b67a-387e29e3672f" region = 1aff98d8-0d5b-4b07-b67a-387e29e3672f
82025-12-18T21:33:16.260ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1aff98d8-0d5b-4b07-b67a-387e29e3672f" "--data" "/data/regions/1aff98d8-0d5b-4b07-b67a-387e29e3672f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 1aff98d8-0d5b-4b07-b67a-387e29e3672f
92025-12-18T21:33:16.359ZINFOcrucible-agent (worker): region files created ok region = 1aff98d8-0d5b-4b07-b67a-387e29e3672f
102025-12-18T21:33:16.359ZINFOcrucible-agent (datafile): region 1aff98d8-0d5b-4b07-b67a-387e29e3672f state: Requested -> Created
112025-12-18T21:33:16.359ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-12-18T21:33:16.379ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1aff98d8-0d5b-4b07-b67a-387e29e3672f
132025-12-18T21:33:16.385ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1aff98d8-0d5b-4b07-b67a-387e29e3672f
142025-12-18T21:33:16.394ZINFOcrucible-agent (worker): creating config property group
152025-12-18T21:33:16.397ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1aff98d8-0d5b-4b07-b67a-387e29e3672f
162025-12-18T21:33:16.397ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1aff98d8-0d5b-4b07-b67a-387e29e3672f
172025-12-18T21:33:16.397ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-12-18T21:33:16.397ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
192025-12-18T21:33:16.397ZINFOcrucible-agent (worker): commit
202025-12-18T21:33:16.401ZINFOcrucible-agent (worker): ok!
212025-12-18T21:33:16.406ZINFOcrucible-agent (worker): SMF ok!
222025-12-18T21:33:16.432ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:53478 req_id = 812c5192-516d-4ae6-9520-b51c2fe778a9 response_code = 200 uri = /crucible/0/regions
232025-12-18T21:33:17.587ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:53478 req_id = 8ef5010b-93cb-4943-9ed6-8a5f032d1337 response_code = 200 uri = /crucible/0/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced
242025-12-18T21:33:17.591ZINFOcrucible-agent (datafile): path is "/data/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced"
252025-12-18T21:33:17.598ZINFOcrucible-agent (datafile): dataset is oxp_423d57ae-147d-4dfc-b0f3-47c12f517139/crucible/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced
262025-12-18T21:33:17.604ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_423d57ae-147d-4dfc-b0f3-47c12f517139/crucible/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced@e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498
272025-12-18T21:33:17.604ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_423d57ae-147d-4dfc-b0f3-47c12f517139/crucible/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced", "e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498"]
282025-12-18T21:33:17.612ZINFOcrucible-agent (dropshot): request completed latency_us = 21825 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:53478 req_id = 28db57db-adb4-42c9-b14b-7beb7f8e9e0a response_code = 200 uri = /crucible/0/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced/snapshots/e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498
292025-12-18T21:33:17.616ZINFOcrucible-agent (datafile): path is "/data/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced"
302025-12-18T21:33:17.621ZINFOcrucible-agent (datafile): dataset is oxp_423d57ae-147d-4dfc-b0f3-47c12f517139/crucible/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced
312025-12-18T21:33:17.628ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_423d57ae-147d-4dfc-b0f3-47c12f517139/crucible/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced@e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498
322025-12-18T21:33:17.628ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_423d57ae-147d-4dfc-b0f3-47c12f517139/crucible/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced", "e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498"]
332025-12-18T21:33:17.635ZINFOcrucible-agent (datafile): requesting running snapshot 01bade03-b48e-4f8b-9dc6-b091a9926ced-e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498 state: Requested
342025-12-18T21:33:17.635ZINFOcrucible-agent (worker): applying SMF actions for region 01bade03-b48e-4f8b-9dc6-b091a9926ced running snapshot e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498 (state Requested)...
352025-12-18T21:33:17.635ZINFOcrucible-agent (dropshot): request completed latency_us = 19293 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:53478 req_id = eb1584bd-15c3-447e-8abf-e0f3ec041616 response_code = 200 uri = /crucible/0/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced/snapshots/e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498/run
362025-12-18T21:33:17.640ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-01bade03-b48e-4f8b-9dc6-b091a9926ced-e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498
372025-12-18T21:33:17.656ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-01bade03-b48e-4f8b-9dc6-b091a9926ced-e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498
382025-12-18T21:33:17.675ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-01bade03-b48e-4f8b-9dc6-b091a9926ced-e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498
392025-12-18T21:33:17.675ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced/.zfs/snapshot/e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498
402025-12-18T21:33:17.675ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-12-18T21:33:17.675ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-12-18T21:33:17.675ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
432025-12-18T21:33:17.675ZINFOcrucible-agent (worker): commit
442025-12-18T21:33:17.690ZINFOcrucible-agent (worker): ok!
452025-12-18T21:33:17.702ZINFOcrucible-agent (worker): SMF ok!
462025-12-18T21:33:17.702ZINFOcrucible-agent (datafile): region 01bade03-b48e-4f8b-9dc6-b091a9926ced running snapshot e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498 state: Requested -> Created
472025-12-18T21:33:17.933ZINFOcrucible-agent (datafile): path is "/data/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced"
482025-12-18T21:33:17.939ZINFOcrucible-agent (datafile): dataset is oxp_423d57ae-147d-4dfc-b0f3-47c12f517139/crucible/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced
492025-12-18T21:33:17.945ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_423d57ae-147d-4dfc-b0f3-47c12f517139/crucible/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced@e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498
502025-12-18T21:33:17.945ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_423d57ae-147d-4dfc-b0f3-47c12f517139/crucible/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced", "e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498"]
512025-12-18T21:33:17.951ZINFOcrucible-agent (dropshot): request completed latency_us = 18661 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:53478 req_id = af809bc5-bc6d-40e0-a9cb-bda7d0d5a2ef response_code = 200 uri = /crucible/0/regions/01bade03-b48e-4f8b-9dc6-b091a9926ced/snapshots/e45c57bd-e6bc-42cf-9e9d-3dfaba1ec498/run