Max level shown:
12025-12-17T01:02:39.942ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:64849
22025-12-17T01:02:39.942ZINFOcrucible-agent (datafile): region 5853d254-836e-4309-8e8c-e21e60046b77 state: Requested
32025-12-17T01:02:39.950ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-12-17T01:02:39.950ZINFOcrucible-agent (dropshot): request completed latency_us = 8547 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:64849 req_id = 96d16fca-062e-46ba-ae03-3b61e4fb9609 response_code = 200 uri = /crucible/0/regions
52025-12-17T01:02:39.971ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e1d7dc7c-091f-445c-b1ea-32d64fb1d939/crucible/regions/5853d254-836e-4309-8e8c-e21e60046b77
62025-12-17T01:02:39.971ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e1d7dc7c-091f-445c-b1ea-32d64fb1d939/crucible/regions/5853d254-836e-4309-8e8c-e21e60046b77
72025-12-17T01:02:40.234ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:64849 req_id = 0e46f693-3ffe-4838-91e0-51feed1f0bb1 response_code = 200 uri = /crucible/0/regions
82025-12-17T01:02:40.243ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5853d254-836e-4309-8e8c-e21e60046b77"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5853d254-836e-4309-8e8c-e21e60046b77" region = 5853d254-836e-4309-8e8c-e21e60046b77
92025-12-17T01:02:40.243ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5853d254-836e-4309-8e8c-e21e60046b77" "--data" "/data/regions/5853d254-836e-4309-8e8c-e21e60046b77" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5853d254-836e-4309-8e8c-e21e60046b77
102025-12-17T01:02:40.529ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:64849 req_id = 2c34adc6-0659-46f8-a428-43b0cd4fabbe response_code = 200 uri = /crucible/0/regions
112025-12-17T01:02:40.602ZINFOcrucible-agent (worker): region files created ok region = 5853d254-836e-4309-8e8c-e21e60046b77
122025-12-17T01:02:40.602ZINFOcrucible-agent (datafile): region 5853d254-836e-4309-8e8c-e21e60046b77 state: Requested -> Created
132025-12-17T01:02:40.602ZINFOcrucible-agent (worker): applying SMF actions post create...
142025-12-17T01:02:40.603ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5853d254-836e-4309-8e8c-e21e60046b77
152025-12-17T01:02:40.737ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5853d254-836e-4309-8e8c-e21e60046b77
162025-12-17T01:02:40.890ZINFOcrucible-agent (worker): creating config property group
172025-12-17T01:02:40.921ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5853d254-836e-4309-8e8c-e21e60046b77
182025-12-17T01:02:40.921ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5853d254-836e-4309-8e8c-e21e60046b77
192025-12-17T01:02:40.921ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
202025-12-17T01:02:40.921ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
212025-12-17T01:02:40.921ZINFOcrucible-agent (worker): commit
222025-12-17T01:02:40.991ZINFOcrucible-agent (worker): ok!
232025-12-17T01:02:41.110ZINFOcrucible-agent (worker): SMF ok!
242025-12-17T01:02:41.801ZINFOcrucible-agent (dropshot): request completed latency_us = 90 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:64849 req_id = 2ab8c06c-d87a-452d-91b0-c575ed21aad5 response_code = 200 uri = /crucible/0/regions
252025-12-17T01:02:42.644ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:64849 req_id = 5d3032a6-f114-4272-af3f-e01479bee664 response_code = 200 uri = /crucible/0/regions/97482a95-e827-41cc-838f-78bc05e8e484
262025-12-17T01:02:42.649ZINFOcrucible-agent (datafile): path is "/data/regions/97482a95-e827-41cc-838f-78bc05e8e484"
272025-12-17T01:02:42.655ZINFOcrucible-agent (datafile): dataset is oxp_e1d7dc7c-091f-445c-b1ea-32d64fb1d939/crucible/regions/97482a95-e827-41cc-838f-78bc05e8e484
282025-12-17T01:02:42.662ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_e1d7dc7c-091f-445c-b1ea-32d64fb1d939/crucible/regions/97482a95-e827-41cc-838f-78bc05e8e484@0201e4cf-933d-4f9d-b732-8abdb0ef2ba3
292025-12-17T01:02:42.662ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_e1d7dc7c-091f-445c-b1ea-32d64fb1d939/crucible/regions/97482a95-e827-41cc-838f-78bc05e8e484", "0201e4cf-933d-4f9d-b732-8abdb0ef2ba3"]
302025-12-17T01:02:42.673ZINFOcrucible-agent (dropshot): request completed latency_us = 24067 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:64849 req_id = c52a7bf5-c325-4ab2-ada1-cbf27302e2e8 response_code = 200 uri = /crucible/0/regions/97482a95-e827-41cc-838f-78bc05e8e484/snapshots/0201e4cf-933d-4f9d-b732-8abdb0ef2ba3
312025-12-17T01:02:42.681ZINFOcrucible-agent (datafile): path is "/data/regions/97482a95-e827-41cc-838f-78bc05e8e484"
322025-12-17T01:02:42.685ZINFOcrucible-agent (datafile): dataset is oxp_e1d7dc7c-091f-445c-b1ea-32d64fb1d939/crucible/regions/97482a95-e827-41cc-838f-78bc05e8e484
332025-12-17T01:02:42.690ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_e1d7dc7c-091f-445c-b1ea-32d64fb1d939/crucible/regions/97482a95-e827-41cc-838f-78bc05e8e484@0201e4cf-933d-4f9d-b732-8abdb0ef2ba3
342025-12-17T01:02:42.690ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_e1d7dc7c-091f-445c-b1ea-32d64fb1d939/crucible/regions/97482a95-e827-41cc-838f-78bc05e8e484", "0201e4cf-933d-4f9d-b732-8abdb0ef2ba3"]
352025-12-17T01:02:42.701ZINFOcrucible-agent (datafile): requesting running snapshot 97482a95-e827-41cc-838f-78bc05e8e484-0201e4cf-933d-4f9d-b732-8abdb0ef2ba3 state: Requested
362025-12-17T01:02:42.701ZINFOcrucible-agent (dropshot): request completed latency_us = 20426 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:64849 req_id = 605d4961-3329-4d91-bb64-e167f526e707 response_code = 200 uri = /crucible/0/regions/97482a95-e827-41cc-838f-78bc05e8e484/snapshots/0201e4cf-933d-4f9d-b732-8abdb0ef2ba3/run
372025-12-17T01:02:42.701ZINFOcrucible-agent (worker): applying SMF actions for region 97482a95-e827-41cc-838f-78bc05e8e484 running snapshot 0201e4cf-933d-4f9d-b732-8abdb0ef2ba3 (state Requested)...
382025-12-17T01:02:42.706ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-97482a95-e827-41cc-838f-78bc05e8e484-0201e4cf-933d-4f9d-b732-8abdb0ef2ba3
392025-12-17T01:02:42.723ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-97482a95-e827-41cc-838f-78bc05e8e484-0201e4cf-933d-4f9d-b732-8abdb0ef2ba3
402025-12-17T01:02:42.772ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-97482a95-e827-41cc-838f-78bc05e8e484-0201e4cf-933d-4f9d-b732-8abdb0ef2ba3
412025-12-17T01:02:42.773ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/97482a95-e827-41cc-838f-78bc05e8e484/.zfs/snapshot/0201e4cf-933d-4f9d-b732-8abdb0ef2ba3
422025-12-17T01:02:42.773ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
432025-12-17T01:02:42.773ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442025-12-17T01:02:42.773ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
452025-12-17T01:02:42.773ZINFOcrucible-agent (worker): commit
462025-12-17T01:02:42.797ZINFOcrucible-agent (worker): ok!
472025-12-17T01:02:42.809ZINFOcrucible-agent (worker): SMF ok!
482025-12-17T01:02:42.809ZINFOcrucible-agent (datafile): region 97482a95-e827-41cc-838f-78bc05e8e484 running snapshot 0201e4cf-933d-4f9d-b732-8abdb0ef2ba3 state: Requested -> Created
492025-12-17T01:02:42.908ZINFOcrucible-agent (datafile): path is "/data/regions/97482a95-e827-41cc-838f-78bc05e8e484"
502025-12-17T01:02:42.915ZINFOcrucible-agent (datafile): dataset is oxp_e1d7dc7c-091f-445c-b1ea-32d64fb1d939/crucible/regions/97482a95-e827-41cc-838f-78bc05e8e484
512025-12-17T01:02:42.921ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_e1d7dc7c-091f-445c-b1ea-32d64fb1d939/crucible/regions/97482a95-e827-41cc-838f-78bc05e8e484@0201e4cf-933d-4f9d-b732-8abdb0ef2ba3
522025-12-17T01:02:42.921ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_e1d7dc7c-091f-445c-b1ea-32d64fb1d939/crucible/regions/97482a95-e827-41cc-838f-78bc05e8e484", "0201e4cf-933d-4f9d-b732-8abdb0ef2ba3"]
532025-12-17T01:02:42.927ZINFOcrucible-agent (dropshot): request completed latency_us = 18474 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:64849 req_id = c75d726c-c472-4c6f-8e18-1510f1457540 response_code = 200 uri = /crucible/0/regions/97482a95-e827-41cc-838f-78bc05e8e484/snapshots/0201e4cf-933d-4f9d-b732-8abdb0ef2ba3/run