Max level shown:
12026-02-24T04:04:03.730ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:41425
22026-02-24T04:04:03.730ZINFOcrucible-agent (datafile): region 3aa01c2d-96a6-4a8e-a634-9360208997a7 state: Requested
32026-02-24T04:04:03.735ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-02-24T04:04:03.735ZINFOcrucible-agent (dropshot): request completed latency_us = 4309 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41425 req_id = 43804504-b468-4130-8c01-328b8454c9b6 response_code = 200 uri = /crucible/0/regions
52026-02-24T04:04:03.743ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_96b3c5b7-f050-4ebd-9849-861299536ff1/crucible/regions/3aa01c2d-96a6-4a8e-a634-9360208997a7
62026-02-24T04:04:03.743ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_96b3c5b7-f050-4ebd-9849-861299536ff1/crucible/regions/3aa01c2d-96a6-4a8e-a634-9360208997a7
72026-02-24T04:04:03.870ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3aa01c2d-96a6-4a8e-a634-9360208997a7"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3aa01c2d-96a6-4a8e-a634-9360208997a7" region = 3aa01c2d-96a6-4a8e-a634-9360208997a7
82026-02-24T04:04:03.870ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3aa01c2d-96a6-4a8e-a634-9360208997a7" "--data" "/data/regions/3aa01c2d-96a6-4a8e-a634-9360208997a7" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3aa01c2d-96a6-4a8e-a634-9360208997a7
92026-02-24T04:04:03.876ZINFOcrucible-agent (dropshot): request completed latency_us = 38 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41425 req_id = ac62643d-1124-4240-b0fc-322cfdaf4550 response_code = 200 uri = /crucible/0/regions
102026-02-24T04:04:04.175ZINFOcrucible-agent (worker): region files created ok region = 3aa01c2d-96a6-4a8e-a634-9360208997a7
112026-02-24T04:04:04.175ZINFOcrucible-agent (datafile): region 3aa01c2d-96a6-4a8e-a634-9360208997a7 state: Requested -> Created
122026-02-24T04:04:04.175ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-02-24T04:04:04.175ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3aa01c2d-96a6-4a8e-a634-9360208997a7
142026-02-24T04:04:04.192ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3aa01c2d-96a6-4a8e-a634-9360208997a7
152026-02-24T04:04:04.220ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41425 req_id = ba78839d-e6d7-4ffb-8899-ad22461f99ac response_code = 200 uri = /crucible/0/regions
162026-02-24T04:04:04.267ZINFOcrucible-agent (worker): creating config property group
172026-02-24T04:04:04.302ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3aa01c2d-96a6-4a8e-a634-9360208997a7
182026-02-24T04:04:04.303ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3aa01c2d-96a6-4a8e-a634-9360208997a7
192026-02-24T04:04:04.303ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
202026-02-24T04:04:04.303ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
212026-02-24T04:04:04.303ZINFOcrucible-agent (worker): commit
222026-02-24T04:04:04.318ZINFOcrucible-agent (worker): ok!
232026-02-24T04:04:04.396ZINFOcrucible-agent (worker): SMF ok!
242026-02-24T04:04:06.669ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41425 req_id = e91fd69e-7747-4a8d-baed-309d321a8ae4 response_code = 200 uri = /crucible/0/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005
252026-02-24T04:04:06.673ZINFOcrucible-agent (datafile): path is "/data/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005"
262026-02-24T04:04:06.679ZINFOcrucible-agent (datafile): dataset is oxp_96b3c5b7-f050-4ebd-9849-861299536ff1/crucible/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005
272026-02-24T04:04:06.686ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_96b3c5b7-f050-4ebd-9849-861299536ff1/crucible/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005@daa6572a-9b7a-4876-b797-08df237b7b22
282026-02-24T04:04:06.686ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_96b3c5b7-f050-4ebd-9849-861299536ff1/crucible/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005", "daa6572a-9b7a-4876-b797-08df237b7b22"]
292026-02-24T04:04:06.693ZINFOcrucible-agent (dropshot): request completed latency_us = 20464 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41425 req_id = ef5784ac-5c31-445b-bd55-01006238739d response_code = 200 uri = /crucible/0/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005/snapshots/daa6572a-9b7a-4876-b797-08df237b7b22
302026-02-24T04:04:06.696ZINFOcrucible-agent (datafile): path is "/data/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005"
312026-02-24T04:04:06.703ZINFOcrucible-agent (datafile): dataset is oxp_96b3c5b7-f050-4ebd-9849-861299536ff1/crucible/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005
322026-02-24T04:04:06.709ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_96b3c5b7-f050-4ebd-9849-861299536ff1/crucible/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005@daa6572a-9b7a-4876-b797-08df237b7b22
332026-02-24T04:04:06.709ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_96b3c5b7-f050-4ebd-9849-861299536ff1/crucible/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005", "daa6572a-9b7a-4876-b797-08df237b7b22"]
342026-02-24T04:04:06.721ZINFOcrucible-agent (datafile): requesting running snapshot aa5c8e5c-a11a-4e99-a191-a5eaad548005-daa6572a-9b7a-4876-b797-08df237b7b22 state: Requested
352026-02-24T04:04:06.721ZINFOcrucible-agent (dropshot): request completed latency_us = 24785 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41425 req_id = 728291b5-acc8-4b70-9211-22da6721b97c response_code = 200 uri = /crucible/0/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005/snapshots/daa6572a-9b7a-4876-b797-08df237b7b22/run
362026-02-24T04:04:06.721ZINFOcrucible-agent (worker): applying SMF actions for region aa5c8e5c-a11a-4e99-a191-a5eaad548005 running snapshot daa6572a-9b7a-4876-b797-08df237b7b22 (state Requested)...
372026-02-24T04:04:06.725ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-aa5c8e5c-a11a-4e99-a191-a5eaad548005-daa6572a-9b7a-4876-b797-08df237b7b22
382026-02-24T04:04:06.750ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-aa5c8e5c-a11a-4e99-a191-a5eaad548005-daa6572a-9b7a-4876-b797-08df237b7b22
392026-02-24T04:04:06.827ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-aa5c8e5c-a11a-4e99-a191-a5eaad548005-daa6572a-9b7a-4876-b797-08df237b7b22
402026-02-24T04:04:06.828ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005/.zfs/snapshot/daa6572a-9b7a-4876-b797-08df237b7b22
412026-02-24T04:04:06.828ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-02-24T04:04:06.828ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-02-24T04:04:06.828ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
442026-02-24T04:04:06.828ZINFOcrucible-agent (worker): commit
452026-02-24T04:04:06.841ZINFOcrucible-agent (worker): ok!
462026-02-24T04:04:06.859ZINFOcrucible-agent (datafile): path is "/data/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005"
472026-02-24T04:04:06.866ZINFOcrucible-agent (datafile): dataset is oxp_96b3c5b7-f050-4ebd-9849-861299536ff1/crucible/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005
482026-02-24T04:04:06.867ZINFOcrucible-agent (worker): SMF ok!
492026-02-24T04:04:06.867ZINFOcrucible-agent (datafile): region aa5c8e5c-a11a-4e99-a191-a5eaad548005 running snapshot daa6572a-9b7a-4876-b797-08df237b7b22 state: Requested -> Created
502026-02-24T04:04:06.872ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_96b3c5b7-f050-4ebd-9849-861299536ff1/crucible/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005@daa6572a-9b7a-4876-b797-08df237b7b22
512026-02-24T04:04:06.872ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_96b3c5b7-f050-4ebd-9849-861299536ff1/crucible/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005", "daa6572a-9b7a-4876-b797-08df237b7b22"]
522026-02-24T04:04:06.878ZINFOcrucible-agent (dropshot): request completed latency_us = 18395 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41425 req_id = 1b1fe0ee-2e32-4884-a5c6-93e7c5577a44 response_code = 200 uri = /crucible/0/regions/aa5c8e5c-a11a-4e99-a191-a5eaad548005/snapshots/daa6572a-9b7a-4876-b797-08df237b7b22/run