Max level shown:
12024-12-21T08:15:37.452ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:60871
22024-12-21T08:15:37.483ZINFOcrucible-agent (datafile): region 8eae7f41-da74-45e6-9969-ef53aba21246 state: Requested
32024-12-21T08:15:37.488ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
42024-12-21T08:15:37.493ZINFOcrucible-agent (dropshot): request completed latency_us = 14918 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60871 req_id = 5aabb9e0-0e7e-4bbc-8c99-1c232cca6640 response_code = 200 uri = /crucible/0/regions
52024-12-21T08:15:37.500ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/8eae7f41-da74-45e6-9969-ef53aba21246
62024-12-21T08:15:37.500ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/8eae7f41-da74-45e6-9969-ef53aba21246
72024-12-21T08:15:37.556ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8eae7f41-da74-45e6-9969-ef53aba21246"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8eae7f41-da74-45e6-9969-ef53aba21246" region = 8eae7f41-da74-45e6-9969-ef53aba21246
82024-12-21T08:15:37.556ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8eae7f41-da74-45e6-9969-ef53aba21246" "--data" "/data/regions/8eae7f41-da74-45e6-9969-ef53aba21246" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 8eae7f41-da74-45e6-9969-ef53aba21246
92024-12-21T08:15:37.672ZINFOcrucible-agent (worker): region files created ok region = 8eae7f41-da74-45e6-9969-ef53aba21246
102024-12-21T08:15:37.672ZINFOcrucible-agent (datafile): region 8eae7f41-da74-45e6-9969-ef53aba21246 state: Requested -> Created
112024-12-21T08:15:37.672ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-12-21T08:15:37.672ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8eae7f41-da74-45e6-9969-ef53aba21246
132024-12-21T08:15:37.680ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8eae7f41-da74-45e6-9969-ef53aba21246
142024-12-21T08:15:37.692ZINFOcrucible-agent (worker): creating config property group
152024-12-21T08:15:37.699ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8eae7f41-da74-45e6-9969-ef53aba21246
162024-12-21T08:15:37.699ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8eae7f41-da74-45e6-9969-ef53aba21246
172024-12-21T08:15:37.699ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182024-12-21T08:15:37.699ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
192024-12-21T08:15:37.699ZINFOcrucible-agent (worker): commit
202024-12-21T08:15:37.707ZINFOcrucible-agent (worker): ok!
212024-12-21T08:15:37.711ZINFOcrucible-agent (worker): SMF ok!
222024-12-21T08:15:37.843ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60871 req_id = 16c59b22-1fc3-4ce6-81ee-f1f9b111b5c7 response_code = 200 uri = /crucible/0/regions
232024-12-21T08:15:38.121ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60871 req_id = 02a000d2-054c-4e7f-8df5-570b08acc2b7 response_code = 200 uri = /crucible/0/regions/8eae7f41-da74-45e6-9969-ef53aba21246
242024-12-21T08:15:38.124ZINFOcrucible-agent (datafile): path is "/data/regions/8eae7f41-da74-45e6-9969-ef53aba21246"
252024-12-21T08:15:38.135ZINFOcrucible-agent (datafile): dataset is oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/8eae7f41-da74-45e6-9969-ef53aba21246
262024-12-21T08:15:38.147ZINFOcrucible-agent (datafile): region 8eae7f41-da74-45e6-9969-ef53aba21246 state: Created -> Tombstoned
272024-12-21T08:15:38.147ZINFOcrucible-agent (worker): applying SMF actions before removal...
282024-12-21T08:15:38.147ZINFOcrucible-agent (dropshot): request completed latency_us = 23509 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:60871 req_id = b7330cb1-7ea7-47fd-91b0-08bd6ab7b3c9 response_code = 204 uri = /crucible/0/regions/8eae7f41-da74-45e6-9969-ef53aba21246
292024-12-21T08:15:38.152ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-8eae7f41-da74-45e6-9969-ef53aba21246 (instance states: (Some(Online), None))
302024-12-21T08:15:38.157ZINFOcrucible-agent (worker): SMF ok!
312024-12-21T08:15:38.161ZINFOcrucible-agent (dropshot): request completed latency_us = 226 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60871 req_id = 03867569-e153-41f3-bbe2-02eceac9d26c response_code = 200 uri = /crucible/0/regions/8eae7f41-da74-45e6-9969-ef53aba21246
322024-12-21T08:15:38.172ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/8eae7f41-da74-45e6-9969-ef53aba21246" region = 8eae7f41-da74-45e6-9969-ef53aba21246
332024-12-21T08:15:38.232ZINFOcrucible-agent (dropshot): request completed latency_us = 92 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60871 req_id = 27341604-ef41-4f16-88c5-eaef4d38f13a response_code = 200 uri = /crucible/0/regions/8eae7f41-da74-45e6-9969-ef53aba21246
342024-12-21T08:15:38.266ZINFOcrucible-agent (datafile): region 8eae7f41-da74-45e6-9969-ef53aba21246 state: Tombstoned -> Destroyed
352024-12-21T08:15:38.381ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60871 req_id = 7613361e-1209-4c4d-8279-43797398640b response_code = 200 uri = /crucible/0/regions/8eae7f41-da74-45e6-9969-ef53aba21246
362024-12-21T08:15:41.681ZINFOcrucible-agent (datafile): region 1c08c967-9c3c-4ff9-995c-0f15ee186bdf state: Requested
372024-12-21T08:15:41.681ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
382024-12-21T08:15:41.681ZINFOcrucible-agent (dropshot): request completed latency_us = 209 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60871 req_id = 462d325e-f20f-4646-9463-2a7f340d932e response_code = 200 uri = /crucible/0/regions
392024-12-21T08:15:41.690ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf
402024-12-21T08:15:41.690ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf
412024-12-21T08:15:41.751ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1c08c967-9c3c-4ff9-995c-0f15ee186bdf"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf" region = 1c08c967-9c3c-4ff9-995c-0f15ee186bdf
422024-12-21T08:15:41.753ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1c08c967-9c3c-4ff9-995c-0f15ee186bdf" "--data" "/data/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 1c08c967-9c3c-4ff9-995c-0f15ee186bdf
432024-12-21T08:15:41.815ZINFOcrucible-agent (worker): region files created ok region = 1c08c967-9c3c-4ff9-995c-0f15ee186bdf
442024-12-21T08:15:41.815ZINFOcrucible-agent (datafile): region 1c08c967-9c3c-4ff9-995c-0f15ee186bdf state: Requested -> Created
452024-12-21T08:15:41.815ZINFOcrucible-agent (worker): applying SMF actions post create...
462024-12-21T08:15:41.817ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1c08c967-9c3c-4ff9-995c-0f15ee186bdf
472024-12-21T08:15:41.820ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1c08c967-9c3c-4ff9-995c-0f15ee186bdf
482024-12-21T08:15:41.826ZINFOcrucible-agent (worker): creating config property group
492024-12-21T08:15:41.829ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1c08c967-9c3c-4ff9-995c-0f15ee186bdf
502024-12-21T08:15:41.830ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf
512024-12-21T08:15:41.830ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
522024-12-21T08:15:41.830ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
532024-12-21T08:15:41.830ZINFOcrucible-agent (worker): commit
542024-12-21T08:15:41.833ZINFOcrucible-agent (worker): ok!
552024-12-21T08:15:41.838ZINFOcrucible-agent (worker): SMF ok!
562024-12-21T08:15:42.009ZINFOcrucible-agent (dropshot): request completed latency_us = 88 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60871 req_id = 7aec7974-a5e6-4cef-9e3d-f488bb413b78 response_code = 200 uri = /crucible/0/regions
572024-12-21T08:25:37.824ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:46908
582024-12-21T08:25:37.825ZINFOcrucible-agent (datafile): region 04d96cae-2bc7-4d7f-9870-0da49f1b1249 state: Requested
592024-12-21T08:25:37.825ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
602024-12-21T08:25:37.825ZINFOcrucible-agent (dropshot): request completed latency_us = 1346 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46908 req_id = 9bb4b53f-1b5d-4db3-bf8a-295587db2285 response_code = 200 uri = /crucible/0/regions
612024-12-21T08:25:37.838ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/04d96cae-2bc7-4d7f-9870-0da49f1b1249
622024-12-21T08:25:37.838ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/04d96cae-2bc7-4d7f-9870-0da49f1b1249
632024-12-21T08:25:37.892ZINFOcrucible-agent (worker): creating region Region { id: RegionId("04d96cae-2bc7-4d7f-9870-0da49f1b1249"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/04d96cae-2bc7-4d7f-9870-0da49f1b1249" region = 04d96cae-2bc7-4d7f-9870-0da49f1b1249
642024-12-21T08:25:37.894ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "04d96cae-2bc7-4d7f-9870-0da49f1b1249" "--data" "/data/regions/04d96cae-2bc7-4d7f-9870-0da49f1b1249" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 04d96cae-2bc7-4d7f-9870-0da49f1b1249
652024-12-21T08:25:37.966ZINFOcrucible-agent (worker): region files created ok region = 04d96cae-2bc7-4d7f-9870-0da49f1b1249
662024-12-21T08:25:37.966ZINFOcrucible-agent (datafile): region 04d96cae-2bc7-4d7f-9870-0da49f1b1249 state: Requested -> Created
672024-12-21T08:25:37.966ZINFOcrucible-agent (worker): applying SMF actions post create...
682024-12-21T08:25:37.967ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-04d96cae-2bc7-4d7f-9870-0da49f1b1249
692024-12-21T08:25:37.975ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-04d96cae-2bc7-4d7f-9870-0da49f1b1249
702024-12-21T08:25:37.983ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46908 req_id = 0ba71223-f7a1-43cb-ba47-62812fd59305 response_code = 200 uri = /crucible/0/regions
712024-12-21T08:25:37.990ZINFOcrucible-agent (worker): creating config property group
722024-12-21T08:25:37.994ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-04d96cae-2bc7-4d7f-9870-0da49f1b1249
732024-12-21T08:25:37.994ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/04d96cae-2bc7-4d7f-9870-0da49f1b1249
742024-12-21T08:25:37.994ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
752024-12-21T08:25:37.994ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
762024-12-21T08:25:37.994ZINFOcrucible-agent (worker): commit
772024-12-21T08:25:37.999ZINFOcrucible-agent (worker): ok!
782024-12-21T08:25:38.005ZINFOcrucible-agent (worker): SMF ok!
792024-12-21T08:25:40.177ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46908 req_id = 9969bd80-ede0-45c9-8965-a725c90be7ad response_code = 200 uri = /crucible/0/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf
802024-12-21T08:25:40.180ZINFOcrucible-agent (datafile): path is "/data/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf"
812024-12-21T08:25:40.189ZINFOcrucible-agent (datafile): dataset is oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf
822024-12-21T08:25:40.198ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf@fc6061e2-9851-4837-bdff-b9fe69ca9fd5
832024-12-21T08:25:40.198ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf", "fc6061e2-9851-4837-bdff-b9fe69ca9fd5"]
842024-12-21T08:25:40.209ZINFOcrucible-agent (dropshot): request completed latency_us = 29182 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46908 req_id = ed142ba3-123e-4ddc-afa2-df0ccfe77ff2 response_code = 200 uri = /crucible/0/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf/snapshots/fc6061e2-9851-4837-bdff-b9fe69ca9fd5
852024-12-21T08:25:40.213ZINFOcrucible-agent (datafile): path is "/data/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf"
862024-12-21T08:25:40.221ZINFOcrucible-agent (datafile): dataset is oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf
872024-12-21T08:25:40.229ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf@fc6061e2-9851-4837-bdff-b9fe69ca9fd5
882024-12-21T08:25:40.229ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf", "fc6061e2-9851-4837-bdff-b9fe69ca9fd5"]
892024-12-21T08:25:40.238ZINFOcrucible-agent (datafile): requesting running snapshot 1c08c967-9c3c-4ff9-995c-0f15ee186bdf-fc6061e2-9851-4837-bdff-b9fe69ca9fd5 state: Requested
902024-12-21T08:25:40.238ZINFOcrucible-agent (worker): applying SMF actions for region 1c08c967-9c3c-4ff9-995c-0f15ee186bdf running snapshot fc6061e2-9851-4837-bdff-b9fe69ca9fd5 (state Requested)...
912024-12-21T08:25:40.238ZINFOcrucible-agent (dropshot): request completed latency_us = 25839 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46908 req_id = 9c0b7dd6-e9e7-4569-8d10-50c05f70d8cb response_code = 200 uri = /crucible/0/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf/snapshots/fc6061e2-9851-4837-bdff-b9fe69ca9fd5/run
922024-12-21T08:25:40.241ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-1c08c967-9c3c-4ff9-995c-0f15ee186bdf-fc6061e2-9851-4837-bdff-b9fe69ca9fd5
932024-12-21T08:25:40.244ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-1c08c967-9c3c-4ff9-995c-0f15ee186bdf-fc6061e2-9851-4837-bdff-b9fe69ca9fd5
942024-12-21T08:25:40.253ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-1c08c967-9c3c-4ff9-995c-0f15ee186bdf-fc6061e2-9851-4837-bdff-b9fe69ca9fd5
952024-12-21T08:25:40.253ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf/.zfs/snapshot/fc6061e2-9851-4837-bdff-b9fe69ca9fd5
962024-12-21T08:25:40.253ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
972024-12-21T08:25:40.253ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
982024-12-21T08:25:40.254ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
992024-12-21T08:25:40.254ZINFOcrucible-agent (worker): commit
1002024-12-21T08:25:40.257ZINFOcrucible-agent (worker): ok!
1012024-12-21T08:25:40.261ZINFOcrucible-agent (worker): SMF ok!
1022024-12-21T08:25:40.261ZINFOcrucible-agent (datafile): region 1c08c967-9c3c-4ff9-995c-0f15ee186bdf running snapshot fc6061e2-9851-4837-bdff-b9fe69ca9fd5 state: Requested -> Created
1032024-12-21T08:25:40.471ZINFOcrucible-agent (datafile): path is "/data/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf"
1042024-12-21T08:25:40.479ZINFOcrucible-agent (datafile): dataset is oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf
1052024-12-21T08:25:40.488ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf@fc6061e2-9851-4837-bdff-b9fe69ca9fd5
1062024-12-21T08:25:40.488ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf", "fc6061e2-9851-4837-bdff-b9fe69ca9fd5"]
1072024-12-21T08:25:40.496ZINFOcrucible-agent (dropshot): request completed latency_us = 25332 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46908 req_id = e4f903d5-4922-4317-85ee-8c548ae34a25 response_code = 200 uri = /crucible/0/regions/1c08c967-9c3c-4ff9-995c-0f15ee186bdf/snapshots/fc6061e2-9851-4837-bdff-b9fe69ca9fd5/run
1082024-12-21T08:25:43.992ZINFOcrucible-agent (datafile): region c04634c6-a069-4081-b1f0-4396817e8f7d state: Requested
1092024-12-21T08:25:43.993ZINFOcrucible-agent (dropshot): request completed latency_us = 260 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46908 req_id = 7f875df3-d469-4c75-8300-b6c0c20ad9db response_code = 200 uri = /crucible/0/regions
1102024-12-21T08:25:43.993ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1112024-12-21T08:25:44.003ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/c04634c6-a069-4081-b1f0-4396817e8f7d
1122024-12-21T08:25:44.003ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/c04634c6-a069-4081-b1f0-4396817e8f7d
1132024-12-21T08:25:44.059ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c04634c6-a069-4081-b1f0-4396817e8f7d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c04634c6-a069-4081-b1f0-4396817e8f7d" region = c04634c6-a069-4081-b1f0-4396817e8f7d
1142024-12-21T08:25:44.059ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c04634c6-a069-4081-b1f0-4396817e8f7d" "--data" "/data/regions/c04634c6-a069-4081-b1f0-4396817e8f7d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c04634c6-a069-4081-b1f0-4396817e8f7d
1152024-12-21T08:25:44.130ZINFOcrucible-agent (worker): region files created ok region = c04634c6-a069-4081-b1f0-4396817e8f7d
1162024-12-21T08:25:44.130ZINFOcrucible-agent (datafile): region c04634c6-a069-4081-b1f0-4396817e8f7d state: Requested -> Created
1172024-12-21T08:25:44.130ZINFOcrucible-agent (worker): applying SMF actions post create...
1182024-12-21T08:25:44.132ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c04634c6-a069-4081-b1f0-4396817e8f7d
1192024-12-21T08:25:44.136ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c04634c6-a069-4081-b1f0-4396817e8f7d
1202024-12-21T08:25:44.143ZINFOcrucible-agent (worker): creating config property group
1212024-12-21T08:25:44.146ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c04634c6-a069-4081-b1f0-4396817e8f7d
1222024-12-21T08:25:44.146ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c04634c6-a069-4081-b1f0-4396817e8f7d
1232024-12-21T08:25:44.146ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
1242024-12-21T08:25:44.146ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
1252024-12-21T08:25:44.146ZINFOcrucible-agent (worker): commit
1262024-12-21T08:25:44.151ZINFOcrucible-agent (worker): ok!
1272024-12-21T08:25:44.158ZINFOcrucible-agent (worker): SMF ok!
1282024-12-21T08:25:44.159ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46908 req_id = 939ae7df-761a-4dcd-b93f-5d9367a6f452 response_code = 200 uri = /crucible/0/regions
1292024-12-21T08:26:09.147ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46908 req_id = a0a8266e-2b7c-44c3-8f5e-81cba52ddfd9 response_code = 200 uri = /crucible/0/regions/c04634c6-a069-4081-b1f0-4396817e8f7d
1302024-12-21T08:26:09.150ZINFOcrucible-agent (datafile): path is "/data/regions/c04634c6-a069-4081-b1f0-4396817e8f7d"
1312024-12-21T08:26:09.162ZINFOcrucible-agent (datafile): dataset is oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/c04634c6-a069-4081-b1f0-4396817e8f7d
1322024-12-21T08:26:09.172ZINFOcrucible-agent (datafile): region c04634c6-a069-4081-b1f0-4396817e8f7d state: Created -> Tombstoned
1332024-12-21T08:26:09.172ZINFOcrucible-agent (worker): applying SMF actions before removal...
1342024-12-21T08:26:09.172ZINFOcrucible-agent (dropshot): request completed latency_us = 22311 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:46908 req_id = 68be228a-3116-44c9-a47a-a13cdbe37e54 response_code = 204 uri = /crucible/0/regions/c04634c6-a069-4081-b1f0-4396817e8f7d
1352024-12-21T08:26:09.174ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-c04634c6-a069-4081-b1f0-4396817e8f7d (instance states: (Some(Online), None))
1362024-12-21T08:26:09.177ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46908 req_id = 8a58c4f2-37ab-4b64-be37-2cb55d15c3f6 response_code = 200 uri = /crucible/0/regions/c04634c6-a069-4081-b1f0-4396817e8f7d
1372024-12-21T08:26:09.184ZINFOcrucible-agent (worker): SMF ok!
1382024-12-21T08:26:09.195ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_1f6f464f-c123-4470-96c3-74700df96380/crucible/regions/c04634c6-a069-4081-b1f0-4396817e8f7d" region = c04634c6-a069-4081-b1f0-4396817e8f7d
1392024-12-21T08:26:09.255ZINFOcrucible-agent (datafile): region c04634c6-a069-4081-b1f0-4396817e8f7d state: Tombstoned -> Destroyed
1402024-12-21T08:26:09.309ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46908 req_id = 179ddb4f-eeb2-49a9-af47-d7a439310985 response_code = 200 uri = /crucible/0/regions/c04634c6-a069-4081-b1f0-4396817e8f7d