Max level shown:
12026-08-22T13:04:02.820ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:61357
22026-08-22T13:04:02.820ZINFOcrucible-agent (datafile): region 68fd550a-72f7-4544-8adf-dd3b2f9369b5 state: Requested
32026-08-22T13:04:02.821ZINFOcrucible-agent (dropshot): request completed latency_us = 661 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61357 req_id = 361803c8-9594-49cf-b04e-34c2d813dcdd response_code = 200 uri = /crucible/0/regions
42026-08-22T13:04:02.821ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-08-22T13:04:02.831ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_7f148e67-bafd-490f-91cf-079179272cf3/crucible/regions/68fd550a-72f7-4544-8adf-dd3b2f9369b5
62026-08-22T13:04:02.831ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_7f148e67-bafd-490f-91cf-079179272cf3/crucible/regions/68fd550a-72f7-4544-8adf-dd3b2f9369b5
72026-08-22T13:04:02.915ZINFOcrucible-agent (worker): creating region Region { id: RegionId("68fd550a-72f7-4544-8adf-dd3b2f9369b5"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/68fd550a-72f7-4544-8adf-dd3b2f9369b5" region = 68fd550a-72f7-4544-8adf-dd3b2f9369b5
82026-08-22T13:04:02.915ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "68fd550a-72f7-4544-8adf-dd3b2f9369b5" "--data" "/data/regions/68fd550a-72f7-4544-8adf-dd3b2f9369b5" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 68fd550a-72f7-4544-8adf-dd3b2f9369b5
92026-08-22T13:04:03.027ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61357 req_id = 9f59d8b5-8093-4c65-9de4-13f475cd4e3b response_code = 200 uri = /crucible/0/regions
102026-08-22T13:04:03.110ZINFOcrucible-agent (worker): region files created ok region = 68fd550a-72f7-4544-8adf-dd3b2f9369b5
112026-08-22T13:04:03.110ZINFOcrucible-agent (datafile): region 68fd550a-72f7-4544-8adf-dd3b2f9369b5 state: Requested -> Created
122026-08-22T13:04:03.111ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-08-22T13:04:03.111ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-68fd550a-72f7-4544-8adf-dd3b2f9369b5
142026-08-22T13:04:03.143ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-68fd550a-72f7-4544-8adf-dd3b2f9369b5
152026-08-22T13:04:03.186ZINFOcrucible-agent (worker): creating config property group
162026-08-22T13:04:03.199ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-68fd550a-72f7-4544-8adf-dd3b2f9369b5
172026-08-22T13:04:03.199ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/68fd550a-72f7-4544-8adf-dd3b2f9369b5
182026-08-22T13:04:03.199ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-08-22T13:04:03.199ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202026-08-22T13:04:03.199ZINFOcrucible-agent (worker): commit
212026-08-22T13:04:03.209ZINFOcrucible-agent (worker): ok!
222026-08-22T13:04:03.225ZINFOcrucible-agent (worker): SMF ok!
232026-08-22T13:04:03.643ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61357 req_id = f0917e07-6efd-401d-bc4e-7a5760617fb3 response_code = 200 uri = /crucible/0/regions
242026-08-22T13:04:04.177ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61357 req_id = b09c46e3-8cda-45bc-a908-04abc8b3fd49 response_code = 200 uri = /crucible/0/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7
252026-08-22T13:04:04.181ZINFOcrucible-agent (datafile): path is "/data/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7"
262026-08-22T13:04:04.189ZINFOcrucible-agent (datafile): dataset is oxp_7f148e67-bafd-490f-91cf-079179272cf3/crucible/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7
272026-08-22T13:04:04.196ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7f148e67-bafd-490f-91cf-079179272cf3/crucible/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7@d0dca8ec-c514-46cb-9299-838012a0bad6
282026-08-22T13:04:04.196ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7f148e67-bafd-490f-91cf-079179272cf3/crucible/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7", "d0dca8ec-c514-46cb-9299-838012a0bad6"]
292026-08-22T13:04:04.218ZINFOcrucible-agent (dropshot): request completed latency_us = 36934 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61357 req_id = f8ef09ac-a1fa-4f05-af45-c6c792b9355d response_code = 200 uri = /crucible/0/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7/snapshots/d0dca8ec-c514-46cb-9299-838012a0bad6
302026-08-22T13:04:04.228ZINFOcrucible-agent (datafile): path is "/data/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7"
312026-08-22T13:04:04.235ZINFOcrucible-agent (datafile): dataset is oxp_7f148e67-bafd-490f-91cf-079179272cf3/crucible/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7
322026-08-22T13:04:04.242ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7f148e67-bafd-490f-91cf-079179272cf3/crucible/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7@d0dca8ec-c514-46cb-9299-838012a0bad6
332026-08-22T13:04:04.242ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7f148e67-bafd-490f-91cf-079179272cf3/crucible/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7", "d0dca8ec-c514-46cb-9299-838012a0bad6"]
342026-08-22T13:04:04.249ZINFOcrucible-agent (datafile): requesting running snapshot e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7-d0dca8ec-c514-46cb-9299-838012a0bad6 state: Requested
352026-08-22T13:04:04.265ZINFOcrucible-agent (worker): applying SMF actions for region e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7 running snapshot d0dca8ec-c514-46cb-9299-838012a0bad6 (state Requested)...
362026-08-22T13:04:04.265ZINFOcrucible-agent (dropshot): request completed latency_us = 36459 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61357 req_id = 80adf8f2-375e-4277-af1c-5a5b71fcb1cd response_code = 200 uri = /crucible/0/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7/snapshots/d0dca8ec-c514-46cb-9299-838012a0bad6/run
372026-08-22T13:04:04.267ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7-d0dca8ec-c514-46cb-9299-838012a0bad6
382026-08-22T13:04:04.316ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7-d0dca8ec-c514-46cb-9299-838012a0bad6
392026-08-22T13:04:04.344ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7-d0dca8ec-c514-46cb-9299-838012a0bad6
402026-08-22T13:04:04.344ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7/.zfs/snapshot/d0dca8ec-c514-46cb-9299-838012a0bad6
412026-08-22T13:04:04.344ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-08-22T13:04:04.344ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-08-22T13:04:04.344ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
442026-08-22T13:04:04.344ZINFOcrucible-agent (worker): commit
452026-08-22T13:04:04.354ZINFOcrucible-agent (worker): ok!
462026-08-22T13:04:04.366ZINFOcrucible-agent (worker): SMF ok!
472026-08-22T13:04:04.366ZINFOcrucible-agent (datafile): region e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7 running snapshot d0dca8ec-c514-46cb-9299-838012a0bad6 state: Requested -> Created
482026-08-22T13:04:04.405ZINFOcrucible-agent (datafile): path is "/data/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7"
492026-08-22T13:04:04.412ZINFOcrucible-agent (datafile): dataset is oxp_7f148e67-bafd-490f-91cf-079179272cf3/crucible/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7
502026-08-22T13:04:04.420ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7f148e67-bafd-490f-91cf-079179272cf3/crucible/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7@d0dca8ec-c514-46cb-9299-838012a0bad6
512026-08-22T13:04:04.420ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7f148e67-bafd-490f-91cf-079179272cf3/crucible/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7", "d0dca8ec-c514-46cb-9299-838012a0bad6"]
522026-08-22T13:04:04.427ZINFOcrucible-agent (dropshot): request completed latency_us = 22052 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61357 req_id = 1fa49229-ef45-4e43-b4de-96a69265603c response_code = 200 uri = /crucible/0/regions/e3c5f2ef-1ea6-48b0-8406-985f3b5b75a7/snapshots/d0dca8ec-c514-46cb-9299-838012a0bad6/run