Max level shown:
12025-03-21T18:51:21.521ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::c]:61651
22025-03-21T18:51:21.580ZINFOcrucible-agent (datafile): region 26db992d-1308-4de8-8706-d3818786c2c9 state: Requested
32025-03-21T18:51:21.583ZINFOcrucible-agent (dropshot): request completed latency_us = 28300 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61651 req_id = ce2f723e-3874-4dce-b7fb-0992ac70102e response_code = 200 uri = /crucible/0/regions
42025-03-21T18:51:21.586ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-03-21T18:51:21.596ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crucible/regions/26db992d-1308-4de8-8706-d3818786c2c9
62025-03-21T18:51:21.596ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crucible/regions/26db992d-1308-4de8-8706-d3818786c2c9
72025-03-21T18:51:21.668ZINFOcrucible-agent (worker): creating region Region { id: RegionId("26db992d-1308-4de8-8706-d3818786c2c9"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/26db992d-1308-4de8-8706-d3818786c2c9" region = 26db992d-1308-4de8-8706-d3818786c2c9
82025-03-21T18:51:21.670ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "26db992d-1308-4de8-8706-d3818786c2c9" "--data" "/data/regions/26db992d-1308-4de8-8706-d3818786c2c9" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 26db992d-1308-4de8-8706-d3818786c2c9
92025-03-21T18:51:21.770ZINFOcrucible-agent (dropshot): request completed latency_us = 102 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61651 req_id = 4287b708-3ead-4b4e-8632-272f4608316f response_code = 200 uri = /crucible/0/regions
102025-03-21T18:51:22.130ZINFOcrucible-agent (worker): region files created ok region = 26db992d-1308-4de8-8706-d3818786c2c9
112025-03-21T18:51:22.130ZINFOcrucible-agent (datafile): region 26db992d-1308-4de8-8706-d3818786c2c9 state: Requested -> Created
122025-03-21T18:51:22.131ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-03-21T18:51:22.131ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-26db992d-1308-4de8-8706-d3818786c2c9
142025-03-21T18:51:22.141ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-26db992d-1308-4de8-8706-d3818786c2c9
152025-03-21T18:51:22.174ZINFOcrucible-agent (worker): creating config property group
162025-03-21T18:51:22.182ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-26db992d-1308-4de8-8706-d3818786c2c9
172025-03-21T18:51:22.183ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/26db992d-1308-4de8-8706-d3818786c2c9
182025-03-21T18:51:22.183ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-03-21T18:51:22.183ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
202025-03-21T18:51:22.183ZINFOcrucible-agent (worker): commit
212025-03-21T18:51:22.192ZINFOcrucible-agent (worker): ok!
222025-03-21T18:51:22.214ZINFOcrucible-agent (worker): SMF ok!
232025-03-21T18:51:22.303ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61651 req_id = c07a642f-af15-485d-94b6-eba4e05fcc83 response_code = 200 uri = /crucible/0/regions
242025-03-21T18:51:28.170ZINFOcrucible-agent (datafile): region 12fd43f3-7e3b-4f94-bd92-0df97d68ce17 state: Requested
252025-03-21T18:51:28.170ZINFOcrucible-agent (dropshot): request completed latency_us = 203 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61651 req_id = b9706369-2bca-418a-bae6-c55416666daa response_code = 200 uri = /crucible/0/regions
262025-03-21T18:51:28.170ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272025-03-21T18:51:28.180ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crucible/regions/12fd43f3-7e3b-4f94-bd92-0df97d68ce17
282025-03-21T18:51:28.180ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crucible/regions/12fd43f3-7e3b-4f94-bd92-0df97d68ce17
292025-03-21T18:51:28.248ZINFOcrucible-agent (worker): creating region Region { id: RegionId("12fd43f3-7e3b-4f94-bd92-0df97d68ce17"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/12fd43f3-7e3b-4f94-bd92-0df97d68ce17" region = 12fd43f3-7e3b-4f94-bd92-0df97d68ce17
302025-03-21T18:51:28.248ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "12fd43f3-7e3b-4f94-bd92-0df97d68ce17" "--data" "/data/regions/12fd43f3-7e3b-4f94-bd92-0df97d68ce17" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 12fd43f3-7e3b-4f94-bd92-0df97d68ce17
312025-03-21T18:51:28.370ZINFOcrucible-agent (worker): region files created ok region = 12fd43f3-7e3b-4f94-bd92-0df97d68ce17
322025-03-21T18:51:28.370ZINFOcrucible-agent (datafile): region 12fd43f3-7e3b-4f94-bd92-0df97d68ce17 state: Requested -> Created
332025-03-21T18:51:28.371ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-03-21T18:51:28.371ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-12fd43f3-7e3b-4f94-bd92-0df97d68ce17
352025-03-21T18:51:28.377ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-12fd43f3-7e3b-4f94-bd92-0df97d68ce17
362025-03-21T18:51:28.389ZINFOcrucible-agent (worker): creating config property group
372025-03-21T18:51:28.395ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-12fd43f3-7e3b-4f94-bd92-0df97d68ce17
382025-03-21T18:51:28.396ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/12fd43f3-7e3b-4f94-bd92-0df97d68ce17
392025-03-21T18:51:28.396ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-03-21T18:51:28.396ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
412025-03-21T18:51:28.396ZINFOcrucible-agent (worker): commit
422025-03-21T18:51:28.404ZINFOcrucible-agent (worker): ok!
432025-03-21T18:51:28.412ZINFOcrucible-agent (worker): SMF ok!
442025-03-21T18:51:28.419ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61651 req_id = 6e3f7b42-583f-4191-b161-a8899946e409 response_code = 200 uri = /crucible/0/regions
452025-03-21T18:51:54.263ZINFOcrucible-agent (dropshot): request completed latency_us = 2263 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61651 req_id = 85be0935-faf6-42a4-8813-91d7f5c801f1 response_code = 200 uri = /crucible/0/regions/12fd43f3-7e3b-4f94-bd92-0df97d68ce17
462025-03-21T18:51:54.266ZINFOcrucible-agent (datafile): path is "/data/regions/12fd43f3-7e3b-4f94-bd92-0df97d68ce17"
472025-03-21T18:51:54.279ZINFOcrucible-agent (datafile): dataset is oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crucible/regions/12fd43f3-7e3b-4f94-bd92-0df97d68ce17
482025-03-21T18:51:54.289ZINFOcrucible-agent (datafile): region 12fd43f3-7e3b-4f94-bd92-0df97d68ce17 state: Created -> Tombstoned
492025-03-21T18:51:54.289ZINFOcrucible-agent (worker): applying SMF actions before removal...
502025-03-21T18:51:54.289ZINFOcrucible-agent (dropshot): request completed latency_us = 23082 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:61651 req_id = 1c15a62e-5713-45d7-952e-14f1c516a0f6 response_code = 204 uri = /crucible/0/regions/12fd43f3-7e3b-4f94-bd92-0df97d68ce17
512025-03-21T18:51:54.290ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-12fd43f3-7e3b-4f94-bd92-0df97d68ce17 (instance states: (Some(Online), None))
522025-03-21T18:51:54.293ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61651 req_id = c10d9189-9c41-4e31-babd-eaa332fc91e1 response_code = 200 uri = /crucible/0/regions/12fd43f3-7e3b-4f94-bd92-0df97d68ce17
532025-03-21T18:51:54.301ZINFOcrucible-agent (worker): SMF ok!
542025-03-21T18:51:54.313ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crucible/regions/12fd43f3-7e3b-4f94-bd92-0df97d68ce17" region = 12fd43f3-7e3b-4f94-bd92-0df97d68ce17
552025-03-21T18:51:54.361ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61651 req_id = 80557b9b-addd-4263-ad13-ecc6ef34f9bb response_code = 200 uri = /crucible/0/regions/12fd43f3-7e3b-4f94-bd92-0df97d68ce17
562025-03-21T18:51:54.376ZINFOcrucible-agent (datafile): region 12fd43f3-7e3b-4f94-bd92-0df97d68ce17 state: Tombstoned -> Destroyed
572025-03-21T18:51:54.521ZINFOcrucible-agent (dropshot): request completed latency_us = 31 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61651 req_id = 85522af8-6812-45fd-9fa6-643dfddb1c14 response_code = 200 uri = /crucible/0/regions/12fd43f3-7e3b-4f94-bd92-0df97d68ce17