Max level shown:
12026-05-06T00:36:05.957ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:54786
22026-05-06T00:36:05.957ZINFOcrucible-agent (datafile): region c9657a52-9203-4339-8683-b01e449514ac state: Requested
32026-05-06T00:36:05.958ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-06T00:36:05.958ZINFOcrucible-agent (dropshot): request completed latency_us = 708 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54786 req_id = eeba6e6e-273e-4f9e-805a-559c6cee4f56 response_code = 200 uri = /crucible/0/regions
52026-05-06T00:36:05.967ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ee03afd7-496f-4b77-83dc-27b553f79866/crucible/regions/c9657a52-9203-4339-8683-b01e449514ac
62026-05-06T00:36:05.967ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ee03afd7-496f-4b77-83dc-27b553f79866/crucible/regions/c9657a52-9203-4339-8683-b01e449514ac
72026-05-06T00:36:06.025ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c9657a52-9203-4339-8683-b01e449514ac"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c9657a52-9203-4339-8683-b01e449514ac" region = c9657a52-9203-4339-8683-b01e449514ac
82026-05-06T00:36:06.025ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c9657a52-9203-4339-8683-b01e449514ac" "--data" "/data/regions/c9657a52-9203-4339-8683-b01e449514ac" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c9657a52-9203-4339-8683-b01e449514ac
92026-05-06T00:36:06.112ZINFOcrucible-agent (worker): region files created ok region = c9657a52-9203-4339-8683-b01e449514ac
102026-05-06T00:36:06.112ZINFOcrucible-agent (datafile): region c9657a52-9203-4339-8683-b01e449514ac state: Requested -> Created
112026-05-06T00:36:06.112ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-05-06T00:36:06.113ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c9657a52-9203-4339-8683-b01e449514ac
132026-05-06T00:36:06.125ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c9657a52-9203-4339-8683-b01e449514ac
142026-05-06T00:36:06.149ZINFOcrucible-agent (worker): creating config property group
152026-05-06T00:36:06.152ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c9657a52-9203-4339-8683-b01e449514ac
162026-05-06T00:36:06.153ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c9657a52-9203-4339-8683-b01e449514ac
172026-05-06T00:36:06.153ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-05-06T00:36:06.153ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
192026-05-06T00:36:06.153ZINFOcrucible-agent (worker): commit
202026-05-06T00:36:06.157ZINFOcrucible-agent (worker): ok!
212026-05-06T00:36:06.161ZINFOcrucible-agent (worker): SMF ok!
222026-05-06T00:36:06.182ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54786 req_id = 3b0a655c-bae5-44de-a251-9f672e79ec07 response_code = 200 uri = /crucible/0/regions
232026-05-06T00:36:12.199ZINFOcrucible-agent (datafile): region 74e60f80-381c-4c0f-8831-11b335f356f3 state: Requested
242026-05-06T00:36:12.199ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
252026-05-06T00:36:12.199ZINFOcrucible-agent (dropshot): request completed latency_us = 232 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54786 req_id = 4df5af70-aaa7-4880-b5f8-f97e7b2fe70e response_code = 200 uri = /crucible/0/regions
262026-05-06T00:36:12.206ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ee03afd7-496f-4b77-83dc-27b553f79866/crucible/regions/74e60f80-381c-4c0f-8831-11b335f356f3
272026-05-06T00:36:12.206ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ee03afd7-496f-4b77-83dc-27b553f79866/crucible/regions/74e60f80-381c-4c0f-8831-11b335f356f3
282026-05-06T00:36:12.262ZINFOcrucible-agent (worker): creating region Region { id: RegionId("74e60f80-381c-4c0f-8831-11b335f356f3"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/74e60f80-381c-4c0f-8831-11b335f356f3" region = 74e60f80-381c-4c0f-8831-11b335f356f3
292026-05-06T00:36:12.262ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "74e60f80-381c-4c0f-8831-11b335f356f3" "--data" "/data/regions/74e60f80-381c-4c0f-8831-11b335f356f3" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 74e60f80-381c-4c0f-8831-11b335f356f3
302026-05-06T00:36:12.342ZINFOcrucible-agent (worker): region files created ok region = 74e60f80-381c-4c0f-8831-11b335f356f3
312026-05-06T00:36:12.342ZINFOcrucible-agent (datafile): region 74e60f80-381c-4c0f-8831-11b335f356f3 state: Requested -> Created
322026-05-06T00:36:12.342ZINFOcrucible-agent (worker): applying SMF actions post create...
332026-05-06T00:36:12.343ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-74e60f80-381c-4c0f-8831-11b335f356f3
342026-05-06T00:36:12.350ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-74e60f80-381c-4c0f-8831-11b335f356f3
352026-05-06T00:36:12.358ZINFOcrucible-agent (worker): creating config property group
362026-05-06T00:36:12.362ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-74e60f80-381c-4c0f-8831-11b335f356f3
372026-05-06T00:36:12.362ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/74e60f80-381c-4c0f-8831-11b335f356f3
382026-05-06T00:36:12.362ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392026-05-06T00:36:12.362ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
402026-05-06T00:36:12.362ZINFOcrucible-agent (worker): commit
412026-05-06T00:36:12.366ZINFOcrucible-agent (worker): ok!
422026-05-06T00:36:12.377ZINFOcrucible-agent (worker): SMF ok!
432026-05-06T00:36:12.553ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54786 req_id = ce250316-16b8-4da1-bc1e-be6ade5a704c response_code = 200 uri = /crucible/0/regions
442026-05-06T00:36:38.299ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54786 req_id = e91bd484-ec07-4781-89da-b1143bfca813 response_code = 200 uri = /crucible/0/regions/74e60f80-381c-4c0f-8831-11b335f356f3
452026-05-06T00:36:38.302ZINFOcrucible-agent (datafile): path is "/data/regions/74e60f80-381c-4c0f-8831-11b335f356f3"
462026-05-06T00:36:38.314ZINFOcrucible-agent (datafile): dataset is oxp_ee03afd7-496f-4b77-83dc-27b553f79866/crucible/regions/74e60f80-381c-4c0f-8831-11b335f356f3
472026-05-06T00:36:38.321ZINFOcrucible-agent (datafile): region 74e60f80-381c-4c0f-8831-11b335f356f3 state: Created -> Tombstoned
482026-05-06T00:36:38.321ZINFOcrucible-agent (worker): applying SMF actions before removal...
492026-05-06T00:36:38.321ZINFOcrucible-agent (dropshot): request completed latency_us = 18821 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:54786 req_id = 138bc46d-81e1-4952-9c5e-7bcb59601b41 response_code = 204 uri = /crucible/0/regions/74e60f80-381c-4c0f-8831-11b335f356f3
502026-05-06T00:36:38.322ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-74e60f80-381c-4c0f-8831-11b335f356f3 (instance states: (Some(Online), None))
512026-05-06T00:36:38.325ZINFOcrucible-agent (dropshot): request completed latency_us = 34 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54786 req_id = a7b278f7-c752-4a53-add7-96d176eaef84 response_code = 200 uri = /crucible/0/regions/74e60f80-381c-4c0f-8831-11b335f356f3
522026-05-06T00:36:38.335ZINFOcrucible-agent (worker): SMF ok!
532026-05-06T00:36:38.343ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_ee03afd7-496f-4b77-83dc-27b553f79866/crucible/regions/74e60f80-381c-4c0f-8831-11b335f356f3" region = 74e60f80-381c-4c0f-8831-11b335f356f3
542026-05-06T00:36:38.389ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54786 req_id = 1508379a-0a61-4594-82cc-4cb0ed806598 response_code = 200 uri = /crucible/0/regions/74e60f80-381c-4c0f-8831-11b335f356f3
552026-05-06T00:36:38.398ZINFOcrucible-agent (datafile): region 74e60f80-381c-4c0f-8831-11b335f356f3 state: Tombstoned -> Destroyed
562026-05-06T00:36:38.551ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54786 req_id = e1f18887-8420-471f-8fe1-1ec61d2f59cd response_code = 200 uri = /crucible/0/regions/74e60f80-381c-4c0f-8831-11b335f356f3