Max level shown:
12026-11-04T06:40:18.636ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:61818
22026-11-04T06:40:18.678ZINFOcrucible-agent (datafile): region d92f935a-3955-45fa-ad01-1daaf598d0bc state: Requested
32026-11-04T06:40:18.686ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-11-04T06:40:18.692ZINFOcrucible-agent (dropshot): request completed latency_us = 20814 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61818 req_id = 43e45998-227a-40be-915a-8e9e73b30e8e response_code = 200 uri = /crucible/0/regions
52026-11-04T06:40:18.697ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ab49d45f-8c79-4b86-b628-3727392a0489/crucible/regions/d92f935a-3955-45fa-ad01-1daaf598d0bc
62026-11-04T06:40:18.697ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ab49d45f-8c79-4b86-b628-3727392a0489/crucible/regions/d92f935a-3955-45fa-ad01-1daaf598d0bc
72026-11-04T06:40:18.752ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d92f935a-3955-45fa-ad01-1daaf598d0bc"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d92f935a-3955-45fa-ad01-1daaf598d0bc" region = d92f935a-3955-45fa-ad01-1daaf598d0bc
82026-11-04T06:40:18.752ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d92f935a-3955-45fa-ad01-1daaf598d0bc" "--data" "/data/regions/d92f935a-3955-45fa-ad01-1daaf598d0bc" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d92f935a-3955-45fa-ad01-1daaf598d0bc
92026-11-04T06:40:19.033ZINFOcrucible-agent (dropshot): request completed latency_us = 94 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61818 req_id = cd2614c7-bfb1-403f-a42e-3fb26f839ba0 response_code = 200 uri = /crucible/0/regions
102026-11-04T06:40:19.144ZINFOcrucible-agent (worker): region files created ok region = d92f935a-3955-45fa-ad01-1daaf598d0bc
112026-11-04T06:40:19.147ZINFOcrucible-agent (datafile): region d92f935a-3955-45fa-ad01-1daaf598d0bc state: Requested -> Created
122026-11-04T06:40:19.147ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-11-04T06:40:19.147ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d92f935a-3955-45fa-ad01-1daaf598d0bc
142026-11-04T06:40:19.159ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d92f935a-3955-45fa-ad01-1daaf598d0bc
152026-11-04T06:40:19.174ZINFOcrucible-agent (worker): creating config property group
162026-11-04T06:40:19.178ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d92f935a-3955-45fa-ad01-1daaf598d0bc
172026-11-04T06:40:19.178ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d92f935a-3955-45fa-ad01-1daaf598d0bc
182026-11-04T06:40:19.178ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-11-04T06:40:19.178ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202026-11-04T06:40:19.178ZINFOcrucible-agent (worker): commit
212026-11-04T06:40:19.182ZINFOcrucible-agent (worker): ok!
222026-11-04T06:40:19.187ZINFOcrucible-agent (worker): SMF ok!
232026-11-04T06:40:19.325ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61818 req_id = ced6f0bc-aa6f-4c2e-bb8b-66f098728bc9 response_code = 200 uri = /crucible/0/regions
242026-11-04T06:40:25.820ZINFOcrucible-agent (datafile): region 572c4325-8944-4838-8c00-f3def981db71 state: Requested
252026-11-04T06:40:25.821ZINFOcrucible-agent (dropshot): request completed latency_us = 260 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61818 req_id = 81728c5c-41b2-4281-a0da-3603304b2b55 response_code = 200 uri = /crucible/0/regions
262026-11-04T06:40:25.821ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-11-04T06:40:25.826ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ab49d45f-8c79-4b86-b628-3727392a0489/crucible/regions/572c4325-8944-4838-8c00-f3def981db71
282026-11-04T06:40:25.826ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ab49d45f-8c79-4b86-b628-3727392a0489/crucible/regions/572c4325-8944-4838-8c00-f3def981db71
292026-11-04T06:40:25.886ZINFOcrucible-agent (worker): creating region Region { id: RegionId("572c4325-8944-4838-8c00-f3def981db71"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/572c4325-8944-4838-8c00-f3def981db71" region = 572c4325-8944-4838-8c00-f3def981db71
302026-11-04T06:40:25.886ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "572c4325-8944-4838-8c00-f3def981db71" "--data" "/data/regions/572c4325-8944-4838-8c00-f3def981db71" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 572c4325-8944-4838-8c00-f3def981db71
312026-11-04T06:40:25.965ZINFOcrucible-agent (worker): region files created ok region = 572c4325-8944-4838-8c00-f3def981db71
322026-11-04T06:40:25.965ZINFOcrucible-agent (datafile): region 572c4325-8944-4838-8c00-f3def981db71 state: Requested -> Created
332026-11-04T06:40:25.965ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-11-04T06:40:25.966ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-572c4325-8944-4838-8c00-f3def981db71
352026-11-04T06:40:25.969ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-572c4325-8944-4838-8c00-f3def981db71
362026-11-04T06:40:25.978ZINFOcrucible-agent (worker): creating config property group
372026-11-04T06:40:25.981ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-572c4325-8944-4838-8c00-f3def981db71
382026-11-04T06:40:25.982ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/572c4325-8944-4838-8c00-f3def981db71
392026-11-04T06:40:25.982ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-11-04T06:40:25.982ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
412026-11-04T06:40:25.982ZINFOcrucible-agent (worker): commit
422026-11-04T06:40:25.986ZINFOcrucible-agent (worker): ok!
432026-11-04T06:40:25.993ZINFOcrucible-agent (worker): SMF ok!
442026-11-04T06:40:26.083ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61818 req_id = e6fa81ab-fb53-4442-ad8c-9d1546ae240f response_code = 200 uri = /crucible/0/regions
452026-11-04T06:40:55.914ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:61818 req_id = 85255fdd-576d-4c81-8f9d-82a3aa92fd7d response_code = 200 uri = /crucible/0/regions/572c4325-8944-4838-8c00-f3def981db71
462026-11-04T06:40:55.917ZINFOcrucible-agent (datafile): path is "/data/regions/572c4325-8944-4838-8c00-f3def981db71"
472026-11-04T06:40:55.924ZINFOcrucible-agent (datafile): dataset is oxp_ab49d45f-8c79-4b86-b628-3727392a0489/crucible/regions/572c4325-8944-4838-8c00-f3def981db71
482026-11-04T06:40:55.931ZINFOcrucible-agent (datafile): region 572c4325-8944-4838-8c00-f3def981db71 state: Created -> Tombstoned
492026-11-04T06:40:55.931ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-11-04T06:40:55.931ZINFOcrucible-agent (dropshot): request completed latency_us = 14007 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:61818 req_id = d87caeb2-5e6d-4dc2-9b4a-afe26134dbc6 response_code = 204 uri = /crucible/0/regions/572c4325-8944-4838-8c00-f3def981db71
512026-11-04T06:40:55.932ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-572c4325-8944-4838-8c00-f3def981db71 (instance states: (Some(Online), None))
522026-11-04T06:40:55.934ZINFOcrucible-agent (dropshot): request completed latency_us = 38 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:61818 req_id = 817b2d9d-9265-4155-b4de-6aa288c710ac response_code = 200 uri = /crucible/0/regions/572c4325-8944-4838-8c00-f3def981db71
532026-11-04T06:40:55.937ZINFOcrucible-agent (worker): SMF ok!
542026-11-04T06:40:55.945ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_ab49d45f-8c79-4b86-b628-3727392a0489/crucible/regions/572c4325-8944-4838-8c00-f3def981db71" region = 572c4325-8944-4838-8c00-f3def981db71
552026-11-04T06:40:55.994ZINFOcrucible-agent (datafile): region 572c4325-8944-4838-8c00-f3def981db71 state: Tombstoned -> Destroyed
562026-11-04T06:40:56.007ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:61818 req_id = f15b8578-e120-44e7-9f84-80a1d3fbf849 response_code = 200 uri = /crucible/0/regions/572c4325-8944-4838-8c00-f3def981db71