Max level shown:
12026-11-05T22:22:03.261ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:63522
22026-11-05T22:22:03.303ZINFOcrucible-agent (datafile): region 1d22f495-c24f-4792-a824-e3b744e6876b state: Requested
32026-11-05T22:22:03.310ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-11-05T22:22:03.314ZINFOcrucible-agent (dropshot): request completed latency_us = 20731 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63522 req_id = f7d5252b-4ee8-465d-9df6-60c94566125e response_code = 200 uri = /crucible/0/regions
52026-11-05T22:22:03.321ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f2f7cd2a-eb6c-47f0-ab80-4de26e3eb59a/crucible/regions/1d22f495-c24f-4792-a824-e3b744e6876b
62026-11-05T22:22:03.321ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f2f7cd2a-eb6c-47f0-ab80-4de26e3eb59a/crucible/regions/1d22f495-c24f-4792-a824-e3b744e6876b
72026-11-05T22:22:03.368ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1d22f495-c24f-4792-a824-e3b744e6876b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1d22f495-c24f-4792-a824-e3b744e6876b" region = 1d22f495-c24f-4792-a824-e3b744e6876b
82026-11-05T22:22:03.368ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1d22f495-c24f-4792-a824-e3b744e6876b" "--data" "/data/regions/1d22f495-c24f-4792-a824-e3b744e6876b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 1d22f495-c24f-4792-a824-e3b744e6876b
92026-11-05T22:22:03.607ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63522 req_id = c4c40400-1af8-478e-a820-ad4304d423f5 response_code = 200 uri = /crucible/0/regions
102026-11-05T22:22:03.725ZINFOcrucible-agent (worker): region files created ok region = 1d22f495-c24f-4792-a824-e3b744e6876b
112026-11-05T22:22:03.727ZINFOcrucible-agent (datafile): region 1d22f495-c24f-4792-a824-e3b744e6876b state: Requested -> Created
122026-11-05T22:22:03.727ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-11-05T22:22:03.728ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1d22f495-c24f-4792-a824-e3b744e6876b
142026-11-05T22:22:03.736ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1d22f495-c24f-4792-a824-e3b744e6876b
152026-11-05T22:22:03.746ZINFOcrucible-agent (worker): creating config property group
162026-11-05T22:22:03.749ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1d22f495-c24f-4792-a824-e3b744e6876b
172026-11-05T22:22:03.750ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1d22f495-c24f-4792-a824-e3b744e6876b
182026-11-05T22:22:03.750ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-11-05T22:22:03.750ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202026-11-05T22:22:03.750ZINFOcrucible-agent (worker): commit
212026-11-05T22:22:03.754ZINFOcrucible-agent (worker): ok!
222026-11-05T22:22:03.758ZINFOcrucible-agent (worker): SMF ok!
232026-11-05T22:22:04.283ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63522 req_id = dad0b622-1751-42d0-889d-2372b09d3720 response_code = 200 uri = /crucible/0/regions
242026-11-05T22:22:09.878ZINFOcrucible-agent (datafile): region 27cdd815-0936-4883-8f62-72fae9426c6f state: Requested
252026-11-05T22:22:09.878ZINFOcrucible-agent (dropshot): request completed latency_us = 222 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63522 req_id = d0c40809-39d4-4451-8261-d25990246f64 response_code = 200 uri = /crucible/0/regions
262026-11-05T22:22:09.878ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-11-05T22:22:09.884ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f2f7cd2a-eb6c-47f0-ab80-4de26e3eb59a/crucible/regions/27cdd815-0936-4883-8f62-72fae9426c6f
282026-11-05T22:22:09.884ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f2f7cd2a-eb6c-47f0-ab80-4de26e3eb59a/crucible/regions/27cdd815-0936-4883-8f62-72fae9426c6f
292026-11-05T22:22:09.924ZINFOcrucible-agent (worker): creating region Region { id: RegionId("27cdd815-0936-4883-8f62-72fae9426c6f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/27cdd815-0936-4883-8f62-72fae9426c6f" region = 27cdd815-0936-4883-8f62-72fae9426c6f
302026-11-05T22:22:09.924ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "27cdd815-0936-4883-8f62-72fae9426c6f" "--data" "/data/regions/27cdd815-0936-4883-8f62-72fae9426c6f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 27cdd815-0936-4883-8f62-72fae9426c6f
312026-11-05T22:22:09.994ZINFOcrucible-agent (worker): region files created ok region = 27cdd815-0936-4883-8f62-72fae9426c6f
322026-11-05T22:22:09.994ZINFOcrucible-agent (datafile): region 27cdd815-0936-4883-8f62-72fae9426c6f state: Requested -> Created
332026-11-05T22:22:09.994ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-11-05T22:22:09.995ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-27cdd815-0936-4883-8f62-72fae9426c6f
352026-11-05T22:22:09.999ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-27cdd815-0936-4883-8f62-72fae9426c6f
362026-11-05T22:22:10.006ZINFOcrucible-agent (worker): creating config property group
372026-11-05T22:22:10.009ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-27cdd815-0936-4883-8f62-72fae9426c6f
382026-11-05T22:22:10.009ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/27cdd815-0936-4883-8f62-72fae9426c6f
392026-11-05T22:22:10.010ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-11-05T22:22:10.010ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
412026-11-05T22:22:10.010ZINFOcrucible-agent (worker): commit
422026-11-05T22:22:10.014ZINFOcrucible-agent (worker): ok!
432026-11-05T22:22:10.018ZINFOcrucible-agent (worker): SMF ok!
442026-11-05T22:22:10.070ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63522 req_id = 6c796e23-1ccf-4b6b-8a38-a5e18335402a response_code = 200 uri = /crucible/0/regions
452026-11-05T22:22:36.059ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:63522 req_id = dde69675-c2cf-4755-8dd7-0db0d166e126 response_code = 200 uri = /crucible/0/regions/27cdd815-0936-4883-8f62-72fae9426c6f
462026-11-05T22:22:36.062ZINFOcrucible-agent (datafile): path is "/data/regions/27cdd815-0936-4883-8f62-72fae9426c6f"
472026-11-05T22:22:36.070ZINFOcrucible-agent (datafile): dataset is oxp_f2f7cd2a-eb6c-47f0-ab80-4de26e3eb59a/crucible/regions/27cdd815-0936-4883-8f62-72fae9426c6f
482026-11-05T22:22:36.077ZINFOcrucible-agent (datafile): region 27cdd815-0936-4883-8f62-72fae9426c6f state: Created -> Tombstoned
492026-11-05T22:22:36.077ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-11-05T22:22:36.077ZINFOcrucible-agent (dropshot): request completed latency_us = 14324 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:63522 req_id = 4381ee0f-7479-4bf0-8c46-af6ea744b509 response_code = 204 uri = /crucible/0/regions/27cdd815-0936-4883-8f62-72fae9426c6f
512026-11-05T22:22:36.078ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-27cdd815-0936-4883-8f62-72fae9426c6f (instance states: (Some(Online), None))
522026-11-05T22:22:36.082ZINFOcrucible-agent (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:63522 req_id = 28a39635-4908-4783-9ff5-8b933ccc6be2 response_code = 200 uri = /crucible/0/regions/27cdd815-0936-4883-8f62-72fae9426c6f
532026-11-05T22:22:36.083ZINFOcrucible-agent (worker): SMF ok!
542026-11-05T22:22:36.090ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_f2f7cd2a-eb6c-47f0-ab80-4de26e3eb59a/crucible/regions/27cdd815-0936-4883-8f62-72fae9426c6f" region = 27cdd815-0936-4883-8f62-72fae9426c6f
552026-11-05T22:22:36.135ZINFOcrucible-agent (datafile): region 27cdd815-0936-4883-8f62-72fae9426c6f state: Tombstoned -> Destroyed
562026-11-05T22:22:36.191ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:63522 req_id = 2a4adb3e-54fd-4acf-93eb-c4db0aaec83d response_code = 200 uri = /crucible/0/regions/27cdd815-0936-4883-8f62-72fae9426c6f