Max level shown:
12026-04-03T04:38:31.685ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:64029
22026-04-03T04:38:31.685ZINFOcrucible-agent (datafile): region 3ea31341-9447-446b-9a74-5ac428fecdd9 state: Requested
32026-04-03T04:38:31.686ZINFOcrucible-agent (dropshot): request completed latency_us = 983 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:64029 req_id = bc7c80d4-d054-4033-88a0-8872614b19a9 response_code = 200 uri = /crucible/0/regions
42026-04-03T04:38:31.686ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-04-03T04:38:31.696ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_03e3b765-adb9-474b-80f3-44037fdda325/crucible/regions/3ea31341-9447-446b-9a74-5ac428fecdd9
62026-04-03T04:38:31.696ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_03e3b765-adb9-474b-80f3-44037fdda325/crucible/regions/3ea31341-9447-446b-9a74-5ac428fecdd9
72026-04-03T04:38:31.758ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3ea31341-9447-446b-9a74-5ac428fecdd9"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3ea31341-9447-446b-9a74-5ac428fecdd9" region = 3ea31341-9447-446b-9a74-5ac428fecdd9
82026-04-03T04:38:31.758ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3ea31341-9447-446b-9a74-5ac428fecdd9" "--data" "/data/regions/3ea31341-9447-446b-9a74-5ac428fecdd9" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3ea31341-9447-446b-9a74-5ac428fecdd9
92026-04-03T04:38:31.870ZINFOcrucible-agent (worker): region files created ok region = 3ea31341-9447-446b-9a74-5ac428fecdd9
102026-04-03T04:38:31.870ZINFOcrucible-agent (datafile): region 3ea31341-9447-446b-9a74-5ac428fecdd9 state: Requested -> Created
112026-04-03T04:38:31.870ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-04-03T04:38:31.871ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3ea31341-9447-446b-9a74-5ac428fecdd9
132026-04-03T04:38:31.881ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3ea31341-9447-446b-9a74-5ac428fecdd9
142026-04-03T04:38:31.901ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:64029 req_id = 6bb8a08a-d877-44d9-87cd-ccfce74362d0 response_code = 200 uri = /crucible/0/regions
152026-04-03T04:38:31.903ZINFOcrucible-agent (worker): creating config property group
162026-04-03T04:38:31.907ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3ea31341-9447-446b-9a74-5ac428fecdd9
172026-04-03T04:38:31.907ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3ea31341-9447-446b-9a74-5ac428fecdd9
182026-04-03T04:38:31.907ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-04-03T04:38:31.907ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202026-04-03T04:38:31.907ZINFOcrucible-agent (worker): commit
212026-04-03T04:38:31.911ZINFOcrucible-agent (worker): ok!
222026-04-03T04:38:31.916ZINFOcrucible-agent (worker): SMF ok!
232026-04-03T04:38:38.601ZINFOcrucible-agent (datafile): region 72396094-95d6-4922-955f-f3073bdc6d73 state: Requested
242026-04-03T04:38:38.602ZINFOcrucible-agent (dropshot): request completed latency_us = 222 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:64029 req_id = b17182b1-e488-4f8c-9969-3e890c5af39f response_code = 200 uri = /crucible/0/regions
252026-04-03T04:38:38.602ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-04-03T04:38:38.609ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_03e3b765-adb9-474b-80f3-44037fdda325/crucible/regions/72396094-95d6-4922-955f-f3073bdc6d73
272026-04-03T04:38:38.609ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_03e3b765-adb9-474b-80f3-44037fdda325/crucible/regions/72396094-95d6-4922-955f-f3073bdc6d73
282026-04-03T04:38:38.657ZINFOcrucible-agent (worker): creating region Region { id: RegionId("72396094-95d6-4922-955f-f3073bdc6d73"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/72396094-95d6-4922-955f-f3073bdc6d73" region = 72396094-95d6-4922-955f-f3073bdc6d73
292026-04-03T04:38:38.657ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "72396094-95d6-4922-955f-f3073bdc6d73" "--data" "/data/regions/72396094-95d6-4922-955f-f3073bdc6d73" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 72396094-95d6-4922-955f-f3073bdc6d73
302026-04-03T04:38:38.732ZINFOcrucible-agent (worker): region files created ok region = 72396094-95d6-4922-955f-f3073bdc6d73
312026-04-03T04:38:38.733ZINFOcrucible-agent (datafile): region 72396094-95d6-4922-955f-f3073bdc6d73 state: Requested -> Created
322026-04-03T04:38:38.733ZINFOcrucible-agent (worker): applying SMF actions post create...
332026-04-03T04:38:38.737ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-72396094-95d6-4922-955f-f3073bdc6d73
342026-04-03T04:38:38.745ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-72396094-95d6-4922-955f-f3073bdc6d73
352026-04-03T04:38:38.752ZINFOcrucible-agent (worker): creating config property group
362026-04-03T04:38:38.757ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-72396094-95d6-4922-955f-f3073bdc6d73
372026-04-03T04:38:38.757ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/72396094-95d6-4922-955f-f3073bdc6d73
382026-04-03T04:38:38.757ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392026-04-03T04:38:38.757ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
402026-04-03T04:38:38.757ZINFOcrucible-agent (worker): commit
412026-04-03T04:38:38.761ZINFOcrucible-agent (worker): ok!
422026-04-03T04:38:38.765ZINFOcrucible-agent (worker): SMF ok!
432026-04-03T04:38:38.944ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:64029 req_id = ad31b771-201f-4bcf-889a-55eb92884cd0 response_code = 200 uri = /crucible/0/regions
442026-04-03T04:39:04.686ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:64029 req_id = 6e55d079-dd90-4349-ab78-8614f5e29f07 response_code = 200 uri = /crucible/0/regions/72396094-95d6-4922-955f-f3073bdc6d73
452026-04-03T04:39:04.690ZINFOcrucible-agent (datafile): path is "/data/regions/72396094-95d6-4922-955f-f3073bdc6d73"
462026-04-03T04:39:04.700ZINFOcrucible-agent (datafile): dataset is oxp_03e3b765-adb9-474b-80f3-44037fdda325/crucible/regions/72396094-95d6-4922-955f-f3073bdc6d73
472026-04-03T04:39:04.708ZINFOcrucible-agent (datafile): region 72396094-95d6-4922-955f-f3073bdc6d73 state: Created -> Tombstoned
482026-04-03T04:39:04.708ZINFOcrucible-agent (dropshot): request completed latency_us = 18100 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:64029 req_id = 057d99e1-0123-464d-bdc5-0bd1ef592346 response_code = 204 uri = /crucible/0/regions/72396094-95d6-4922-955f-f3073bdc6d73
492026-04-03T04:39:04.708ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-04-03T04:39:04.709ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-72396094-95d6-4922-955f-f3073bdc6d73 (instance states: (Some(Online), None))
512026-04-03T04:39:04.710ZINFOcrucible-agent (dropshot): request completed latency_us = 24 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:64029 req_id = ab902c1e-4bc1-44f5-acad-68d186d92e2a response_code = 200 uri = /crucible/0/regions/72396094-95d6-4922-955f-f3073bdc6d73
522026-04-03T04:39:04.721ZINFOcrucible-agent (worker): SMF ok!
532026-04-03T04:39:04.730ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_03e3b765-adb9-474b-80f3-44037fdda325/crucible/regions/72396094-95d6-4922-955f-f3073bdc6d73" region = 72396094-95d6-4922-955f-f3073bdc6d73
542026-04-03T04:39:04.781ZINFOcrucible-agent (datafile): region 72396094-95d6-4922-955f-f3073bdc6d73 state: Tombstoned -> Destroyed
552026-04-03T04:39:04.799ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:64029 req_id = f9dd0bfd-2c52-4f2c-9dc7-6fbe672c7c29 response_code = 200 uri = /crucible/0/regions/72396094-95d6-4922-955f-f3073bdc6d73