Max level shown:
12026-03-24T18:40:57.521ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::b]:55220
22026-03-24T18:40:57.569ZINFOcrucible-agent (datafile): region 85f79e90-c326-4536-947c-9f198116383d state: Requested
32026-03-24T18:40:57.572ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-03-24T18:40:57.572ZINFOcrucible-agent (dropshot): request completed latency_us = 20354 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55220 req_id = 066286fa-95db-4d21-9fe0-ca580358988d response_code = 200 uri = /crucible/0/regions
52026-03-24T18:40:57.581ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_561bc310-6f83-4e6d-82fd-ecacc460531b/crucible/regions/85f79e90-c326-4536-947c-9f198116383d
62026-03-24T18:40:57.581ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_561bc310-6f83-4e6d-82fd-ecacc460531b/crucible/regions/85f79e90-c326-4536-947c-9f198116383d
72026-03-24T18:40:57.639ZINFOcrucible-agent (worker): creating region Region { id: RegionId("85f79e90-c326-4536-947c-9f198116383d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/85f79e90-c326-4536-947c-9f198116383d" region = 85f79e90-c326-4536-947c-9f198116383d
82026-03-24T18:40:57.641ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "85f79e90-c326-4536-947c-9f198116383d" "--data" "/data/regions/85f79e90-c326-4536-947c-9f198116383d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 85f79e90-c326-4536-947c-9f198116383d
92026-03-24T18:40:57.886ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55220 req_id = a2e95dfb-61ea-4074-8772-439120ef5c98 response_code = 200 uri = /crucible/0/regions
102026-03-24T18:40:58.059ZINFOcrucible-agent (worker): region files created ok region = 85f79e90-c326-4536-947c-9f198116383d
112026-03-24T18:40:58.059ZINFOcrucible-agent (datafile): region 85f79e90-c326-4536-947c-9f198116383d state: Requested -> Created
122026-03-24T18:40:58.059ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-03-24T18:40:58.059ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-85f79e90-c326-4536-947c-9f198116383d
142026-03-24T18:40:58.079ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-85f79e90-c326-4536-947c-9f198116383d
152026-03-24T18:40:58.118ZINFOcrucible-agent (worker): creating config property group
162026-03-24T18:40:58.125ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-85f79e90-c326-4536-947c-9f198116383d
172026-03-24T18:40:58.126ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/85f79e90-c326-4536-947c-9f198116383d
182026-03-24T18:40:58.126ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-03-24T18:40:58.126ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
202026-03-24T18:40:58.126ZINFOcrucible-agent (worker): commit
212026-03-24T18:40:58.134ZINFOcrucible-agent (worker): ok!
222026-03-24T18:40:58.144ZINFOcrucible-agent (worker): SMF ok!
232026-03-24T18:40:58.614ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55220 req_id = 1e5ff0b6-30b4-4564-a6cb-1edd7f286feb response_code = 200 uri = /crucible/0/regions
242026-03-24T18:41:05.246ZINFOcrucible-agent (datafile): region bfd829aa-09f4-40eb-b74a-47974c327522 state: Requested
252026-03-24T18:41:05.246ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-03-24T18:41:05.246ZINFOcrucible-agent (dropshot): request completed latency_us = 222 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55220 req_id = 27705b31-6096-4919-861a-068ce21b3263 response_code = 200 uri = /crucible/0/regions
272026-03-24T18:41:05.253ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_561bc310-6f83-4e6d-82fd-ecacc460531b/crucible/regions/bfd829aa-09f4-40eb-b74a-47974c327522
282026-03-24T18:41:05.253ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_561bc310-6f83-4e6d-82fd-ecacc460531b/crucible/regions/bfd829aa-09f4-40eb-b74a-47974c327522
292026-03-24T18:41:05.305ZINFOcrucible-agent (worker): creating region Region { id: RegionId("bfd829aa-09f4-40eb-b74a-47974c327522"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/bfd829aa-09f4-40eb-b74a-47974c327522" region = bfd829aa-09f4-40eb-b74a-47974c327522
302026-03-24T18:41:05.305ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "bfd829aa-09f4-40eb-b74a-47974c327522" "--data" "/data/regions/bfd829aa-09f4-40eb-b74a-47974c327522" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = bfd829aa-09f4-40eb-b74a-47974c327522
312026-03-24T18:41:05.379ZINFOcrucible-agent (worker): region files created ok region = bfd829aa-09f4-40eb-b74a-47974c327522
322026-03-24T18:41:05.380ZINFOcrucible-agent (datafile): region bfd829aa-09f4-40eb-b74a-47974c327522 state: Requested -> Created
332026-03-24T18:41:05.380ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-03-24T18:41:05.384ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-bfd829aa-09f4-40eb-b74a-47974c327522
352026-03-24T18:41:05.387ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-bfd829aa-09f4-40eb-b74a-47974c327522
362026-03-24T18:41:05.394ZINFOcrucible-agent (worker): creating config property group
372026-03-24T18:41:05.397ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-bfd829aa-09f4-40eb-b74a-47974c327522
382026-03-24T18:41:05.397ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bfd829aa-09f4-40eb-b74a-47974c327522
392026-03-24T18:41:05.397ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-03-24T18:41:05.397ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
412026-03-24T18:41:05.397ZINFOcrucible-agent (worker): commit
422026-03-24T18:41:05.401ZINFOcrucible-agent (worker): ok!
432026-03-24T18:41:05.406ZINFOcrucible-agent (worker): SMF ok!
442026-03-24T18:41:05.602ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55220 req_id = a294d719-7531-44ca-a196-a74972c0c198 response_code = 200 uri = /crucible/0/regions
452026-03-24T18:41:30.441ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:55220 req_id = da10e729-13b1-42a2-be14-70e8655a51d5 response_code = 200 uri = /crucible/0/regions/bfd829aa-09f4-40eb-b74a-47974c327522
462026-03-24T18:41:30.445ZINFOcrucible-agent (datafile): path is "/data/regions/bfd829aa-09f4-40eb-b74a-47974c327522"
472026-03-24T18:41:30.456ZINFOcrucible-agent (datafile): dataset is oxp_561bc310-6f83-4e6d-82fd-ecacc460531b/crucible/regions/bfd829aa-09f4-40eb-b74a-47974c327522
482026-03-24T18:41:30.463ZINFOcrucible-agent (datafile): region bfd829aa-09f4-40eb-b74a-47974c327522 state: Created -> Tombstoned
492026-03-24T18:41:30.463ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-03-24T18:41:30.463ZINFOcrucible-agent (dropshot): request completed latency_us = 17393 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:55220 req_id = ab9ab911-788d-499f-a5d9-5da8256bbe64 response_code = 204 uri = /crucible/0/regions/bfd829aa-09f4-40eb-b74a-47974c327522
512026-03-24T18:41:30.464ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-bfd829aa-09f4-40eb-b74a-47974c327522 (instance states: (Some(Online), None))
522026-03-24T18:41:30.466ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:55220 req_id = b8c548af-6f12-4df1-b897-175d908e73ee response_code = 200 uri = /crucible/0/regions/bfd829aa-09f4-40eb-b74a-47974c327522
532026-03-24T18:41:30.477ZINFOcrucible-agent (worker): SMF ok!
542026-03-24T18:41:30.485ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_561bc310-6f83-4e6d-82fd-ecacc460531b/crucible/regions/bfd829aa-09f4-40eb-b74a-47974c327522" region = bfd829aa-09f4-40eb-b74a-47974c327522
552026-03-24T18:41:30.545ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:55220 req_id = 576740aa-80b6-4a1e-8418-6d41db70c8e1 response_code = 200 uri = /crucible/0/regions/bfd829aa-09f4-40eb-b74a-47974c327522
562026-03-24T18:41:30.546ZINFOcrucible-agent (datafile): region bfd829aa-09f4-40eb-b74a-47974c327522 state: Tombstoned -> Destroyed
572026-03-24T18:41:30.665ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:55220 req_id = 0451ff7f-a3c1-42a5-8b7b-fe5e2deb7265 response_code = 200 uri = /crucible/0/regions/bfd829aa-09f4-40eb-b74a-47974c327522