Max level shown:
12026-03-16T21:04:07.466ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:59920
22026-03-16T21:04:07.467ZINFOcrucible-agent (datafile): region 1fa3d9d3-9a93-47ba-a8fd-fb3b9f3bdea8 state: Requested
32026-03-16T21:04:07.468ZINFOcrucible-agent (dropshot): request completed latency_us = 1130 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59920 req_id = fd519ae5-82cc-467c-be33-ca1f7ff8809f response_code = 200 uri = /crucible/0/regions
42026-03-16T21:04:07.468ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-03-16T21:04:07.479ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_263db3db-6f53-4f2d-ac26-d6e3a30a3bcc/crucible/regions/1fa3d9d3-9a93-47ba-a8fd-fb3b9f3bdea8
62026-03-16T21:04:07.479ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_263db3db-6f53-4f2d-ac26-d6e3a30a3bcc/crucible/regions/1fa3d9d3-9a93-47ba-a8fd-fb3b9f3bdea8
72026-03-16T21:04:07.542ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1fa3d9d3-9a93-47ba-a8fd-fb3b9f3bdea8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1fa3d9d3-9a93-47ba-a8fd-fb3b9f3bdea8" region = 1fa3d9d3-9a93-47ba-a8fd-fb3b9f3bdea8
82026-03-16T21:04:07.542ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1fa3d9d3-9a93-47ba-a8fd-fb3b9f3bdea8" "--data" "/data/regions/1fa3d9d3-9a93-47ba-a8fd-fb3b9f3bdea8" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 1fa3d9d3-9a93-47ba-a8fd-fb3b9f3bdea8
92026-03-16T21:04:07.841ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59920 req_id = 33c8c4cd-b15d-48e4-a21b-fe906adb946e response_code = 200 uri = /crucible/0/regions
102026-03-16T21:04:07.942ZINFOcrucible-agent (worker): region files created ok region = 1fa3d9d3-9a93-47ba-a8fd-fb3b9f3bdea8
112026-03-16T21:04:07.942ZINFOcrucible-agent (datafile): region 1fa3d9d3-9a93-47ba-a8fd-fb3b9f3bdea8 state: Requested -> Created
122026-03-16T21:04:07.942ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-03-16T21:04:07.943ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1fa3d9d3-9a93-47ba-a8fd-fb3b9f3bdea8
142026-03-16T21:04:07.953ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1fa3d9d3-9a93-47ba-a8fd-fb3b9f3bdea8
152026-03-16T21:04:07.978ZINFOcrucible-agent (worker): creating config property group
162026-03-16T21:04:07.981ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1fa3d9d3-9a93-47ba-a8fd-fb3b9f3bdea8
172026-03-16T21:04:07.981ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1fa3d9d3-9a93-47ba-a8fd-fb3b9f3bdea8
182026-03-16T21:04:07.982ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-03-16T21:04:07.982ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202026-03-16T21:04:07.982ZINFOcrucible-agent (worker): commit
212026-03-16T21:04:07.986ZINFOcrucible-agent (worker): ok!
222026-03-16T21:04:07.991ZINFOcrucible-agent (worker): SMF ok!
232026-03-16T21:04:08.105ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59920 req_id = 80dd4de0-6615-45fb-a221-b73529cb97e7 response_code = 200 uri = /crucible/0/regions
242026-03-16T21:04:14.370ZINFOcrucible-agent (datafile): region 8b54a705-c933-45d9-b63f-73ae8045e272 state: Requested
252026-03-16T21:04:14.370ZINFOcrucible-agent (dropshot): request completed latency_us = 255 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59920 req_id = c790934f-053b-4139-ad29-39d5e87549b4 response_code = 200 uri = /crucible/0/regions
262026-03-16T21:04:14.370ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-03-16T21:04:14.378ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_263db3db-6f53-4f2d-ac26-d6e3a30a3bcc/crucible/regions/8b54a705-c933-45d9-b63f-73ae8045e272
282026-03-16T21:04:14.378ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_263db3db-6f53-4f2d-ac26-d6e3a30a3bcc/crucible/regions/8b54a705-c933-45d9-b63f-73ae8045e272
292026-03-16T21:04:14.439ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8b54a705-c933-45d9-b63f-73ae8045e272"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8b54a705-c933-45d9-b63f-73ae8045e272" region = 8b54a705-c933-45d9-b63f-73ae8045e272
302026-03-16T21:04:14.439ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8b54a705-c933-45d9-b63f-73ae8045e272" "--data" "/data/regions/8b54a705-c933-45d9-b63f-73ae8045e272" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 8b54a705-c933-45d9-b63f-73ae8045e272
312026-03-16T21:04:14.516ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59920 req_id = f35b1cb0-3807-4dfe-9564-df8c8fd49949 response_code = 200 uri = /crucible/0/regions
322026-03-16T21:04:14.521ZINFOcrucible-agent (worker): region files created ok region = 8b54a705-c933-45d9-b63f-73ae8045e272
332026-03-16T21:04:14.521ZINFOcrucible-agent (datafile): region 8b54a705-c933-45d9-b63f-73ae8045e272 state: Requested -> Created
342026-03-16T21:04:14.522ZINFOcrucible-agent (worker): applying SMF actions post create...
352026-03-16T21:04:14.528ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8b54a705-c933-45d9-b63f-73ae8045e272
362026-03-16T21:04:14.538ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8b54a705-c933-45d9-b63f-73ae8045e272
372026-03-16T21:04:14.548ZINFOcrucible-agent (worker): creating config property group
382026-03-16T21:04:14.553ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8b54a705-c933-45d9-b63f-73ae8045e272
392026-03-16T21:04:14.553ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8b54a705-c933-45d9-b63f-73ae8045e272
402026-03-16T21:04:14.554ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412026-03-16T21:04:14.554ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
422026-03-16T21:04:14.554ZINFOcrucible-agent (worker): commit
432026-03-16T21:04:14.558ZINFOcrucible-agent (worker): ok!
442026-03-16T21:04:14.565ZINFOcrucible-agent (worker): SMF ok!
452026-03-16T21:04:15.154ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59920 req_id = e7dee308-3185-4d73-9413-cadd1b82eb12 response_code = 200 uri = /crucible/0/regions
462026-03-16T21:04:40.319ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59920 req_id = f4b0aef8-2659-4217-b898-fe17c8a7a40a response_code = 200 uri = /crucible/0/regions/8b54a705-c933-45d9-b63f-73ae8045e272
472026-03-16T21:04:40.323ZINFOcrucible-agent (datafile): path is "/data/regions/8b54a705-c933-45d9-b63f-73ae8045e272"
482026-03-16T21:04:40.333ZINFOcrucible-agent (datafile): dataset is oxp_263db3db-6f53-4f2d-ac26-d6e3a30a3bcc/crucible/regions/8b54a705-c933-45d9-b63f-73ae8045e272
492026-03-16T21:04:40.341ZINFOcrucible-agent (datafile): region 8b54a705-c933-45d9-b63f-73ae8045e272 state: Created -> Tombstoned
502026-03-16T21:04:40.341ZINFOcrucible-agent (dropshot): request completed latency_us = 18119 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:59920 req_id = bf35e7c8-4f9b-40a0-ab0b-27ec59a01dad response_code = 204 uri = /crucible/0/regions/8b54a705-c933-45d9-b63f-73ae8045e272
512026-03-16T21:04:40.341ZINFOcrucible-agent (worker): applying SMF actions before removal...
522026-03-16T21:04:40.342ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-8b54a705-c933-45d9-b63f-73ae8045e272 (instance states: (Some(Online), None))
532026-03-16T21:04:40.345ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59920 req_id = 7d7dcca5-19e6-49e5-a40f-c566ae459b62 response_code = 200 uri = /crucible/0/regions/8b54a705-c933-45d9-b63f-73ae8045e272
542026-03-16T21:04:40.352ZINFOcrucible-agent (worker): SMF ok!
552026-03-16T21:04:40.361ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_263db3db-6f53-4f2d-ac26-d6e3a30a3bcc/crucible/regions/8b54a705-c933-45d9-b63f-73ae8045e272" region = 8b54a705-c933-45d9-b63f-73ae8045e272
562026-03-16T21:04:40.418ZINFOcrucible-agent (datafile): region 8b54a705-c933-45d9-b63f-73ae8045e272 state: Tombstoned -> Destroyed
572026-03-16T21:04:40.459ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59920 req_id = f4fe2b85-cae0-488d-a5e9-14315fe55e15 response_code = 200 uri = /crucible/0/regions/8b54a705-c933-45d9-b63f-73ae8045e272