Max level shown:
12026-05-06T13:48:02.275ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:36150
22026-05-06T13:48:02.320ZINFOcrucible-agent (datafile): region bbd5b1af-1107-4333-8690-420777c54369 state: Requested
32026-05-06T13:48:02.324ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-06T13:48:02.324ZINFOcrucible-agent (dropshot): request completed latency_us = 19323 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:36150 req_id = 4ed87fcf-056c-410c-8b29-c69f5df6275d response_code = 200 uri = /crucible/0/regions
52026-05-06T13:48:02.335ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_583d7ff7-2254-4289-814c-b6caa17b2c5f/crucible/regions/bbd5b1af-1107-4333-8690-420777c54369
62026-05-06T13:48:02.335ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_583d7ff7-2254-4289-814c-b6caa17b2c5f/crucible/regions/bbd5b1af-1107-4333-8690-420777c54369
72026-05-06T13:48:02.387ZINFOcrucible-agent (worker): creating region Region { id: RegionId("bbd5b1af-1107-4333-8690-420777c54369"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/bbd5b1af-1107-4333-8690-420777c54369" region = bbd5b1af-1107-4333-8690-420777c54369
82026-05-06T13:48:02.390ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "bbd5b1af-1107-4333-8690-420777c54369" "--data" "/data/regions/bbd5b1af-1107-4333-8690-420777c54369" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = bbd5b1af-1107-4333-8690-420777c54369
92026-05-06T13:48:02.599ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:36150 req_id = 2e458648-6efb-49a9-97c9-f8e17829b4d2 response_code = 200 uri = /crucible/0/regions
102026-05-06T13:48:02.749ZINFOcrucible-agent (worker): region files created ok region = bbd5b1af-1107-4333-8690-420777c54369
112026-05-06T13:48:02.749ZINFOcrucible-agent (datafile): region bbd5b1af-1107-4333-8690-420777c54369 state: Requested -> Created
122026-05-06T13:48:02.749ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-05-06T13:48:02.750ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-bbd5b1af-1107-4333-8690-420777c54369
142026-05-06T13:48:02.762ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-bbd5b1af-1107-4333-8690-420777c54369
152026-05-06T13:48:02.786ZINFOcrucible-agent (worker): creating config property group
162026-05-06T13:48:02.789ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-bbd5b1af-1107-4333-8690-420777c54369
172026-05-06T13:48:02.790ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bbd5b1af-1107-4333-8690-420777c54369
182026-05-06T13:48:02.790ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-05-06T13:48:02.790ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
202026-05-06T13:48:02.790ZINFOcrucible-agent (worker): commit
212026-05-06T13:48:02.795ZINFOcrucible-agent (worker): ok!
222026-05-06T13:48:02.800ZINFOcrucible-agent (worker): SMF ok!
232026-05-06T13:48:03.295ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:36150 req_id = e55bb624-b6ae-44e9-8f7d-7a7bd94e5f23 response_code = 200 uri = /crucible/0/regions
242026-05-06T13:48:09.644ZINFOcrucible-agent (datafile): region 72d28dc7-c7ce-44fa-8317-1e68dfca1909 state: Requested
252026-05-06T13:48:09.644ZINFOcrucible-agent (dropshot): request completed latency_us = 219 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:36150 req_id = 1ae91f9a-e400-47b7-9512-4137c739d4b6 response_code = 200 uri = /crucible/0/regions
262026-05-06T13:48:09.644ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-05-06T13:48:09.651ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_583d7ff7-2254-4289-814c-b6caa17b2c5f/crucible/regions/72d28dc7-c7ce-44fa-8317-1e68dfca1909
282026-05-06T13:48:09.651ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_583d7ff7-2254-4289-814c-b6caa17b2c5f/crucible/regions/72d28dc7-c7ce-44fa-8317-1e68dfca1909
292026-05-06T13:48:09.702ZINFOcrucible-agent (worker): creating region Region { id: RegionId("72d28dc7-c7ce-44fa-8317-1e68dfca1909"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/72d28dc7-c7ce-44fa-8317-1e68dfca1909" region = 72d28dc7-c7ce-44fa-8317-1e68dfca1909
302026-05-06T13:48:09.702ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "72d28dc7-c7ce-44fa-8317-1e68dfca1909" "--data" "/data/regions/72d28dc7-c7ce-44fa-8317-1e68dfca1909" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 72d28dc7-c7ce-44fa-8317-1e68dfca1909
312026-05-06T13:48:09.786ZINFOcrucible-agent (worker): region files created ok region = 72d28dc7-c7ce-44fa-8317-1e68dfca1909
322026-05-06T13:48:09.786ZINFOcrucible-agent (datafile): region 72d28dc7-c7ce-44fa-8317-1e68dfca1909 state: Requested -> Created
332026-05-06T13:48:09.786ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-05-06T13:48:09.787ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-72d28dc7-c7ce-44fa-8317-1e68dfca1909
352026-05-06T13:48:09.791ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-72d28dc7-c7ce-44fa-8317-1e68dfca1909
362026-05-06T13:48:09.800ZINFOcrucible-agent (worker): creating config property group
372026-05-06T13:48:09.803ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-72d28dc7-c7ce-44fa-8317-1e68dfca1909
382026-05-06T13:48:09.803ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/72d28dc7-c7ce-44fa-8317-1e68dfca1909
392026-05-06T13:48:09.803ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-05-06T13:48:09.803ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
412026-05-06T13:48:09.803ZINFOcrucible-agent (worker): commit
422026-05-06T13:48:09.807ZINFOcrucible-agent (worker): ok!
432026-05-06T13:48:09.818ZINFOcrucible-agent (worker): SMF ok!
442026-05-06T13:48:09.969ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:36150 req_id = 4533f227-a630-4c1e-a530-5985d30a8110 response_code = 200 uri = /crucible/0/regions
452026-05-06T13:48:41.776ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:62523
462026-05-06T13:48:41.776ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62523 req_id = a4edc9f4-d8de-4c0a-accc-cdfc4b421466 response_code = 200 uri = /crucible/0/regions/72d28dc7-c7ce-44fa-8317-1e68dfca1909
472026-05-06T13:48:41.780ZINFOcrucible-agent (datafile): path is "/data/regions/72d28dc7-c7ce-44fa-8317-1e68dfca1909"
482026-05-06T13:48:41.791ZINFOcrucible-agent (datafile): dataset is oxp_583d7ff7-2254-4289-814c-b6caa17b2c5f/crucible/regions/72d28dc7-c7ce-44fa-8317-1e68dfca1909
492026-05-06T13:48:41.799ZINFOcrucible-agent (datafile): region 72d28dc7-c7ce-44fa-8317-1e68dfca1909 state: Created -> Tombstoned
502026-05-06T13:48:41.799ZINFOcrucible-agent (dropshot): request completed latency_us = 18812 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:62523 req_id = 4fe6d60f-fcbf-4b4b-9cb7-ff7f6a860446 response_code = 204 uri = /crucible/0/regions/72d28dc7-c7ce-44fa-8317-1e68dfca1909
512026-05-06T13:48:41.799ZINFOcrucible-agent (worker): applying SMF actions before removal...
522026-05-06T13:48:41.799ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-72d28dc7-c7ce-44fa-8317-1e68dfca1909 (instance states: (Some(Online), None))
532026-05-06T13:48:41.803ZINFOcrucible-agent (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62523 req_id = bfb94a15-bfcb-4bf4-92dd-4bc22a4585c4 response_code = 200 uri = /crucible/0/regions/72d28dc7-c7ce-44fa-8317-1e68dfca1909
542026-05-06T13:48:41.821ZINFOcrucible-agent (worker): SMF ok!
552026-05-06T13:48:41.827ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_583d7ff7-2254-4289-814c-b6caa17b2c5f/crucible/regions/72d28dc7-c7ce-44fa-8317-1e68dfca1909" region = 72d28dc7-c7ce-44fa-8317-1e68dfca1909
562026-05-06T13:48:41.924ZINFOcrucible-agent (datafile): region 72d28dc7-c7ce-44fa-8317-1e68dfca1909 state: Tombstoned -> Destroyed
572026-05-06T13:48:41.952ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62523 req_id = 4ab41020-e1d8-463c-9a07-bbd55bc4a8b1 response_code = 200 uri = /crucible/0/regions/72d28dc7-c7ce-44fa-8317-1e68dfca1909