Max level shown:
12026-11-07T22:51:19.784ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:48335
22026-11-07T22:51:19.832ZINFOcrucible-agent (datafile): region eef9d4bc-3e34-415c-80aa-9d9aae2dcaab state: Requested
32026-11-07T22:51:19.840ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-11-07T22:51:19.845ZINFOcrucible-agent (dropshot): request completed latency_us = 21901 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48335 req_id = af679078-75d1-4761-9654-3a33c566c681 response_code = 200 uri = /crucible/0/regions
52026-11-07T22:51:19.853ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_bbbbcf02-2060-4168-b943-dc60d4d4f212/crucible/regions/eef9d4bc-3e34-415c-80aa-9d9aae2dcaab
62026-11-07T22:51:19.853ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_bbbbcf02-2060-4168-b943-dc60d4d4f212/crucible/regions/eef9d4bc-3e34-415c-80aa-9d9aae2dcaab
72026-11-07T22:51:19.907ZINFOcrucible-agent (worker): creating region Region { id: RegionId("eef9d4bc-3e34-415c-80aa-9d9aae2dcaab"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/eef9d4bc-3e34-415c-80aa-9d9aae2dcaab" region = eef9d4bc-3e34-415c-80aa-9d9aae2dcaab
82026-11-07T22:51:19.907ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "eef9d4bc-3e34-415c-80aa-9d9aae2dcaab" "--data" "/data/regions/eef9d4bc-3e34-415c-80aa-9d9aae2dcaab" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = eef9d4bc-3e34-415c-80aa-9d9aae2dcaab
92026-11-07T22:51:20.155ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48335 req_id = 5f3973b7-5a13-4a62-b34d-8a48e47f6ba6 response_code = 200 uri = /crucible/0/regions
102026-11-07T22:51:20.255ZINFOcrucible-agent (worker): region files created ok region = eef9d4bc-3e34-415c-80aa-9d9aae2dcaab
112026-11-07T22:51:20.258ZINFOcrucible-agent (datafile): region eef9d4bc-3e34-415c-80aa-9d9aae2dcaab state: Requested -> Created
122026-11-07T22:51:20.258ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-11-07T22:51:20.258ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-eef9d4bc-3e34-415c-80aa-9d9aae2dcaab
142026-11-07T22:51:20.269ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-eef9d4bc-3e34-415c-80aa-9d9aae2dcaab
152026-11-07T22:51:20.281ZINFOcrucible-agent (worker): creating config property group
162026-11-07T22:51:20.282ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-eef9d4bc-3e34-415c-80aa-9d9aae2dcaab
172026-11-07T22:51:20.283ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/eef9d4bc-3e34-415c-80aa-9d9aae2dcaab
182026-11-07T22:51:20.283ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-11-07T22:51:20.283ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202026-11-07T22:51:20.283ZINFOcrucible-agent (worker): commit
212026-11-07T22:51:20.285ZINFOcrucible-agent (worker): ok!
222026-11-07T22:51:20.288ZINFOcrucible-agent (worker): SMF ok!
232026-11-07T22:51:20.576ZINFOcrucible-agent (dropshot): request completed latency_us = 91 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48335 req_id = 50844d77-f557-48fa-abfd-d38bc526b4ce response_code = 200 uri = /crucible/0/regions
242026-11-07T22:51:26.351ZINFOcrucible-agent (datafile): region 90b28b64-9c98-4b21-8d9c-c1272bf70e79 state: Requested
252026-11-07T22:51:26.352ZINFOcrucible-agent (dropshot): request completed latency_us = 253 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48335 req_id = 312da328-e370-41db-bfc3-6e520c52e4f4 response_code = 200 uri = /crucible/0/regions
262026-11-07T22:51:26.352ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-11-07T22:51:26.358ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_bbbbcf02-2060-4168-b943-dc60d4d4f212/crucible/regions/90b28b64-9c98-4b21-8d9c-c1272bf70e79
282026-11-07T22:51:26.358ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_bbbbcf02-2060-4168-b943-dc60d4d4f212/crucible/regions/90b28b64-9c98-4b21-8d9c-c1272bf70e79
292026-11-07T22:51:26.422ZINFOcrucible-agent (worker): creating region Region { id: RegionId("90b28b64-9c98-4b21-8d9c-c1272bf70e79"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/90b28b64-9c98-4b21-8d9c-c1272bf70e79" region = 90b28b64-9c98-4b21-8d9c-c1272bf70e79
302026-11-07T22:51:26.422ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "90b28b64-9c98-4b21-8d9c-c1272bf70e79" "--data" "/data/regions/90b28b64-9c98-4b21-8d9c-c1272bf70e79" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 90b28b64-9c98-4b21-8d9c-c1272bf70e79
312026-11-07T22:51:26.468ZINFOcrucible-agent (worker): region files created ok region = 90b28b64-9c98-4b21-8d9c-c1272bf70e79
322026-11-07T22:51:26.468ZINFOcrucible-agent (datafile): region 90b28b64-9c98-4b21-8d9c-c1272bf70e79 state: Requested -> Created
332026-11-07T22:51:26.468ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-11-07T22:51:26.469ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-90b28b64-9c98-4b21-8d9c-c1272bf70e79
352026-11-07T22:51:26.470ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-90b28b64-9c98-4b21-8d9c-c1272bf70e79
362026-11-07T22:51:26.474ZINFOcrucible-agent (worker): creating config property group
372026-11-07T22:51:26.475ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-90b28b64-9c98-4b21-8d9c-c1272bf70e79
382026-11-07T22:51:26.476ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/90b28b64-9c98-4b21-8d9c-c1272bf70e79
392026-11-07T22:51:26.476ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-11-07T22:51:26.476ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
412026-11-07T22:51:26.476ZINFOcrucible-agent (worker): commit
422026-11-07T22:51:26.478ZINFOcrucible-agent (worker): ok!
432026-11-07T22:51:26.482ZINFOcrucible-agent (worker): SMF ok!
442026-11-07T22:51:26.699ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48335 req_id = c64a573c-4cbd-4ddf-a903-21bccfdf3fd2 response_code = 200 uri = /crucible/0/regions
452026-11-07T22:51:50.983ZINFOcrucible-agent (dropshot): request completed latency_us = 100 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:48335 req_id = 99adc68f-17e0-4bfa-b398-14aace14a62f response_code = 200 uri = /crucible/0/regions/90b28b64-9c98-4b21-8d9c-c1272bf70e79
462026-11-07T22:51:50.986ZINFOcrucible-agent (datafile): path is "/data/regions/90b28b64-9c98-4b21-8d9c-c1272bf70e79"
472026-11-07T22:51:50.994ZINFOcrucible-agent (datafile): dataset is oxp_bbbbcf02-2060-4168-b943-dc60d4d4f212/crucible/regions/90b28b64-9c98-4b21-8d9c-c1272bf70e79
482026-11-07T22:51:51.001ZINFOcrucible-agent (datafile): region 90b28b64-9c98-4b21-8d9c-c1272bf70e79 state: Created -> Tombstoned
492026-11-07T22:51:51.001ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-11-07T22:51:51.001ZINFOcrucible-agent (dropshot): request completed latency_us = 15014 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:48335 req_id = 5acff656-e230-4614-ab0a-45b1f102dfa2 response_code = 204 uri = /crucible/0/regions/90b28b64-9c98-4b21-8d9c-c1272bf70e79
512026-11-07T22:51:51.002ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-90b28b64-9c98-4b21-8d9c-c1272bf70e79 (instance states: (Some(Online), None))
522026-11-07T22:51:51.004ZINFOcrucible-agent (dropshot): request completed latency_us = 38 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:48335 req_id = beb21f0f-3423-4e3a-bbb8-1211ba78ba35 response_code = 200 uri = /crucible/0/regions/90b28b64-9c98-4b21-8d9c-c1272bf70e79
532026-11-07T22:51:51.005ZINFOcrucible-agent (worker): SMF ok!
542026-11-07T22:51:51.013ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_bbbbcf02-2060-4168-b943-dc60d4d4f212/crucible/regions/90b28b64-9c98-4b21-8d9c-c1272bf70e79" region = 90b28b64-9c98-4b21-8d9c-c1272bf70e79
552026-11-07T22:51:51.058ZINFOcrucible-agent (datafile): region 90b28b64-9c98-4b21-8d9c-c1272bf70e79 state: Tombstoned -> Destroyed
562026-11-07T22:51:51.068ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:48335 req_id = 75d35cca-111c-418b-8c9b-f6ae85150ff1 response_code = 200 uri = /crucible/0/regions/90b28b64-9c98-4b21-8d9c-c1272bf70e79