Max level shown:
12026-07-30T03:37:09.956ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:60677
22026-07-30T03:37:10.002ZINFOcrucible-agent (datafile): region 90bb5ef8-9bf2-4168-87ef-a27530a68003 state: Requested
32026-07-30T03:37:10.008ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-07-30T03:37:10.013ZINFOcrucible-agent (dropshot): request completed latency_us = 20590 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60677 req_id = 43823f64-5d5f-425d-a21c-bb66419d4e13 response_code = 200 uri = /crucible/0/regions
52026-07-30T03:37:10.021ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_82bb5c13-a3fd-4a18-a32c-cf537c74a99d/crucible/regions/90bb5ef8-9bf2-4168-87ef-a27530a68003
62026-07-30T03:37:10.021ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_82bb5c13-a3fd-4a18-a32c-cf537c74a99d/crucible/regions/90bb5ef8-9bf2-4168-87ef-a27530a68003
72026-07-30T03:37:10.080ZINFOcrucible-agent (worker): creating region Region { id: RegionId("90bb5ef8-9bf2-4168-87ef-a27530a68003"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/90bb5ef8-9bf2-4168-87ef-a27530a68003" region = 90bb5ef8-9bf2-4168-87ef-a27530a68003
82026-07-30T03:37:10.082ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "90bb5ef8-9bf2-4168-87ef-a27530a68003" "--data" "/data/regions/90bb5ef8-9bf2-4168-87ef-a27530a68003" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 90bb5ef8-9bf2-4168-87ef-a27530a68003
92026-07-30T03:37:10.215ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60677 req_id = 617155f6-c1ca-47a9-871e-46d2bb6723ef response_code = 200 uri = /crucible/0/regions
102026-07-30T03:37:10.456ZINFOcrucible-agent (worker): region files created ok region = 90bb5ef8-9bf2-4168-87ef-a27530a68003
112026-07-30T03:37:10.461ZINFOcrucible-agent (datafile): region 90bb5ef8-9bf2-4168-87ef-a27530a68003 state: Requested -> Created
122026-07-30T03:37:10.461ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-07-30T03:37:10.464ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-90bb5ef8-9bf2-4168-87ef-a27530a68003
142026-07-30T03:37:10.476ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-90bb5ef8-9bf2-4168-87ef-a27530a68003
152026-07-30T03:37:10.492ZINFOcrucible-agent (worker): creating config property group
162026-07-30T03:37:10.496ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-90bb5ef8-9bf2-4168-87ef-a27530a68003
172026-07-30T03:37:10.496ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/90bb5ef8-9bf2-4168-87ef-a27530a68003
182026-07-30T03:37:10.496ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-07-30T03:37:10.496ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
202026-07-30T03:37:10.497ZINFOcrucible-agent (worker): commit
212026-07-30T03:37:10.501ZINFOcrucible-agent (worker): ok!
222026-07-30T03:37:10.506ZINFOcrucible-agent (worker): SMF ok!
232026-07-30T03:37:10.889ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60677 req_id = c39c55d5-8c05-440c-aaf4-8025eb375d4b response_code = 200 uri = /crucible/0/regions
242026-07-30T03:37:16.724ZINFOcrucible-agent (datafile): region 6a70cdf8-a7e5-4ce5-bed6-52acaaa05935 state: Requested
252026-07-30T03:37:16.724ZINFOcrucible-agent (dropshot): request completed latency_us = 227 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60677 req_id = 2f9f109b-2189-431b-a41c-fd9b0c601977 response_code = 200 uri = /crucible/0/regions
262026-07-30T03:37:16.724ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-07-30T03:37:16.730ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_82bb5c13-a3fd-4a18-a32c-cf537c74a99d/crucible/regions/6a70cdf8-a7e5-4ce5-bed6-52acaaa05935
282026-07-30T03:37:16.730ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_82bb5c13-a3fd-4a18-a32c-cf537c74a99d/crucible/regions/6a70cdf8-a7e5-4ce5-bed6-52acaaa05935
292026-07-30T03:37:16.790ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6a70cdf8-a7e5-4ce5-bed6-52acaaa05935"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6a70cdf8-a7e5-4ce5-bed6-52acaaa05935" region = 6a70cdf8-a7e5-4ce5-bed6-52acaaa05935
302026-07-30T03:37:16.790ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6a70cdf8-a7e5-4ce5-bed6-52acaaa05935" "--data" "/data/regions/6a70cdf8-a7e5-4ce5-bed6-52acaaa05935" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6a70cdf8-a7e5-4ce5-bed6-52acaaa05935
312026-07-30T03:37:16.870ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60677 req_id = 9d246275-4c48-44e3-bcac-13e931ea7460 response_code = 200 uri = /crucible/0/regions
322026-07-30T03:37:16.911ZINFOcrucible-agent (worker): region files created ok region = 6a70cdf8-a7e5-4ce5-bed6-52acaaa05935
332026-07-30T03:37:16.911ZINFOcrucible-agent (datafile): region 6a70cdf8-a7e5-4ce5-bed6-52acaaa05935 state: Requested -> Created
342026-07-30T03:37:16.911ZINFOcrucible-agent (worker): applying SMF actions post create...
352026-07-30T03:37:16.911ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6a70cdf8-a7e5-4ce5-bed6-52acaaa05935
362026-07-30T03:37:16.915ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6a70cdf8-a7e5-4ce5-bed6-52acaaa05935
372026-07-30T03:37:16.922ZINFOcrucible-agent (worker): creating config property group
382026-07-30T03:37:16.925ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6a70cdf8-a7e5-4ce5-bed6-52acaaa05935
392026-07-30T03:37:16.926ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6a70cdf8-a7e5-4ce5-bed6-52acaaa05935
402026-07-30T03:37:16.926ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412026-07-30T03:37:16.926ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
422026-07-30T03:37:16.926ZINFOcrucible-agent (worker): commit
432026-07-30T03:37:16.929ZINFOcrucible-agent (worker): ok!
442026-07-30T03:37:16.935ZINFOcrucible-agent (worker): SMF ok!
452026-07-30T03:37:17.202ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60677 req_id = d6c57dd3-e6af-447f-a057-5f64534dc846 response_code = 200 uri = /crucible/0/regions
462026-07-30T03:37:43.123ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60677 req_id = 40b6cb1b-6aa4-4d74-a3c3-ce820be117a1 response_code = 200 uri = /crucible/0/regions/6a70cdf8-a7e5-4ce5-bed6-52acaaa05935
472026-07-30T03:37:43.125ZINFOcrucible-agent (datafile): path is "/data/regions/6a70cdf8-a7e5-4ce5-bed6-52acaaa05935"
482026-07-30T03:37:43.134ZINFOcrucible-agent (datafile): dataset is oxp_82bb5c13-a3fd-4a18-a32c-cf537c74a99d/crucible/regions/6a70cdf8-a7e5-4ce5-bed6-52acaaa05935
492026-07-30T03:37:43.142ZINFOcrucible-agent (datafile): region 6a70cdf8-a7e5-4ce5-bed6-52acaaa05935 state: Created -> Tombstoned
502026-07-30T03:37:43.142ZINFOcrucible-agent (worker): applying SMF actions before removal...
512026-07-30T03:37:43.142ZINFOcrucible-agent (dropshot): request completed latency_us = 16388 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:60677 req_id = 90ae6cb1-3fc7-40e7-a3aa-3b9416a84b44 response_code = 204 uri = /crucible/0/regions/6a70cdf8-a7e5-4ce5-bed6-52acaaa05935
522026-07-30T03:37:43.143ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6a70cdf8-a7e5-4ce5-bed6-52acaaa05935 (instance states: (Some(Online), None))
532026-07-30T03:37:43.147ZINFOcrucible-agent (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60677 req_id = 93b072c0-066f-4d06-894a-20581b28f542 response_code = 200 uri = /crucible/0/regions/6a70cdf8-a7e5-4ce5-bed6-52acaaa05935
542026-07-30T03:37:43.149ZINFOcrucible-agent (worker): SMF ok!
552026-07-30T03:37:43.156ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_82bb5c13-a3fd-4a18-a32c-cf537c74a99d/crucible/regions/6a70cdf8-a7e5-4ce5-bed6-52acaaa05935" region = 6a70cdf8-a7e5-4ce5-bed6-52acaaa05935
562026-07-30T03:37:43.223ZINFOcrucible-agent (datafile): region 6a70cdf8-a7e5-4ce5-bed6-52acaaa05935 state: Tombstoned -> Destroyed
572026-07-30T03:37:43.256ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60677 req_id = a7400e42-0889-428c-8ef4-dcf986c471b2 response_code = 200 uri = /crucible/0/regions/6a70cdf8-a7e5-4ce5-bed6-52acaaa05935