Max level shown:
12026-03-02T23:10:53.897ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:59283
22026-03-02T23:10:53.897ZINFOcrucible-agent (datafile): region 824a9c1d-902c-4134-a261-d8094bab42e2 state: Requested
32026-03-02T23:10:53.898ZINFOcrucible-agent (dropshot): request completed latency_us = 1052 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59283 req_id = 6e9f0984-f484-463e-88c3-d741d0b69acb response_code = 200 uri = /crucible/0/regions
42026-03-02T23:10:53.898ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-03-02T23:10:53.910ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b66a316e-1ed2-4a9d-badc-cbc1f0790deb/crucible/regions/824a9c1d-902c-4134-a261-d8094bab42e2
62026-03-02T23:10:53.910ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b66a316e-1ed2-4a9d-badc-cbc1f0790deb/crucible/regions/824a9c1d-902c-4134-a261-d8094bab42e2
72026-03-02T23:10:53.967ZINFOcrucible-agent (worker): creating region Region { id: RegionId("824a9c1d-902c-4134-a261-d8094bab42e2"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/824a9c1d-902c-4134-a261-d8094bab42e2" region = 824a9c1d-902c-4134-a261-d8094bab42e2
82026-03-02T23:10:53.967ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "824a9c1d-902c-4134-a261-d8094bab42e2" "--data" "/data/regions/824a9c1d-902c-4134-a261-d8094bab42e2" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 824a9c1d-902c-4134-a261-d8094bab42e2
92026-03-02T23:10:54.054ZINFOcrucible-agent (worker): region files created ok region = 824a9c1d-902c-4134-a261-d8094bab42e2
102026-03-02T23:10:54.054ZINFOcrucible-agent (datafile): region 824a9c1d-902c-4134-a261-d8094bab42e2 state: Requested -> Created
112026-03-02T23:10:54.054ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-03-02T23:10:54.055ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-824a9c1d-902c-4134-a261-d8094bab42e2
132026-03-02T23:10:54.066ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-824a9c1d-902c-4134-a261-d8094bab42e2
142026-03-02T23:10:54.089ZINFOcrucible-agent (worker): creating config property group
152026-03-02T23:10:54.094ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-824a9c1d-902c-4134-a261-d8094bab42e2
162026-03-02T23:10:54.094ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/824a9c1d-902c-4134-a261-d8094bab42e2
172026-03-02T23:10:54.094ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-03-02T23:10:54.094ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
192026-03-02T23:10:54.094ZINFOcrucible-agent (worker): commit
202026-03-02T23:10:54.098ZINFOcrucible-agent (worker): ok!
212026-03-02T23:10:54.103ZINFOcrucible-agent (worker): SMF ok!
222026-03-02T23:10:54.208ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59283 req_id = 7cf67c1f-9c5b-4fc9-b740-77006e2af6cc response_code = 200 uri = /crucible/0/regions
232026-03-02T23:11:01.323ZINFOcrucible-agent (datafile): region b8afab8a-e240-47f3-9891-aca690266577 state: Requested
242026-03-02T23:11:01.323ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
252026-03-02T23:11:01.323ZINFOcrucible-agent (dropshot): request completed latency_us = 242 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59283 req_id = 167d254f-44f2-407f-8018-38cef860a146 response_code = 200 uri = /crucible/0/regions
262026-03-02T23:11:01.331ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b66a316e-1ed2-4a9d-badc-cbc1f0790deb/crucible/regions/b8afab8a-e240-47f3-9891-aca690266577
272026-03-02T23:11:01.331ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b66a316e-1ed2-4a9d-badc-cbc1f0790deb/crucible/regions/b8afab8a-e240-47f3-9891-aca690266577
282026-03-02T23:11:01.375ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b8afab8a-e240-47f3-9891-aca690266577"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b8afab8a-e240-47f3-9891-aca690266577" region = b8afab8a-e240-47f3-9891-aca690266577
292026-03-02T23:11:01.375ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b8afab8a-e240-47f3-9891-aca690266577" "--data" "/data/regions/b8afab8a-e240-47f3-9891-aca690266577" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b8afab8a-e240-47f3-9891-aca690266577
302026-03-02T23:11:01.457ZINFOcrucible-agent (worker): region files created ok region = b8afab8a-e240-47f3-9891-aca690266577
312026-03-02T23:11:01.457ZINFOcrucible-agent (datafile): region b8afab8a-e240-47f3-9891-aca690266577 state: Requested -> Created
322026-03-02T23:11:01.457ZINFOcrucible-agent (worker): applying SMF actions post create...
332026-03-02T23:11:01.462ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b8afab8a-e240-47f3-9891-aca690266577
342026-03-02T23:11:01.470ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b8afab8a-e240-47f3-9891-aca690266577
352026-03-02T23:11:01.485ZINFOcrucible-agent (worker): creating config property group
362026-03-02T23:11:01.489ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b8afab8a-e240-47f3-9891-aca690266577
372026-03-02T23:11:01.490ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b8afab8a-e240-47f3-9891-aca690266577
382026-03-02T23:11:01.490ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392026-03-02T23:11:01.490ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
402026-03-02T23:11:01.490ZINFOcrucible-agent (worker): commit
412026-03-02T23:11:01.494ZINFOcrucible-agent (worker): ok!
422026-03-02T23:11:01.499ZINFOcrucible-agent (worker): SMF ok!
432026-03-02T23:11:01.515ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59283 req_id = 7b75e4b1-3e00-4910-9735-e689dcefc2f3 response_code = 200 uri = /crucible/0/regions
442026-03-02T23:11:27.476ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59283 req_id = 2e207cef-71bc-47e2-bb8f-80f88f1b347b response_code = 200 uri = /crucible/0/regions/b8afab8a-e240-47f3-9891-aca690266577
452026-03-02T23:11:27.479ZINFOcrucible-agent (datafile): path is "/data/regions/b8afab8a-e240-47f3-9891-aca690266577"
462026-03-02T23:11:27.491ZINFOcrucible-agent (datafile): dataset is oxp_b66a316e-1ed2-4a9d-badc-cbc1f0790deb/crucible/regions/b8afab8a-e240-47f3-9891-aca690266577
472026-03-02T23:11:27.498ZINFOcrucible-agent (datafile): region b8afab8a-e240-47f3-9891-aca690266577 state: Created -> Tombstoned
482026-03-02T23:11:27.498ZINFOcrucible-agent (dropshot): request completed latency_us = 19476 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:59283 req_id = c8d1d64c-d079-4b40-93f1-6d1ae9ffe96e response_code = 204 uri = /crucible/0/regions/b8afab8a-e240-47f3-9891-aca690266577
492026-03-02T23:11:27.498ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-03-02T23:11:27.500ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-b8afab8a-e240-47f3-9891-aca690266577 (instance states: (Some(Online), None))
512026-03-02T23:11:27.501ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59283 req_id = 8561d29f-831b-42e2-a52b-26606092bda9 response_code = 200 uri = /crucible/0/regions/b8afab8a-e240-47f3-9891-aca690266577
522026-03-02T23:11:27.512ZINFOcrucible-agent (worker): SMF ok!
532026-03-02T23:11:27.519ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_b66a316e-1ed2-4a9d-badc-cbc1f0790deb/crucible/regions/b8afab8a-e240-47f3-9891-aca690266577" region = b8afab8a-e240-47f3-9891-aca690266577
542026-03-02T23:11:27.568ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59283 req_id = 4e6dcc27-d08d-4143-90c0-911d4f3e41a7 response_code = 200 uri = /crucible/0/regions/b8afab8a-e240-47f3-9891-aca690266577
552026-03-02T23:11:27.586ZINFOcrucible-agent (datafile): region b8afab8a-e240-47f3-9891-aca690266577 state: Tombstoned -> Destroyed
562026-03-02T23:11:27.695ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59283 req_id = ac504100-1b27-4dca-a90e-c2735ee58828 response_code = 200 uri = /crucible/0/regions/b8afab8a-e240-47f3-9891-aca690266577