Max level shown:
12026-11-07T01:41:49.767ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:42851
22026-11-07T01:41:49.817ZINFOcrucible-agent (datafile): region 166dd224-ad1a-4929-bb77-f233dbf9ef45 state: Requested
32026-11-07T01:41:49.828ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-11-07T01:41:49.833ZINFOcrucible-agent (dropshot): request completed latency_us = 31656 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42851 req_id = 4903a313-0cdf-464f-9a31-5ddca3a5e240 response_code = 200 uri = /crucible/0/regions
52026-11-07T01:41:49.838ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_75e8657a-59e2-4773-83af-165d183fb896/crucible/regions/166dd224-ad1a-4929-bb77-f233dbf9ef45
62026-11-07T01:41:49.838ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_75e8657a-59e2-4773-83af-165d183fb896/crucible/regions/166dd224-ad1a-4929-bb77-f233dbf9ef45
72026-11-07T01:41:49.881ZINFOcrucible-agent (worker): creating region Region { id: RegionId("166dd224-ad1a-4929-bb77-f233dbf9ef45"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/166dd224-ad1a-4929-bb77-f233dbf9ef45" region = 166dd224-ad1a-4929-bb77-f233dbf9ef45
82026-11-07T01:41:49.881ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "166dd224-ad1a-4929-bb77-f233dbf9ef45" "--data" "/data/regions/166dd224-ad1a-4929-bb77-f233dbf9ef45" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 166dd224-ad1a-4929-bb77-f233dbf9ef45
92026-11-07T01:41:50.104ZINFOcrucible-agent (dropshot): request completed latency_us = 98 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42851 req_id = a252fe20-4721-4ca1-ab38-cf2b0c47134e response_code = 200 uri = /crucible/0/regions
102026-11-07T01:41:50.229ZINFOcrucible-agent (worker): region files created ok region = 166dd224-ad1a-4929-bb77-f233dbf9ef45
112026-11-07T01:41:50.231ZINFOcrucible-agent (datafile): region 166dd224-ad1a-4929-bb77-f233dbf9ef45 state: Requested -> Created
122026-11-07T01:41:50.231ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-11-07T01:41:50.231ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-166dd224-ad1a-4929-bb77-f233dbf9ef45
142026-11-07T01:41:50.238ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-166dd224-ad1a-4929-bb77-f233dbf9ef45
152026-11-07T01:41:50.245ZINFOcrucible-agent (worker): creating config property group
162026-11-07T01:41:50.246ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-166dd224-ad1a-4929-bb77-f233dbf9ef45
172026-11-07T01:41:50.247ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/166dd224-ad1a-4929-bb77-f233dbf9ef45
182026-11-07T01:41:50.247ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-11-07T01:41:50.247ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202026-11-07T01:41:50.247ZINFOcrucible-agent (worker): commit
212026-11-07T01:41:50.249ZINFOcrucible-agent (worker): ok!
222026-11-07T01:41:50.252ZINFOcrucible-agent (worker): SMF ok!
232026-11-07T01:41:50.443ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42851 req_id = 620ede4c-c938-41f5-a9dc-afedb850a217 response_code = 200 uri = /crucible/0/regions
242026-11-07T01:41:55.767ZINFOcrucible-agent (datafile): region 50a1fe30-53ce-437c-8346-02dd232570b4 state: Requested
252026-11-07T01:41:55.767ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-11-07T01:41:55.767ZINFOcrucible-agent (dropshot): request completed latency_us = 224 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42851 req_id = 44486ad1-7fd3-415b-b89a-927a6c3494e0 response_code = 200 uri = /crucible/0/regions
272026-11-07T01:41:55.775ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_75e8657a-59e2-4773-83af-165d183fb896/crucible/regions/50a1fe30-53ce-437c-8346-02dd232570b4
282026-11-07T01:41:55.775ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_75e8657a-59e2-4773-83af-165d183fb896/crucible/regions/50a1fe30-53ce-437c-8346-02dd232570b4
292026-11-07T01:41:55.817ZINFOcrucible-agent (worker): creating region Region { id: RegionId("50a1fe30-53ce-437c-8346-02dd232570b4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/50a1fe30-53ce-437c-8346-02dd232570b4" region = 50a1fe30-53ce-437c-8346-02dd232570b4
302026-11-07T01:41:55.817ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "50a1fe30-53ce-437c-8346-02dd232570b4" "--data" "/data/regions/50a1fe30-53ce-437c-8346-02dd232570b4" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 50a1fe30-53ce-437c-8346-02dd232570b4
312026-11-07T01:41:55.871ZINFOcrucible-agent (worker): region files created ok region = 50a1fe30-53ce-437c-8346-02dd232570b4
322026-11-07T01:41:55.871ZINFOcrucible-agent (datafile): region 50a1fe30-53ce-437c-8346-02dd232570b4 state: Requested -> Created
332026-11-07T01:41:55.871ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-11-07T01:41:55.872ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-50a1fe30-53ce-437c-8346-02dd232570b4
352026-11-07T01:41:55.874ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-50a1fe30-53ce-437c-8346-02dd232570b4
362026-11-07T01:41:55.879ZINFOcrucible-agent (worker): creating config property group
372026-11-07T01:41:55.880ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-50a1fe30-53ce-437c-8346-02dd232570b4
382026-11-07T01:41:55.881ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/50a1fe30-53ce-437c-8346-02dd232570b4
392026-11-07T01:41:55.881ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-11-07T01:41:55.881ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
412026-11-07T01:41:55.881ZINFOcrucible-agent (worker): commit
422026-11-07T01:41:55.883ZINFOcrucible-agent (worker): ok!
432026-11-07T01:41:55.886ZINFOcrucible-agent (worker): SMF ok!
442026-11-07T01:41:55.978ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42851 req_id = 90a8c298-ed87-4081-a58e-3fd7727b404b response_code = 200 uri = /crucible/0/regions
452026-11-07T01:42:21.245ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42851 req_id = 00b96927-84ad-4c62-b544-3f9665fbfeea response_code = 200 uri = /crucible/0/regions/50a1fe30-53ce-437c-8346-02dd232570b4
462026-11-07T01:42:21.248ZINFOcrucible-agent (datafile): path is "/data/regions/50a1fe30-53ce-437c-8346-02dd232570b4"
472026-11-07T01:42:21.256ZINFOcrucible-agent (datafile): dataset is oxp_75e8657a-59e2-4773-83af-165d183fb896/crucible/regions/50a1fe30-53ce-437c-8346-02dd232570b4
482026-11-07T01:42:21.263ZINFOcrucible-agent (datafile): region 50a1fe30-53ce-437c-8346-02dd232570b4 state: Created -> Tombstoned
492026-11-07T01:42:21.263ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-11-07T01:42:21.263ZINFOcrucible-agent (dropshot): request completed latency_us = 15611 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:42851 req_id = c7159325-41bd-4817-b49c-d3e5f073a845 response_code = 204 uri = /crucible/0/regions/50a1fe30-53ce-437c-8346-02dd232570b4
512026-11-07T01:42:21.264ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-50a1fe30-53ce-437c-8346-02dd232570b4 (instance states: (Some(Online), None))
522026-11-07T01:42:21.267ZINFOcrucible-agent (worker): SMF ok!
532026-11-07T01:42:21.268ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42851 req_id = 0f4335a4-adfc-4ec0-b756-2c0c8710e8db response_code = 200 uri = /crucible/0/regions/50a1fe30-53ce-437c-8346-02dd232570b4
542026-11-07T01:42:21.275ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_75e8657a-59e2-4773-83af-165d183fb896/crucible/regions/50a1fe30-53ce-437c-8346-02dd232570b4" region = 50a1fe30-53ce-437c-8346-02dd232570b4
552026-11-07T01:42:21.319ZINFOcrucible-agent (datafile): region 50a1fe30-53ce-437c-8346-02dd232570b4 state: Tombstoned -> Destroyed
562026-11-07T01:42:21.407ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42851 req_id = 72d4c7f5-89bb-46d7-9389-17504676d725 response_code = 200 uri = /crucible/0/regions/50a1fe30-53ce-437c-8346-02dd232570b4