Max level shown:
12026-11-04T00:38:32.536ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:42198
22026-11-04T00:38:32.536ZINFOcrucible-agent (datafile): region 04871120-2fea-4693-964a-641b0e8422a3 state: Requested
32026-11-04T00:38:32.538ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-11-04T00:38:32.538ZINFOcrucible-agent (dropshot): request completed latency_us = 1101 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:42198 req_id = 399b5854-17ed-429b-bb03-934a33f6fdb8 response_code = 200 uri = /crucible/0/regions
52026-11-04T00:38:32.545ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_753d05d8-da63-4f16-8f51-d323daf51cbf/crucible/regions/04871120-2fea-4693-964a-641b0e8422a3
62026-11-04T00:38:32.545ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_753d05d8-da63-4f16-8f51-d323daf51cbf/crucible/regions/04871120-2fea-4693-964a-641b0e8422a3
72026-11-04T00:38:32.589ZINFOcrucible-agent (worker): creating region Region { id: RegionId("04871120-2fea-4693-964a-641b0e8422a3"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/04871120-2fea-4693-964a-641b0e8422a3" region = 04871120-2fea-4693-964a-641b0e8422a3
82026-11-04T00:38:32.589ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "04871120-2fea-4693-964a-641b0e8422a3" "--data" "/data/regions/04871120-2fea-4693-964a-641b0e8422a3" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 04871120-2fea-4693-964a-641b0e8422a3
92026-11-04T00:38:32.638ZINFOcrucible-agent (worker): region files created ok region = 04871120-2fea-4693-964a-641b0e8422a3
102026-11-04T00:38:32.638ZINFOcrucible-agent (datafile): region 04871120-2fea-4693-964a-641b0e8422a3 state: Requested -> Created
112026-11-04T00:38:32.638ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-11-04T00:38:32.639ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-04871120-2fea-4693-964a-641b0e8422a3
132026-11-04T00:38:32.643ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-04871120-2fea-4693-964a-641b0e8422a3
142026-11-04T00:38:32.657ZINFOcrucible-agent (worker): creating config property group
152026-11-04T00:38:32.658ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-04871120-2fea-4693-964a-641b0e8422a3
162026-11-04T00:38:32.658ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/04871120-2fea-4693-964a-641b0e8422a3
172026-11-04T00:38:32.658ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-11-04T00:38:32.658ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
192026-11-04T00:38:32.658ZINFOcrucible-agent (worker): commit
202026-11-04T00:38:32.660ZINFOcrucible-agent (worker): ok!
212026-11-04T00:38:32.663ZINFOcrucible-agent (worker): SMF ok!
222026-11-04T00:38:32.779ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:42198 req_id = ff3b5411-fb65-4d81-9aad-ab938ac0b8d2 response_code = 200 uri = /crucible/0/regions
232026-11-04T00:38:39.048ZINFOcrucible-agent (datafile): region 9fc653d7-15f9-457c-9aec-f3ff39da3edf state: Requested
242026-11-04T00:38:39.048ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
252026-11-04T00:38:39.048ZINFOcrucible-agent (dropshot): request completed latency_us = 265 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:42198 req_id = dc9593c0-3b32-4408-a99e-46a4bb64b86e response_code = 200 uri = /crucible/0/regions
262026-11-04T00:38:39.054ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_753d05d8-da63-4f16-8f51-d323daf51cbf/crucible/regions/9fc653d7-15f9-457c-9aec-f3ff39da3edf
272026-11-04T00:38:39.054ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_753d05d8-da63-4f16-8f51-d323daf51cbf/crucible/regions/9fc653d7-15f9-457c-9aec-f3ff39da3edf
282026-11-04T00:38:39.096ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9fc653d7-15f9-457c-9aec-f3ff39da3edf"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9fc653d7-15f9-457c-9aec-f3ff39da3edf" region = 9fc653d7-15f9-457c-9aec-f3ff39da3edf
292026-11-04T00:38:39.096ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9fc653d7-15f9-457c-9aec-f3ff39da3edf" "--data" "/data/regions/9fc653d7-15f9-457c-9aec-f3ff39da3edf" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 9fc653d7-15f9-457c-9aec-f3ff39da3edf
302026-11-04T00:38:39.146ZINFOcrucible-agent (worker): region files created ok region = 9fc653d7-15f9-457c-9aec-f3ff39da3edf
312026-11-04T00:38:39.146ZINFOcrucible-agent (datafile): region 9fc653d7-15f9-457c-9aec-f3ff39da3edf state: Requested -> Created
322026-11-04T00:38:39.146ZINFOcrucible-agent (worker): applying SMF actions post create...
332026-11-04T00:38:39.148ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9fc653d7-15f9-457c-9aec-f3ff39da3edf
342026-11-04T00:38:39.156ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9fc653d7-15f9-457c-9aec-f3ff39da3edf
352026-11-04T00:38:39.160ZINFOcrucible-agent (worker): creating config property group
362026-11-04T00:38:39.164ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9fc653d7-15f9-457c-9aec-f3ff39da3edf
372026-11-04T00:38:39.164ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9fc653d7-15f9-457c-9aec-f3ff39da3edf
382026-11-04T00:38:39.164ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392026-11-04T00:38:39.164ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
402026-11-04T00:38:39.164ZINFOcrucible-agent (worker): commit
412026-11-04T00:38:39.166ZINFOcrucible-agent (worker): ok!
422026-11-04T00:38:39.168ZINFOcrucible-agent (worker): SMF ok!
432026-11-04T00:38:39.276ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:42198 req_id = 96688d35-d026-4a4e-a90b-8a7fdf8c230c response_code = 200 uri = /crucible/0/regions
442026-11-04T00:39:06.019ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:42198 req_id = 38f9ee74-c167-4da7-a5f1-499b90666fd9 response_code = 200 uri = /crucible/0/regions/9fc653d7-15f9-457c-9aec-f3ff39da3edf
452026-11-04T00:39:06.023ZINFOcrucible-agent (datafile): path is "/data/regions/9fc653d7-15f9-457c-9aec-f3ff39da3edf"
462026-11-04T00:39:06.033ZINFOcrucible-agent (datafile): dataset is oxp_753d05d8-da63-4f16-8f51-d323daf51cbf/crucible/regions/9fc653d7-15f9-457c-9aec-f3ff39da3edf
472026-11-04T00:39:06.039ZINFOcrucible-agent (datafile): region 9fc653d7-15f9-457c-9aec-f3ff39da3edf state: Created -> Tombstoned
482026-11-04T00:39:06.039ZINFOcrucible-agent (dropshot): request completed latency_us = 16450 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:42198 req_id = 970e9ca2-02de-410e-b472-2f1ec5cb762d response_code = 204 uri = /crucible/0/regions/9fc653d7-15f9-457c-9aec-f3ff39da3edf
492026-11-04T00:39:06.039ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-11-04T00:39:06.041ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-9fc653d7-15f9-457c-9aec-f3ff39da3edf (instance states: (Some(Online), None))
512026-11-04T00:39:06.042ZINFOcrucible-agent (dropshot): request completed latency_us = 41 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:42198 req_id = 4a79beeb-2e09-4a13-85c8-2ebc30242553 response_code = 200 uri = /crucible/0/regions/9fc653d7-15f9-457c-9aec-f3ff39da3edf
522026-11-04T00:39:06.044ZINFOcrucible-agent (worker): SMF ok!
532026-11-04T00:39:06.052ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_753d05d8-da63-4f16-8f51-d323daf51cbf/crucible/regions/9fc653d7-15f9-457c-9aec-f3ff39da3edf" region = 9fc653d7-15f9-457c-9aec-f3ff39da3edf
542026-11-04T00:39:06.093ZINFOcrucible-agent (datafile): region 9fc653d7-15f9-457c-9aec-f3ff39da3edf state: Tombstoned -> Destroyed
552026-11-04T00:39:06.134ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:42198 req_id = f0e5624b-1af7-469b-801b-d267b7a3cfd4 response_code = 200 uri = /crucible/0/regions/9fc653d7-15f9-457c-9aec-f3ff39da3edf