Max level shown:
12026-10-29T21:50:15.809ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:43923
22026-10-29T21:50:15.855ZINFOcrucible-agent (datafile): region c22e62e1-dab3-4de3-b3ca-3135ce118934 state: Requested
32026-10-29T21:50:15.864ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-10-29T21:50:15.869ZINFOcrucible-agent (dropshot): request completed latency_us = 23876 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43923 req_id = 4d7a6cfe-4f84-4c9f-bc9c-b23931a755b2 response_code = 200 uri = /crucible/0/regions
52026-10-29T21:50:15.878ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_220e5020-8e0b-4da1-97f0-d60fa360d4c1/crucible/regions/c22e62e1-dab3-4de3-b3ca-3135ce118934
62026-10-29T21:50:15.878ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_220e5020-8e0b-4da1-97f0-d60fa360d4c1/crucible/regions/c22e62e1-dab3-4de3-b3ca-3135ce118934
72026-10-29T21:50:15.927ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c22e62e1-dab3-4de3-b3ca-3135ce118934"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c22e62e1-dab3-4de3-b3ca-3135ce118934" region = c22e62e1-dab3-4de3-b3ca-3135ce118934
82026-10-29T21:50:15.927ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c22e62e1-dab3-4de3-b3ca-3135ce118934" "--data" "/data/regions/c22e62e1-dab3-4de3-b3ca-3135ce118934" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c22e62e1-dab3-4de3-b3ca-3135ce118934
92026-10-29T21:50:16.136ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43923 req_id = 057f5a84-2b20-4ffa-9992-2b20b9ac3103 response_code = 200 uri = /crucible/0/regions
102026-10-29T21:50:16.284ZINFOcrucible-agent (worker): region files created ok region = c22e62e1-dab3-4de3-b3ca-3135ce118934
112026-10-29T21:50:16.286ZINFOcrucible-agent (datafile): region c22e62e1-dab3-4de3-b3ca-3135ce118934 state: Requested -> Created
122026-10-29T21:50:16.286ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-10-29T21:50:16.287ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c22e62e1-dab3-4de3-b3ca-3135ce118934
142026-10-29T21:50:16.310ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c22e62e1-dab3-4de3-b3ca-3135ce118934
152026-10-29T21:50:16.331ZINFOcrucible-agent (worker): creating config property group
162026-10-29T21:50:16.333ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c22e62e1-dab3-4de3-b3ca-3135ce118934
172026-10-29T21:50:16.333ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c22e62e1-dab3-4de3-b3ca-3135ce118934
182026-10-29T21:50:16.333ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-10-29T21:50:16.333ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202026-10-29T21:50:16.334ZINFOcrucible-agent (worker): commit
212026-10-29T21:50:16.336ZINFOcrucible-agent (worker): ok!
222026-10-29T21:50:16.338ZINFOcrucible-agent (worker): SMF ok!
232026-10-29T21:50:16.641ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43923 req_id = b557c556-a884-4a5a-a4e5-f057ffbcd62c response_code = 200 uri = /crucible/0/regions
242026-10-29T21:50:22.751ZINFOcrucible-agent (datafile): region d0da25c3-c276-4c02-9264-bc489f000aae state: Requested
252026-10-29T21:50:22.751ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-10-29T21:50:22.751ZINFOcrucible-agent (dropshot): request completed latency_us = 275 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43923 req_id = 5e1d3926-fb57-48aa-addc-c9f9f08c1322 response_code = 200 uri = /crucible/0/regions
272026-10-29T21:50:22.757ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_220e5020-8e0b-4da1-97f0-d60fa360d4c1/crucible/regions/d0da25c3-c276-4c02-9264-bc489f000aae
282026-10-29T21:50:22.757ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_220e5020-8e0b-4da1-97f0-d60fa360d4c1/crucible/regions/d0da25c3-c276-4c02-9264-bc489f000aae
292026-10-29T21:50:22.811ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d0da25c3-c276-4c02-9264-bc489f000aae"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d0da25c3-c276-4c02-9264-bc489f000aae" region = d0da25c3-c276-4c02-9264-bc489f000aae
302026-10-29T21:50:22.811ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d0da25c3-c276-4c02-9264-bc489f000aae" "--data" "/data/regions/d0da25c3-c276-4c02-9264-bc489f000aae" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d0da25c3-c276-4c02-9264-bc489f000aae
312026-10-29T21:50:22.861ZINFOcrucible-agent (worker): region files created ok region = d0da25c3-c276-4c02-9264-bc489f000aae
322026-10-29T21:50:22.861ZINFOcrucible-agent (datafile): region d0da25c3-c276-4c02-9264-bc489f000aae state: Requested -> Created
332026-10-29T21:50:22.861ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-10-29T21:50:22.862ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d0da25c3-c276-4c02-9264-bc489f000aae
352026-10-29T21:50:22.864ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d0da25c3-c276-4c02-9264-bc489f000aae
362026-10-29T21:50:22.867ZINFOcrucible-agent (worker): creating config property group
372026-10-29T21:50:22.869ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d0da25c3-c276-4c02-9264-bc489f000aae
382026-10-29T21:50:22.869ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d0da25c3-c276-4c02-9264-bc489f000aae
392026-10-29T21:50:22.869ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-10-29T21:50:22.869ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
412026-10-29T21:50:22.869ZINFOcrucible-agent (worker): commit
422026-10-29T21:50:22.871ZINFOcrucible-agent (worker): ok!
432026-10-29T21:50:22.874ZINFOcrucible-agent (worker): SMF ok!
442026-10-29T21:50:23.034ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43923 req_id = cda21c60-00f7-438d-8181-ca00a031c98c response_code = 200 uri = /crucible/0/regions
452026-10-29T21:50:47.137ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43923 req_id = fe47c320-0efe-41b6-be51-0274108564bf response_code = 200 uri = /crucible/0/regions/d0da25c3-c276-4c02-9264-bc489f000aae
462026-10-29T21:50:47.140ZINFOcrucible-agent (datafile): path is "/data/regions/d0da25c3-c276-4c02-9264-bc489f000aae"
472026-10-29T21:50:47.148ZINFOcrucible-agent (datafile): dataset is oxp_220e5020-8e0b-4da1-97f0-d60fa360d4c1/crucible/regions/d0da25c3-c276-4c02-9264-bc489f000aae
482026-10-29T21:50:47.155ZINFOcrucible-agent (datafile): region d0da25c3-c276-4c02-9264-bc489f000aae state: Created -> Tombstoned
492026-10-29T21:50:47.156ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-10-29T21:50:47.156ZINFOcrucible-agent (dropshot): request completed latency_us = 15629 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:43923 req_id = 6ff27eaf-2d77-4cba-a80e-7fad5878ef31 response_code = 204 uri = /crucible/0/regions/d0da25c3-c276-4c02-9264-bc489f000aae
512026-10-29T21:50:47.157ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-d0da25c3-c276-4c02-9264-bc489f000aae (instance states: (Some(Online), None))
522026-10-29T21:50:47.159ZINFOcrucible-agent (dropshot): request completed latency_us = 35 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43923 req_id = 1a458a98-dc8b-4412-87b0-f854beddda44 response_code = 200 uri = /crucible/0/regions/d0da25c3-c276-4c02-9264-bc489f000aae
532026-10-29T21:50:47.160ZINFOcrucible-agent (worker): SMF ok!
542026-10-29T21:50:47.168ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_220e5020-8e0b-4da1-97f0-d60fa360d4c1/crucible/regions/d0da25c3-c276-4c02-9264-bc489f000aae" region = d0da25c3-c276-4c02-9264-bc489f000aae
552026-10-29T21:50:47.217ZINFOcrucible-agent (datafile): region d0da25c3-c276-4c02-9264-bc489f000aae state: Tombstoned -> Destroyed
562026-10-29T21:50:47.246ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43923 req_id = db7be9e7-adb5-4640-af3f-32e9fe828d09 response_code = 200 uri = /crucible/0/regions/d0da25c3-c276-4c02-9264-bc489f000aae