Max level shown:
12026-08-22T13:04:02.820ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:41141
22026-08-22T13:04:02.820ZINFOcrucible-agent (datafile): region 284812ff-40b3-4c07-af0d-03e1876d69ca state: Requested
32026-08-22T13:04:02.821ZINFOcrucible-agent (dropshot): request completed latency_us = 811 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41141 req_id = 34229f30-85e2-43b7-b77b-7f973cd02989 response_code = 200 uri = /crucible/0/regions
42026-08-22T13:04:02.821ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-08-22T13:04:02.831ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_69cd74da-6418-4bd4-a3ed-c03794c7cff2/crucible/regions/284812ff-40b3-4c07-af0d-03e1876d69ca
62026-08-22T13:04:02.831ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_69cd74da-6418-4bd4-a3ed-c03794c7cff2/crucible/regions/284812ff-40b3-4c07-af0d-03e1876d69ca
72026-08-22T13:04:02.925ZINFOcrucible-agent (worker): creating region Region { id: RegionId("284812ff-40b3-4c07-af0d-03e1876d69ca"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/284812ff-40b3-4c07-af0d-03e1876d69ca" region = 284812ff-40b3-4c07-af0d-03e1876d69ca
82026-08-22T13:04:02.925ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "284812ff-40b3-4c07-af0d-03e1876d69ca" "--data" "/data/regions/284812ff-40b3-4c07-af0d-03e1876d69ca" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 284812ff-40b3-4c07-af0d-03e1876d69ca
92026-08-22T13:04:03.005ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41141 req_id = 697482f5-79f0-485b-ab6e-70b5564c8c7b response_code = 200 uri = /crucible/0/regions
102026-08-22T13:04:03.106ZINFOcrucible-agent (worker): region files created ok region = 284812ff-40b3-4c07-af0d-03e1876d69ca
112026-08-22T13:04:03.106ZINFOcrucible-agent (datafile): region 284812ff-40b3-4c07-af0d-03e1876d69ca state: Requested -> Created
122026-08-22T13:04:03.106ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-08-22T13:04:03.107ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-284812ff-40b3-4c07-af0d-03e1876d69ca
142026-08-22T13:04:03.117ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-284812ff-40b3-4c07-af0d-03e1876d69ca
152026-08-22T13:04:03.162ZINFOcrucible-agent (worker): creating config property group
162026-08-22T13:04:03.174ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-284812ff-40b3-4c07-af0d-03e1876d69ca
172026-08-22T13:04:03.175ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/284812ff-40b3-4c07-af0d-03e1876d69ca
182026-08-22T13:04:03.175ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-08-22T13:04:03.175ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202026-08-22T13:04:03.175ZINFOcrucible-agent (worker): commit
212026-08-22T13:04:03.195ZINFOcrucible-agent (worker): ok!
222026-08-22T13:04:03.210ZINFOcrucible-agent (worker): SMF ok!
232026-08-22T13:04:03.600ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41141 req_id = f057c241-6c1e-4c11-a619-c25eb696cb2e response_code = 200 uri = /crucible/0/regions
242026-08-22T13:04:11.103ZINFOcrucible-agent (datafile): region 141b4943-5c86-4444-95f1-3ddcb5611193 state: Requested
252026-08-22T13:04:11.103ZINFOcrucible-agent (dropshot): request completed latency_us = 186 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41141 req_id = bcee1aa0-8800-4720-8072-950e1dc93376 response_code = 200 uri = /crucible/0/regions
262026-08-22T13:04:11.103ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-08-22T13:04:11.110ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_69cd74da-6418-4bd4-a3ed-c03794c7cff2/crucible/regions/141b4943-5c86-4444-95f1-3ddcb5611193
282026-08-22T13:04:11.110ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_69cd74da-6418-4bd4-a3ed-c03794c7cff2/crucible/regions/141b4943-5c86-4444-95f1-3ddcb5611193
292026-08-22T13:04:11.188ZINFOcrucible-agent (worker): creating region Region { id: RegionId("141b4943-5c86-4444-95f1-3ddcb5611193"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/141b4943-5c86-4444-95f1-3ddcb5611193" region = 141b4943-5c86-4444-95f1-3ddcb5611193
302026-08-22T13:04:11.188ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "141b4943-5c86-4444-95f1-3ddcb5611193" "--data" "/data/regions/141b4943-5c86-4444-95f1-3ddcb5611193" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 141b4943-5c86-4444-95f1-3ddcb5611193
312026-08-22T13:04:11.356ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41141 req_id = c43898dc-8d28-40ea-b87d-e38e8022440e response_code = 200 uri = /crucible/0/regions
322026-08-22T13:04:11.399ZINFOcrucible-agent (worker): region files created ok region = 141b4943-5c86-4444-95f1-3ddcb5611193
332026-08-22T13:04:11.399ZINFOcrucible-agent (datafile): region 141b4943-5c86-4444-95f1-3ddcb5611193 state: Requested -> Created
342026-08-22T13:04:11.400ZINFOcrucible-agent (worker): applying SMF actions post create...
352026-08-22T13:04:11.401ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-141b4943-5c86-4444-95f1-3ddcb5611193
362026-08-22T13:04:11.432ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::b]:37083
372026-08-22T13:04:11.432ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:37083 req_id = 2ad319ac-9665-4e65-8db2-2aa010178e69 response_code = 200 uri = /crucible/0/regions/141b4943-5c86-4444-95f1-3ddcb5611193
382026-08-22T13:04:11.433ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-141b4943-5c86-4444-95f1-3ddcb5611193
392026-08-22T13:04:11.478ZINFOcrucible-agent (worker): creating config property group
402026-08-22T13:04:11.494ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:35263
412026-08-22T13:04:11.494ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35263 req_id = fe6fef4e-4ea0-4b15-b871-bc598918d87b response_code = 200 uri = /crucible/0/regions/141b4943-5c86-4444-95f1-3ddcb5611193
422026-08-22T13:04:11.501ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-141b4943-5c86-4444-95f1-3ddcb5611193
432026-08-22T13:04:11.502ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/141b4943-5c86-4444-95f1-3ddcb5611193
442026-08-22T13:04:11.502ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
452026-08-22T13:04:11.502ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
462026-08-22T13:04:11.502ZINFOcrucible-agent (worker): commit
472026-08-22T13:04:11.517ZINFOcrucible-agent (worker): ok!
482026-08-22T13:04:11.538ZINFOcrucible-agent (worker): SMF ok!
492026-08-22T13:04:11.859ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41141 req_id = 2424cdbb-c4b4-4bde-b729-4793f0cf03c0 response_code = 200 uri = /crucible/0/regions
502026-08-22T13:04:50.504ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:36252
512026-08-22T13:04:50.504ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:36252 req_id = 9941eb42-3729-4822-9744-68426b710145 response_code = 200 uri = /crucible/0/regions/141b4943-5c86-4444-95f1-3ddcb5611193
522026-08-22T13:04:50.507ZINFOcrucible-agent (datafile): path is "/data/regions/141b4943-5c86-4444-95f1-3ddcb5611193"
532026-08-22T13:04:50.530ZINFOcrucible-agent (datafile): dataset is oxp_69cd74da-6418-4bd4-a3ed-c03794c7cff2/crucible/regions/141b4943-5c86-4444-95f1-3ddcb5611193
542026-08-22T13:04:50.535ZINFOcrucible-agent (datafile): region 141b4943-5c86-4444-95f1-3ddcb5611193 state: Created -> Tombstoned
552026-08-22T13:04:50.535ZINFOcrucible-agent (worker): applying SMF actions before removal...
562026-08-22T13:04:50.535ZINFOcrucible-agent (dropshot): request completed latency_us = 28749 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:36252 req_id = b159d258-efcf-4deb-8ab4-14b0eb931c6c response_code = 204 uri = /crucible/0/regions/141b4943-5c86-4444-95f1-3ddcb5611193
572026-08-22T13:04:50.536ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-141b4943-5c86-4444-95f1-3ddcb5611193 (instance states: (Some(Online), None))
582026-08-22T13:04:50.538ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:36252 req_id = c2b3fbd1-afac-472f-bbd3-2354df2c73d7 response_code = 200 uri = /crucible/0/regions/141b4943-5c86-4444-95f1-3ddcb5611193
592026-08-22T13:04:50.564ZINFOcrucible-agent (worker): SMF ok!
602026-08-22T13:04:50.571ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_69cd74da-6418-4bd4-a3ed-c03794c7cff2/crucible/regions/141b4943-5c86-4444-95f1-3ddcb5611193" region = 141b4943-5c86-4444-95f1-3ddcb5611193
612026-08-22T13:04:50.605ZINFOcrucible-agent (dropshot): request completed latency_us = 113 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:36252 req_id = 056f00c3-1625-4d9b-9f9d-e971e61f8be2 response_code = 200 uri = /crucible/0/regions/141b4943-5c86-4444-95f1-3ddcb5611193
622026-08-22T13:04:50.729ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:36252 req_id = 12e30ac7-5672-4d4f-b3fe-e622f7daeaad response_code = 200 uri = /crucible/0/regions/141b4943-5c86-4444-95f1-3ddcb5611193
632026-08-22T13:04:50.756ZINFOcrucible-agent (datafile): region 141b4943-5c86-4444-95f1-3ddcb5611193 state: Tombstoned -> Destroyed
642026-08-22T13:04:50.811ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:36252 req_id = 856f7676-a46e-426b-aa3c-8480fdcf80a2 response_code = 200 uri = /crucible/0/regions/141b4943-5c86-4444-95f1-3ddcb5611193