Max level shown:
12025-11-21T18:19:56.675ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::c]:37361
22025-11-21T18:19:56.729ZINFOcrucible-agent (datafile): region d5e35b46-de93-42f2-999a-4ebdd647481f state: Requested
32025-11-21T18:19:56.733ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-11-21T18:19:56.733ZINFOcrucible-agent (dropshot): request completed latency_us = 22205 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37361 req_id = f0bc922d-ab0e-4597-ba40-d2dccde06ad2 response_code = 200 uri = /crucible/0/regions
52025-11-21T18:19:56.749ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c2ee07b8-6dc2-4030-aef6-370d0ab0c0d6/crucible/regions/d5e35b46-de93-42f2-999a-4ebdd647481f
62025-11-21T18:19:56.749ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c2ee07b8-6dc2-4030-aef6-370d0ab0c0d6/crucible/regions/d5e35b46-de93-42f2-999a-4ebdd647481f
72025-11-21T18:19:56.841ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d5e35b46-de93-42f2-999a-4ebdd647481f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d5e35b46-de93-42f2-999a-4ebdd647481f" region = d5e35b46-de93-42f2-999a-4ebdd647481f
82025-11-21T18:19:56.844ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d5e35b46-de93-42f2-999a-4ebdd647481f" "--data" "/data/regions/d5e35b46-de93-42f2-999a-4ebdd647481f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d5e35b46-de93-42f2-999a-4ebdd647481f
92025-11-21T18:19:56.900ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37361 req_id = dcb038e9-b51b-4e6a-9976-1253c9156057 response_code = 200 uri = /crucible/0/regions
102025-11-21T18:19:57.294ZINFOcrucible-agent (worker): region files created ok region = d5e35b46-de93-42f2-999a-4ebdd647481f
112025-11-21T18:19:57.294ZINFOcrucible-agent (datafile): region d5e35b46-de93-42f2-999a-4ebdd647481f state: Requested -> Created
122025-11-21T18:19:57.294ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-11-21T18:19:57.295ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d5e35b46-de93-42f2-999a-4ebdd647481f
142025-11-21T18:19:57.309ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d5e35b46-de93-42f2-999a-4ebdd647481f
152025-11-21T18:19:57.336ZINFOcrucible-agent (worker): creating config property group
162025-11-21T18:19:57.340ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d5e35b46-de93-42f2-999a-4ebdd647481f
172025-11-21T18:19:57.340ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d5e35b46-de93-42f2-999a-4ebdd647481f
182025-11-21T18:19:57.340ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-11-21T18:19:57.341ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
202025-11-21T18:19:57.341ZINFOcrucible-agent (worker): commit
212025-11-21T18:19:57.350ZINFOcrucible-agent (worker): ok!
222025-11-21T18:19:57.357ZINFOcrucible-agent (worker): SMF ok!
232025-11-21T18:19:57.653ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37361 req_id = 07a86aba-abcd-4211-87ff-0dec8426cfd1 response_code = 200 uri = /crucible/0/regions
242025-11-21T18:20:04.312ZINFOcrucible-agent (datafile): region 80d342c2-ec62-4097-9e26-1d2facfdab53 state: Requested
252025-11-21T18:20:04.312ZINFOcrucible-agent (dropshot): request completed latency_us = 250 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37361 req_id = 8cbedbc3-11af-4735-8336-e5bda34504a3 response_code = 200 uri = /crucible/0/regions
262025-11-21T18:20:04.312ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272025-11-21T18:20:04.319ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c2ee07b8-6dc2-4030-aef6-370d0ab0c0d6/crucible/regions/80d342c2-ec62-4097-9e26-1d2facfdab53
282025-11-21T18:20:04.319ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c2ee07b8-6dc2-4030-aef6-370d0ab0c0d6/crucible/regions/80d342c2-ec62-4097-9e26-1d2facfdab53
292025-11-21T18:20:04.369ZINFOcrucible-agent (worker): creating region Region { id: RegionId("80d342c2-ec62-4097-9e26-1d2facfdab53"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/80d342c2-ec62-4097-9e26-1d2facfdab53" region = 80d342c2-ec62-4097-9e26-1d2facfdab53
302025-11-21T18:20:04.369ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "80d342c2-ec62-4097-9e26-1d2facfdab53" "--data" "/data/regions/80d342c2-ec62-4097-9e26-1d2facfdab53" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 80d342c2-ec62-4097-9e26-1d2facfdab53
312025-11-21T18:20:04.449ZINFOcrucible-agent (worker): region files created ok region = 80d342c2-ec62-4097-9e26-1d2facfdab53
322025-11-21T18:20:04.449ZINFOcrucible-agent (datafile): region 80d342c2-ec62-4097-9e26-1d2facfdab53 state: Requested -> Created
332025-11-21T18:20:04.449ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-11-21T18:20:04.449ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-80d342c2-ec62-4097-9e26-1d2facfdab53
352025-11-21T18:20:04.452ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-80d342c2-ec62-4097-9e26-1d2facfdab53
362025-11-21T18:20:04.460ZINFOcrucible-agent (worker): creating config property group
372025-11-21T18:20:04.463ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-80d342c2-ec62-4097-9e26-1d2facfdab53
382025-11-21T18:20:04.463ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/80d342c2-ec62-4097-9e26-1d2facfdab53
392025-11-21T18:20:04.463ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-11-21T18:20:04.463ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
412025-11-21T18:20:04.463ZINFOcrucible-agent (worker): commit
422025-11-21T18:20:04.467ZINFOcrucible-agent (worker): ok!
432025-11-21T18:20:04.477ZINFOcrucible-agent (worker): SMF ok!
442025-11-21T18:20:04.594ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37361 req_id = 2246e6e6-1548-412b-a9ba-7c4b576317fd response_code = 200 uri = /crucible/0/regions
452025-11-21T18:20:31.827ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:37361 req_id = 43a90139-669e-43b5-b897-b2349c922e6e response_code = 200 uri = /crucible/0/regions/80d342c2-ec62-4097-9e26-1d2facfdab53
462025-11-21T18:20:31.831ZINFOcrucible-agent (datafile): path is "/data/regions/80d342c2-ec62-4097-9e26-1d2facfdab53"
472025-11-21T18:20:31.843ZINFOcrucible-agent (datafile): dataset is oxp_c2ee07b8-6dc2-4030-aef6-370d0ab0c0d6/crucible/regions/80d342c2-ec62-4097-9e26-1d2facfdab53
482025-11-21T18:20:31.850ZINFOcrucible-agent (datafile): region 80d342c2-ec62-4097-9e26-1d2facfdab53 state: Created -> Tombstoned
492025-11-21T18:20:31.850ZINFOcrucible-agent (dropshot): request completed latency_us = 19703 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:37361 req_id = 94a5f5b4-bd45-4c09-9d2e-ff1876b2cee9 response_code = 204 uri = /crucible/0/regions/80d342c2-ec62-4097-9e26-1d2facfdab53
502025-11-21T18:20:31.850ZINFOcrucible-agent (worker): applying SMF actions before removal...
512025-11-21T18:20:31.851ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-80d342c2-ec62-4097-9e26-1d2facfdab53 (instance states: (Some(Online), None))
522025-11-21T18:20:31.855ZINFOcrucible-agent (dropshot): request completed latency_us = 37 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:37361 req_id = 17e7cb4f-97dc-4aba-b757-dbf99ef9eaf4 response_code = 200 uri = /crucible/0/regions/80d342c2-ec62-4097-9e26-1d2facfdab53
532025-11-21T18:20:31.861ZINFOcrucible-agent (worker): SMF ok!
542025-11-21T18:20:31.869ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_c2ee07b8-6dc2-4030-aef6-370d0ab0c0d6/crucible/regions/80d342c2-ec62-4097-9e26-1d2facfdab53" region = 80d342c2-ec62-4097-9e26-1d2facfdab53
552025-11-21T18:20:31.932ZINFOcrucible-agent (datafile): region 80d342c2-ec62-4097-9e26-1d2facfdab53 state: Tombstoned -> Destroyed
562025-11-21T18:20:32.001ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:37361 req_id = 4b7a913b-2579-4f42-b15c-f8a3b5088cd9 response_code = 200 uri = /crucible/0/regions/80d342c2-ec62-4097-9e26-1d2facfdab53