Max level shown:
12024-12-19T19:33:28.082ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:45559
22024-12-19T19:33:28.131ZINFOcrucible-agent (datafile): region b958be82-9249-4ec7-b6cc-67ea68f2b3c2 state: Requested
32024-12-19T19:33:28.135ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-12-19T19:33:28.140ZINFOcrucible-agent (dropshot): request completed latency_us = 16544 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45559 req_id = ca6248f7-6f06-40ce-a526-3083715da520 response_code = 200 uri = /crucible/0/regions
52024-12-19T19:33:28.148ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_962b1ef1-fd21-4baa-a28a-e5c292e48320/crucible/regions/b958be82-9249-4ec7-b6cc-67ea68f2b3c2
62024-12-19T19:33:28.148ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_962b1ef1-fd21-4baa-a28a-e5c292e48320/crucible/regions/b958be82-9249-4ec7-b6cc-67ea68f2b3c2
72024-12-19T19:33:28.223ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b958be82-9249-4ec7-b6cc-67ea68f2b3c2"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b958be82-9249-4ec7-b6cc-67ea68f2b3c2" region = b958be82-9249-4ec7-b6cc-67ea68f2b3c2
82024-12-19T19:33:28.225ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b958be82-9249-4ec7-b6cc-67ea68f2b3c2" "--data" "/data/regions/b958be82-9249-4ec7-b6cc-67ea68f2b3c2" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b958be82-9249-4ec7-b6cc-67ea68f2b3c2
92024-12-19T19:33:28.300ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45559 req_id = a38ef696-63ab-45f7-bd2a-162039d22c93 response_code = 200 uri = /crucible/0/regions
102024-12-19T19:33:28.608ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45559 req_id = 57164bb5-7d37-414d-99fa-de858fffd226 response_code = 200 uri = /crucible/0/regions
112024-12-19T19:33:28.611ZINFOcrucible-agent (worker): region files created ok region = b958be82-9249-4ec7-b6cc-67ea68f2b3c2
122024-12-19T19:33:28.611ZINFOcrucible-agent (datafile): region b958be82-9249-4ec7-b6cc-67ea68f2b3c2 state: Requested -> Created
132024-12-19T19:33:28.611ZINFOcrucible-agent (worker): applying SMF actions post create...
142024-12-19T19:33:28.611ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b958be82-9249-4ec7-b6cc-67ea68f2b3c2
152024-12-19T19:33:28.625ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b958be82-9249-4ec7-b6cc-67ea68f2b3c2
162024-12-19T19:33:28.657ZINFOcrucible-agent (worker): creating config property group
172024-12-19T19:33:28.663ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b958be82-9249-4ec7-b6cc-67ea68f2b3c2
182024-12-19T19:33:28.664ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b958be82-9249-4ec7-b6cc-67ea68f2b3c2
192024-12-19T19:33:28.664ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
202024-12-19T19:33:28.664ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
212024-12-19T19:33:28.664ZINFOcrucible-agent (worker): commit
222024-12-19T19:33:28.673ZINFOcrucible-agent (worker): ok!
232024-12-19T19:33:28.680ZINFOcrucible-agent (worker): SMF ok!
242024-12-19T19:33:29.254ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45559 req_id = 19cc333a-539d-487b-bfc4-d0ce42a402f6 response_code = 200 uri = /crucible/0/regions
252024-12-19T19:33:34.246ZINFOcrucible-agent (datafile): region 9562ec30-2851-42c9-9bb9-ffcf510231b8 state: Requested
262024-12-19T19:33:34.246ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272024-12-19T19:33:34.246ZINFOcrucible-agent (dropshot): request completed latency_us = 218 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45559 req_id = 5655f7a8-cd75-49c4-8e25-a3804215654e response_code = 200 uri = /crucible/0/regions
282024-12-19T19:33:34.256ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_962b1ef1-fd21-4baa-a28a-e5c292e48320/crucible/regions/9562ec30-2851-42c9-9bb9-ffcf510231b8
292024-12-19T19:33:34.256ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_962b1ef1-fd21-4baa-a28a-e5c292e48320/crucible/regions/9562ec30-2851-42c9-9bb9-ffcf510231b8
302024-12-19T19:33:34.325ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9562ec30-2851-42c9-9bb9-ffcf510231b8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9562ec30-2851-42c9-9bb9-ffcf510231b8" region = 9562ec30-2851-42c9-9bb9-ffcf510231b8
312024-12-19T19:33:34.325ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9562ec30-2851-42c9-9bb9-ffcf510231b8" "--data" "/data/regions/9562ec30-2851-42c9-9bb9-ffcf510231b8" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 9562ec30-2851-42c9-9bb9-ffcf510231b8
322024-12-19T19:33:34.384ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45559 req_id = 9cff53d8-efc9-4565-b776-b8ca3c654a34 response_code = 200 uri = /crucible/0/regions
332024-12-19T19:33:34.402ZINFOcrucible-agent (worker): region files created ok region = 9562ec30-2851-42c9-9bb9-ffcf510231b8
342024-12-19T19:33:34.402ZINFOcrucible-agent (datafile): region 9562ec30-2851-42c9-9bb9-ffcf510231b8 state: Requested -> Created
352024-12-19T19:33:34.402ZINFOcrucible-agent (worker): applying SMF actions post create...
362024-12-19T19:33:34.402ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9562ec30-2851-42c9-9bb9-ffcf510231b8
372024-12-19T19:33:34.406ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9562ec30-2851-42c9-9bb9-ffcf510231b8
382024-12-19T19:33:34.418ZINFOcrucible-agent (worker): creating config property group
392024-12-19T19:33:34.422ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9562ec30-2851-42c9-9bb9-ffcf510231b8
402024-12-19T19:33:34.422ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9562ec30-2851-42c9-9bb9-ffcf510231b8
412024-12-19T19:33:34.422ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
422024-12-19T19:33:34.422ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
432024-12-19T19:33:34.422ZINFOcrucible-agent (worker): commit
442024-12-19T19:33:34.426ZINFOcrucible-agent (worker): ok!
452024-12-19T19:33:34.435ZINFOcrucible-agent (worker): SMF ok!
462024-12-19T19:33:35.079ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45559 req_id = 64da4e42-bccc-499d-b52f-14120d24278b response_code = 200 uri = /crucible/0/regions
472024-12-19T19:33:59.204ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45559 req_id = 9fe83e71-ecf5-49e8-87e9-d4fcd50e24ea response_code = 200 uri = /crucible/0/regions/9562ec30-2851-42c9-9bb9-ffcf510231b8
482024-12-19T19:33:59.208ZINFOcrucible-agent (datafile): path is "/data/regions/9562ec30-2851-42c9-9bb9-ffcf510231b8"
492024-12-19T19:33:59.218ZINFOcrucible-agent (datafile): dataset is oxp_962b1ef1-fd21-4baa-a28a-e5c292e48320/crucible/regions/9562ec30-2851-42c9-9bb9-ffcf510231b8
502024-12-19T19:33:59.227ZINFOcrucible-agent (datafile): region 9562ec30-2851-42c9-9bb9-ffcf510231b8 state: Created -> Tombstoned
512024-12-19T19:33:59.227ZINFOcrucible-agent (worker): applying SMF actions before removal...
522024-12-19T19:33:59.227ZINFOcrucible-agent (dropshot): request completed latency_us = 19948 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:45559 req_id = dd6ccdf9-5382-47f3-9c5d-94b52e0b9a81 response_code = 204 uri = /crucible/0/regions/9562ec30-2851-42c9-9bb9-ffcf510231b8
532024-12-19T19:33:59.229ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-9562ec30-2851-42c9-9bb9-ffcf510231b8 (instance states: (Some(Online), None))
542024-12-19T19:33:59.232ZINFOcrucible-agent (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45559 req_id = 1c43fb2e-f392-47c5-98de-13653f695ba7 response_code = 200 uri = /crucible/0/regions/9562ec30-2851-42c9-9bb9-ffcf510231b8
552024-12-19T19:33:59.234ZINFOcrucible-agent (worker): SMF ok!
562024-12-19T19:33:59.245ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_962b1ef1-fd21-4baa-a28a-e5c292e48320/crucible/regions/9562ec30-2851-42c9-9bb9-ffcf510231b8" region = 9562ec30-2851-42c9-9bb9-ffcf510231b8
572024-12-19T19:33:59.293ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45559 req_id = e6833a44-4252-4b91-95bf-84dfa565f1a9 response_code = 200 uri = /crucible/0/regions/9562ec30-2851-42c9-9bb9-ffcf510231b8
582024-12-19T19:33:59.322ZINFOcrucible-agent (datafile): region 9562ec30-2851-42c9-9bb9-ffcf510231b8 state: Tombstoned -> Destroyed
592024-12-19T19:33:59.363ZINFOcrucible-agent (dropshot): request completed latency_us = 39 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45559 req_id = 59e44f16-1e3d-4f2a-aec1-7dc10cb8613c response_code = 200 uri = /crucible/0/regions/9562ec30-2851-42c9-9bb9-ffcf510231b8