Max level shown:
12024-08-07T00:00:38.188ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:47509
22024-08-07T00:00:38.188ZINFOcrucible-agent (datafile): region 59747eef-17f2-46d1-897f-c035aa5c4e4c state: Requested
32024-08-07T00:00:38.189ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-08-07T00:00:38.189ZINFOcrucible-agent (dropshot): request completed latency_us = 665 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47509 req_id = 2046d748-a12e-4835-9166-b1bfeaf4e8a0 response_code = 200 uri = /crucible/0/regions
52024-08-07T00:00:38.199ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6ed47f84-c58d-4b53-8b62-95bcd7544747/crucible/regions/59747eef-17f2-46d1-897f-c035aa5c4e4c
62024-08-07T00:00:38.199ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6ed47f84-c58d-4b53-8b62-95bcd7544747/crucible/regions/59747eef-17f2-46d1-897f-c035aa5c4e4c
72024-08-07T00:00:38.265ZINFOcrucible-agent (worker): creating region Region { id: RegionId("59747eef-17f2-46d1-897f-c035aa5c4e4c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/59747eef-17f2-46d1-897f-c035aa5c4e4c" region = 59747eef-17f2-46d1-897f-c035aa5c4e4c
82024-08-07T00:00:38.265ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "59747eef-17f2-46d1-897f-c035aa5c4e4c" "--data" "/data/regions/59747eef-17f2-46d1-897f-c035aa5c4e4c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 59747eef-17f2-46d1-897f-c035aa5c4e4c
92024-08-07T00:00:38.413ZINFOcrucible-agent (dropshot): request completed latency_us = 102 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47509 req_id = f4f57d24-df1a-4a35-996c-e87339f18810 response_code = 200 uri = /crucible/0/regions
102024-08-07T00:00:38.463ZINFOcrucible-agent (worker): region files created ok region = 59747eef-17f2-46d1-897f-c035aa5c4e4c
112024-08-07T00:00:38.463ZINFOcrucible-agent (datafile): region 59747eef-17f2-46d1-897f-c035aa5c4e4c state: Requested -> Created
122024-08-07T00:00:38.463ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-08-07T00:00:38.470ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-59747eef-17f2-46d1-897f-c035aa5c4e4c
142024-08-07T00:00:38.482ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-59747eef-17f2-46d1-897f-c035aa5c4e4c
152024-08-07T00:00:38.506ZINFOcrucible-agent (worker): creating config property group
162024-08-07T00:00:38.515ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-59747eef-17f2-46d1-897f-c035aa5c4e4c
172024-08-07T00:00:38.515ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/59747eef-17f2-46d1-897f-c035aa5c4e4c
182024-08-07T00:00:38.515ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192024-08-07T00:00:38.515ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202024-08-07T00:00:38.515ZINFOcrucible-agent (worker): commit
212024-08-07T00:00:38.523ZINFOcrucible-agent (worker): ok!
222024-08-07T00:00:38.533ZINFOcrucible-agent (worker): SMF ok!
232024-08-07T00:00:38.811ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47509 req_id = 538fdd3d-af2d-41cb-9e9d-837cb4d0ac36 response_code = 200 uri = /crucible/0/regions
242024-08-07T00:00:40.828ZINFOcrucible-agent (dropshot): request completed latency_us = 100 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47509 req_id = 8210cc91-a6ba-492a-9a3b-b2cb24d81c95 response_code = 200 uri = /crucible/0/regions/07b8851f-caa3-422f-9754-870686698d2a
252024-08-07T00:00:40.833ZINFOcrucible-agent (datafile): path is "/data/regions/07b8851f-caa3-422f-9754-870686698d2a"
262024-08-07T00:00:40.842ZINFOcrucible-agent (datafile): dataset is oxp_6ed47f84-c58d-4b53-8b62-95bcd7544747/crucible/regions/07b8851f-caa3-422f-9754-870686698d2a
272024-08-07T00:00:40.851ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6ed47f84-c58d-4b53-8b62-95bcd7544747/crucible/regions/07b8851f-caa3-422f-9754-870686698d2a@bda4015e-8885-41a6-879d-055327634624
282024-08-07T00:00:40.851ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6ed47f84-c58d-4b53-8b62-95bcd7544747/crucible/regions/07b8851f-caa3-422f-9754-870686698d2a", "bda4015e-8885-41a6-879d-055327634624"]
292024-08-07T00:00:40.861ZINFOcrucible-agent (dropshot): request completed latency_us = 30661 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47509 req_id = 1d9ad0d2-cb51-4664-961d-6f4937dfbb0b response_code = 200 uri = /crucible/0/regions/07b8851f-caa3-422f-9754-870686698d2a/snapshots/bda4015e-8885-41a6-879d-055327634624
302024-08-07T00:00:40.864ZINFOcrucible-agent (datafile): path is "/data/regions/07b8851f-caa3-422f-9754-870686698d2a"
312024-08-07T00:00:40.872ZINFOcrucible-agent (datafile): dataset is oxp_6ed47f84-c58d-4b53-8b62-95bcd7544747/crucible/regions/07b8851f-caa3-422f-9754-870686698d2a
322024-08-07T00:00:40.881ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6ed47f84-c58d-4b53-8b62-95bcd7544747/crucible/regions/07b8851f-caa3-422f-9754-870686698d2a@bda4015e-8885-41a6-879d-055327634624
332024-08-07T00:00:40.881ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6ed47f84-c58d-4b53-8b62-95bcd7544747/crucible/regions/07b8851f-caa3-422f-9754-870686698d2a", "bda4015e-8885-41a6-879d-055327634624"]
342024-08-07T00:00:40.889ZINFOcrucible-agent (datafile): requesting running snapshot 07b8851f-caa3-422f-9754-870686698d2a-bda4015e-8885-41a6-879d-055327634624 state: Requested
352024-08-07T00:00:40.890ZINFOcrucible-agent (worker): applying SMF actions for region 07b8851f-caa3-422f-9754-870686698d2a running snapshot bda4015e-8885-41a6-879d-055327634624 (state Requested)...
362024-08-07T00:00:40.890ZINFOcrucible-agent (dropshot): request completed latency_us = 25544 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47509 req_id = c5d4ab89-4963-4175-9baf-82170adcc4ee response_code = 200 uri = /crucible/0/regions/07b8851f-caa3-422f-9754-870686698d2a/snapshots/bda4015e-8885-41a6-879d-055327634624/run
372024-08-07T00:00:40.892ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-07b8851f-caa3-422f-9754-870686698d2a-bda4015e-8885-41a6-879d-055327634624
382024-08-07T00:00:40.899ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-07b8851f-caa3-422f-9754-870686698d2a-bda4015e-8885-41a6-879d-055327634624
392024-08-07T00:00:40.921ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-07b8851f-caa3-422f-9754-870686698d2a-bda4015e-8885-41a6-879d-055327634624
402024-08-07T00:00:40.921ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/07b8851f-caa3-422f-9754-870686698d2a/.zfs/snapshot/bda4015e-8885-41a6-879d-055327634624
412024-08-07T00:00:40.921ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422024-08-07T00:00:40.921ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432024-08-07T00:00:40.921ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
442024-08-07T00:00:40.921ZINFOcrucible-agent (worker): commit
452024-08-07T00:00:40.928ZINFOcrucible-agent (worker): ok!
462024-08-07T00:00:40.937ZINFOcrucible-agent (worker): SMF ok!
472024-08-07T00:00:40.937ZINFOcrucible-agent (datafile): region 07b8851f-caa3-422f-9754-870686698d2a running snapshot bda4015e-8885-41a6-879d-055327634624 state: Requested -> Created
482024-08-07T00:00:41.177ZINFOcrucible-agent (datafile): path is "/data/regions/07b8851f-caa3-422f-9754-870686698d2a"
492024-08-07T00:00:41.186ZINFOcrucible-agent (datafile): dataset is oxp_6ed47f84-c58d-4b53-8b62-95bcd7544747/crucible/regions/07b8851f-caa3-422f-9754-870686698d2a
502024-08-07T00:00:41.193ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6ed47f84-c58d-4b53-8b62-95bcd7544747/crucible/regions/07b8851f-caa3-422f-9754-870686698d2a@bda4015e-8885-41a6-879d-055327634624
512024-08-07T00:00:41.193ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6ed47f84-c58d-4b53-8b62-95bcd7544747/crucible/regions/07b8851f-caa3-422f-9754-870686698d2a", "bda4015e-8885-41a6-879d-055327634624"]
522024-08-07T00:00:41.200ZINFOcrucible-agent (dropshot): request completed latency_us = 22846 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47509 req_id = 1c5ab616-417f-4c87-9e97-45a7e1a9454c response_code = 200 uri = /crucible/0/regions/07b8851f-caa3-422f-9754-870686698d2a/snapshots/bda4015e-8885-41a6-879d-055327634624/run