Max level shown:
12024-11-27T18:46:45.013ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:62339
22024-11-27T18:46:45.013ZINFOcrucible-agent (datafile): region caa1fdd6-1902-418e-8b06-1337cf570849 state: Requested
32024-11-27T18:46:45.014ZINFOcrucible-agent (dropshot): request completed latency_us = 641 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62339 req_id = 9a08ce20-716e-4151-8655-0d5774259bd5 response_code = 200 uri = /crucible/0/regions
42024-11-27T18:46:45.014ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52024-11-27T18:46:45.026ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f16fc47c-323a-43fa-b3f8-74cbe3a81dac/crucible/regions/caa1fdd6-1902-418e-8b06-1337cf570849
62024-11-27T18:46:45.026ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f16fc47c-323a-43fa-b3f8-74cbe3a81dac/crucible/regions/caa1fdd6-1902-418e-8b06-1337cf570849
72024-11-27T18:46:45.080ZINFOcrucible-agent (worker): creating region Region { id: RegionId("caa1fdd6-1902-418e-8b06-1337cf570849"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/caa1fdd6-1902-418e-8b06-1337cf570849" region = caa1fdd6-1902-418e-8b06-1337cf570849
82024-11-27T18:46:45.080ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "caa1fdd6-1902-418e-8b06-1337cf570849" "--data" "/data/regions/caa1fdd6-1902-418e-8b06-1337cf570849" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = caa1fdd6-1902-418e-8b06-1337cf570849
92024-11-27T18:46:45.161ZINFOcrucible-agent (worker): region files created ok region = caa1fdd6-1902-418e-8b06-1337cf570849
102024-11-27T18:46:45.161ZINFOcrucible-agent (datafile): region caa1fdd6-1902-418e-8b06-1337cf570849 state: Requested -> Created
112024-11-27T18:46:45.161ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-11-27T18:46:45.178ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-caa1fdd6-1902-418e-8b06-1337cf570849
132024-11-27T18:46:45.191ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-caa1fdd6-1902-418e-8b06-1337cf570849
142024-11-27T18:46:45.203ZINFOcrucible-agent (worker): creating config property group
152024-11-27T18:46:45.207ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-caa1fdd6-1902-418e-8b06-1337cf570849
162024-11-27T18:46:45.207ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/caa1fdd6-1902-418e-8b06-1337cf570849
172024-11-27T18:46:45.207ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-11-27T18:46:45.207ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
192024-11-27T18:46:45.207ZINFOcrucible-agent (worker): commit
202024-11-27T18:46:45.211ZINFOcrucible-agent (worker): ok!
212024-11-27T18:46:45.216ZINFOcrucible-agent (worker): SMF ok!
222024-11-27T18:46:45.359ZINFOcrucible-agent (dropshot): request completed latency_us = 94 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62339 req_id = d0e3300d-70d8-4a14-98db-40025f56f5dd response_code = 200 uri = /crucible/0/regions
232024-11-27T18:46:46.832ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:62339 req_id = e46777f5-3c04-4885-aa52-a30def4e5679 response_code = 200 uri = /crucible/0/regions/238a746f-800c-4d35-900c-97ef2dc41a9d
242024-11-27T18:46:46.836ZINFOcrucible-agent (datafile): path is "/data/regions/238a746f-800c-4d35-900c-97ef2dc41a9d"
252024-11-27T18:46:46.845ZINFOcrucible-agent (datafile): dataset is oxp_f16fc47c-323a-43fa-b3f8-74cbe3a81dac/crucible/regions/238a746f-800c-4d35-900c-97ef2dc41a9d
262024-11-27T18:46:46.853ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f16fc47c-323a-43fa-b3f8-74cbe3a81dac/crucible/regions/238a746f-800c-4d35-900c-97ef2dc41a9d@791db8d9-73be-40b8-8ffa-26ae4cedc83e
272024-11-27T18:46:46.853ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f16fc47c-323a-43fa-b3f8-74cbe3a81dac/crucible/regions/238a746f-800c-4d35-900c-97ef2dc41a9d", "791db8d9-73be-40b8-8ffa-26ae4cedc83e"]
282024-11-27T18:46:46.864ZINFOcrucible-agent (dropshot): request completed latency_us = 27660 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:62339 req_id = 966d380c-f762-46b9-b5ff-b68519522361 response_code = 200 uri = /crucible/0/regions/238a746f-800c-4d35-900c-97ef2dc41a9d/snapshots/791db8d9-73be-40b8-8ffa-26ae4cedc83e
292024-11-27T18:46:46.868ZINFOcrucible-agent (datafile): path is "/data/regions/238a746f-800c-4d35-900c-97ef2dc41a9d"
302024-11-27T18:46:46.875ZINFOcrucible-agent (datafile): dataset is oxp_f16fc47c-323a-43fa-b3f8-74cbe3a81dac/crucible/regions/238a746f-800c-4d35-900c-97ef2dc41a9d
312024-11-27T18:46:46.883ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f16fc47c-323a-43fa-b3f8-74cbe3a81dac/crucible/regions/238a746f-800c-4d35-900c-97ef2dc41a9d@791db8d9-73be-40b8-8ffa-26ae4cedc83e
322024-11-27T18:46:46.883ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f16fc47c-323a-43fa-b3f8-74cbe3a81dac/crucible/regions/238a746f-800c-4d35-900c-97ef2dc41a9d", "791db8d9-73be-40b8-8ffa-26ae4cedc83e"]
332024-11-27T18:46:46.892ZINFOcrucible-agent (datafile): requesting running snapshot 238a746f-800c-4d35-900c-97ef2dc41a9d-791db8d9-73be-40b8-8ffa-26ae4cedc83e state: Requested
342024-11-27T18:46:46.892ZINFOcrucible-agent (worker): applying SMF actions for region 238a746f-800c-4d35-900c-97ef2dc41a9d running snapshot 791db8d9-73be-40b8-8ffa-26ae4cedc83e (state Requested)...
352024-11-27T18:46:46.892ZINFOcrucible-agent (dropshot): request completed latency_us = 24891 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62339 req_id = dd6666bd-8c85-4a6b-84bf-ce2fa7300595 response_code = 200 uri = /crucible/0/regions/238a746f-800c-4d35-900c-97ef2dc41a9d/snapshots/791db8d9-73be-40b8-8ffa-26ae4cedc83e/run
362024-11-27T18:46:46.895ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-238a746f-800c-4d35-900c-97ef2dc41a9d-791db8d9-73be-40b8-8ffa-26ae4cedc83e
372024-11-27T18:46:46.898ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-238a746f-800c-4d35-900c-97ef2dc41a9d-791db8d9-73be-40b8-8ffa-26ae4cedc83e
382024-11-27T18:46:46.908ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-238a746f-800c-4d35-900c-97ef2dc41a9d-791db8d9-73be-40b8-8ffa-26ae4cedc83e
392024-11-27T18:46:46.908ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/238a746f-800c-4d35-900c-97ef2dc41a9d/.zfs/snapshot/791db8d9-73be-40b8-8ffa-26ae4cedc83e
402024-11-27T18:46:46.908ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412024-11-27T18:46:46.908ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422024-11-27T18:46:46.908ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
432024-11-27T18:46:46.908ZINFOcrucible-agent (worker): commit
442024-11-27T18:46:46.912ZINFOcrucible-agent (worker): ok!
452024-11-27T18:46:46.916ZINFOcrucible-agent (worker): SMF ok!
462024-11-27T18:46:46.917ZINFOcrucible-agent (datafile): region 238a746f-800c-4d35-900c-97ef2dc41a9d running snapshot 791db8d9-73be-40b8-8ffa-26ae4cedc83e state: Requested -> Created
472024-11-27T18:46:47.216ZINFOcrucible-agent (datafile): path is "/data/regions/238a746f-800c-4d35-900c-97ef2dc41a9d"
482024-11-27T18:46:47.225ZINFOcrucible-agent (datafile): dataset is oxp_f16fc47c-323a-43fa-b3f8-74cbe3a81dac/crucible/regions/238a746f-800c-4d35-900c-97ef2dc41a9d
492024-11-27T18:46:47.233ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f16fc47c-323a-43fa-b3f8-74cbe3a81dac/crucible/regions/238a746f-800c-4d35-900c-97ef2dc41a9d@791db8d9-73be-40b8-8ffa-26ae4cedc83e
502024-11-27T18:46:47.233ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f16fc47c-323a-43fa-b3f8-74cbe3a81dac/crucible/regions/238a746f-800c-4d35-900c-97ef2dc41a9d", "791db8d9-73be-40b8-8ffa-26ae4cedc83e"]
512024-11-27T18:46:47.241ZINFOcrucible-agent (dropshot): request completed latency_us = 25993 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62339 req_id = 5fabb999-4d20-4a4c-9a08-a3cdc9a0ff84 response_code = 200 uri = /crucible/0/regions/238a746f-800c-4d35-900c-97ef2dc41a9d/snapshots/791db8d9-73be-40b8-8ffa-26ae4cedc83e/run