Max level shown:
12025-12-20T00:36:15.415ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::c]:49077
22025-12-20T00:36:15.415ZINFOcrucible-agent (datafile): region f804a1fe-ab01-4e5b-9be0-057fbcc6c70d state: Requested
32025-12-20T00:36:15.416ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-12-20T00:36:15.416ZINFOcrucible-agent (dropshot): request completed latency_us = 641 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:49077 req_id = f7ad8bee-5d52-4d54-88e0-123dc026994d response_code = 200 uri = /crucible/0/regions
52025-12-20T00:36:15.425ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_a01f1533-1407-4cfb-9e88-c51537ae6b75/crucible/regions/f804a1fe-ab01-4e5b-9be0-057fbcc6c70d
62025-12-20T00:36:15.425ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_a01f1533-1407-4cfb-9e88-c51537ae6b75/crucible/regions/f804a1fe-ab01-4e5b-9be0-057fbcc6c70d
72025-12-20T00:36:15.471ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f804a1fe-ab01-4e5b-9be0-057fbcc6c70d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/f804a1fe-ab01-4e5b-9be0-057fbcc6c70d" region = f804a1fe-ab01-4e5b-9be0-057fbcc6c70d
82025-12-20T00:36:15.471ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "f804a1fe-ab01-4e5b-9be0-057fbcc6c70d" "--data" "/data/regions/f804a1fe-ab01-4e5b-9be0-057fbcc6c70d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = f804a1fe-ab01-4e5b-9be0-057fbcc6c70d
92025-12-20T00:36:15.572ZINFOcrucible-agent (worker): region files created ok region = f804a1fe-ab01-4e5b-9be0-057fbcc6c70d
102025-12-20T00:36:15.573ZINFOcrucible-agent (datafile): region f804a1fe-ab01-4e5b-9be0-057fbcc6c70d state: Requested -> Created
112025-12-20T00:36:15.573ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-12-20T00:36:15.590ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f804a1fe-ab01-4e5b-9be0-057fbcc6c70d
132025-12-20T00:36:15.601ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f804a1fe-ab01-4e5b-9be0-057fbcc6c70d
142025-12-20T00:36:15.615ZINFOcrucible-agent (worker): creating config property group
152025-12-20T00:36:15.618ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f804a1fe-ab01-4e5b-9be0-057fbcc6c70d
162025-12-20T00:36:15.618ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f804a1fe-ab01-4e5b-9be0-057fbcc6c70d
172025-12-20T00:36:15.618ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-12-20T00:36:15.618ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
192025-12-20T00:36:15.618ZINFOcrucible-agent (worker): commit
202025-12-20T00:36:15.622ZINFOcrucible-agent (worker): ok!
212025-12-20T00:36:15.627ZINFOcrucible-agent (worker): SMF ok!
222025-12-20T00:36:15.792ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:49077 req_id = 9b58925a-c00a-4959-abd7-8ff4c4d19f2d response_code = 200 uri = /crucible/0/regions
232025-12-20T00:36:16.852ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:49077 req_id = 5d08b232-0b03-4434-8fa9-8f371af332d6 response_code = 200 uri = /crucible/0/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a
242025-12-20T00:36:16.854ZINFOcrucible-agent (datafile): path is "/data/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a"
252025-12-20T00:36:16.860ZINFOcrucible-agent (datafile): dataset is oxp_a01f1533-1407-4cfb-9e88-c51537ae6b75/crucible/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a
262025-12-20T00:36:16.867ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a01f1533-1407-4cfb-9e88-c51537ae6b75/crucible/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a@e5ae05c6-4053-4c7e-a921-bffc4060750e
272025-12-20T00:36:16.867ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a01f1533-1407-4cfb-9e88-c51537ae6b75/crucible/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a", "e5ae05c6-4053-4c7e-a921-bffc4060750e"]
282025-12-20T00:36:16.876ZINFOcrucible-agent (dropshot): request completed latency_us = 22266 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:49077 req_id = b0ce9e9b-8b5f-4cd9-b53a-8cc704a89021 response_code = 200 uri = /crucible/0/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a/snapshots/e5ae05c6-4053-4c7e-a921-bffc4060750e
292025-12-20T00:36:16.882ZINFOcrucible-agent (datafile): path is "/data/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a"
302025-12-20T00:36:16.888ZINFOcrucible-agent (datafile): dataset is oxp_a01f1533-1407-4cfb-9e88-c51537ae6b75/crucible/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a
312025-12-20T00:36:16.894ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a01f1533-1407-4cfb-9e88-c51537ae6b75/crucible/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a@e5ae05c6-4053-4c7e-a921-bffc4060750e
322025-12-20T00:36:16.894ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a01f1533-1407-4cfb-9e88-c51537ae6b75/crucible/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a", "e5ae05c6-4053-4c7e-a921-bffc4060750e"]
332025-12-20T00:36:16.901ZINFOcrucible-agent (datafile): requesting running snapshot a7ee1a34-52ae-4990-8144-2200c9c59f5a-e5ae05c6-4053-4c7e-a921-bffc4060750e state: Requested
342025-12-20T00:36:16.901ZINFOcrucible-agent (dropshot): request completed latency_us = 19649 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:49077 req_id = 9a6aeb49-e3f9-4293-a2d0-20efc88ecf12 response_code = 200 uri = /crucible/0/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a/snapshots/e5ae05c6-4053-4c7e-a921-bffc4060750e/run
352025-12-20T00:36:16.901ZINFOcrucible-agent (worker): applying SMF actions for region a7ee1a34-52ae-4990-8144-2200c9c59f5a running snapshot e5ae05c6-4053-4c7e-a921-bffc4060750e (state Requested)...
362025-12-20T00:36:16.906ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-a7ee1a34-52ae-4990-8144-2200c9c59f5a-e5ae05c6-4053-4c7e-a921-bffc4060750e
372025-12-20T00:36:16.909ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-a7ee1a34-52ae-4990-8144-2200c9c59f5a-e5ae05c6-4053-4c7e-a921-bffc4060750e
382025-12-20T00:36:16.919ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-a7ee1a34-52ae-4990-8144-2200c9c59f5a-e5ae05c6-4053-4c7e-a921-bffc4060750e
392025-12-20T00:36:16.919ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a/.zfs/snapshot/e5ae05c6-4053-4c7e-a921-bffc4060750e
402025-12-20T00:36:16.919ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-12-20T00:36:16.919ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-12-20T00:36:16.919ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
432025-12-20T00:36:16.920ZINFOcrucible-agent (worker): commit
442025-12-20T00:36:16.923ZINFOcrucible-agent (worker): ok!
452025-12-20T00:36:16.927ZINFOcrucible-agent (worker): SMF ok!
462025-12-20T00:36:16.927ZINFOcrucible-agent (datafile): region a7ee1a34-52ae-4990-8144-2200c9c59f5a running snapshot e5ae05c6-4053-4c7e-a921-bffc4060750e state: Requested -> Created
472025-12-20T00:36:17.094ZINFOcrucible-agent (datafile): path is "/data/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a"
482025-12-20T00:36:17.100ZINFOcrucible-agent (datafile): dataset is oxp_a01f1533-1407-4cfb-9e88-c51537ae6b75/crucible/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a
492025-12-20T00:36:17.105ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a01f1533-1407-4cfb-9e88-c51537ae6b75/crucible/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a@e5ae05c6-4053-4c7e-a921-bffc4060750e
502025-12-20T00:36:17.105ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a01f1533-1407-4cfb-9e88-c51537ae6b75/crucible/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a", "e5ae05c6-4053-4c7e-a921-bffc4060750e"]
512025-12-20T00:36:17.110ZINFOcrucible-agent (dropshot): request completed latency_us = 16662 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:49077 req_id = 7f9f61d9-4839-4e96-9d56-792566d3b779 response_code = 200 uri = /crucible/0/regions/a7ee1a34-52ae-4990-8144-2200c9c59f5a/snapshots/e5ae05c6-4053-4c7e-a921-bffc4060750e/run