Max level shown:
12025-10-24T23:32:10.975ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:65002
22025-10-24T23:32:10.975ZINFOcrucible-agent (datafile): region 0fd6da5a-fdc6-463b-b09d-8691440e295c state: Requested
32025-10-24T23:32:10.976ZINFOcrucible-agent (dropshot): request completed latency_us = 628 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65002 req_id = 04e675a8-b576-43e0-878b-40ff4ef99816 response_code = 200 uri = /crucible/0/regions
42025-10-24T23:32:10.976ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-10-24T23:32:10.983ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_25a7dd80-6fb9-4242-8d54-0b967893b7c3/crucible/regions/0fd6da5a-fdc6-463b-b09d-8691440e295c
62025-10-24T23:32:10.983ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_25a7dd80-6fb9-4242-8d54-0b967893b7c3/crucible/regions/0fd6da5a-fdc6-463b-b09d-8691440e295c
72025-10-24T23:32:11.079ZINFOcrucible-agent (worker): creating region Region { id: RegionId("0fd6da5a-fdc6-463b-b09d-8691440e295c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/0fd6da5a-fdc6-463b-b09d-8691440e295c" region = 0fd6da5a-fdc6-463b-b09d-8691440e295c
82025-10-24T23:32:11.079ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "0fd6da5a-fdc6-463b-b09d-8691440e295c" "--data" "/data/regions/0fd6da5a-fdc6-463b-b09d-8691440e295c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 0fd6da5a-fdc6-463b-b09d-8691440e295c
92025-10-24T23:32:11.112ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65002 req_id = 243f2be0-a033-40f9-9fe5-a516b7fe6d97 response_code = 200 uri = /crucible/0/regions
102025-10-24T23:32:11.460ZINFOcrucible-agent (worker): region files created ok region = 0fd6da5a-fdc6-463b-b09d-8691440e295c
112025-10-24T23:32:11.460ZINFOcrucible-agent (datafile): region 0fd6da5a-fdc6-463b-b09d-8691440e295c state: Requested -> Created
122025-10-24T23:32:11.460ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-10-24T23:32:11.461ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-0fd6da5a-fdc6-463b-b09d-8691440e295c
142025-10-24T23:32:11.484ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-0fd6da5a-fdc6-463b-b09d-8691440e295c
152025-10-24T23:32:11.575ZINFOcrucible-agent (worker): creating config property group
162025-10-24T23:32:11.601ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-0fd6da5a-fdc6-463b-b09d-8691440e295c
172025-10-24T23:32:11.602ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0fd6da5a-fdc6-463b-b09d-8691440e295c
182025-10-24T23:32:11.602ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-10-24T23:32:11.602ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
202025-10-24T23:32:11.602ZINFOcrucible-agent (worker): commit
212025-10-24T23:32:11.613ZINFOcrucible-agent (worker): ok!
222025-10-24T23:32:11.640ZINFOcrucible-agent (worker): SMF ok!
232025-10-24T23:32:11.742ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65002 req_id = 4fd699d6-8ace-4e4d-bf82-1a23077a6806 response_code = 200 uri = /crucible/0/regions
242025-10-24T23:32:14.030ZINFOcrucible-agent (dropshot): request completed latency_us = 19343 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:65002 req_id = 830fc092-230b-4eea-b224-6debf55773e3 response_code = 200 uri = /crucible/0/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c
252025-10-24T23:32:14.045ZINFOcrucible-agent (datafile): path is "/data/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c"
262025-10-24T23:32:14.051ZINFOcrucible-agent (datafile): dataset is oxp_25a7dd80-6fb9-4242-8d54-0b967893b7c3/crucible/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c
272025-10-24T23:32:14.058ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_25a7dd80-6fb9-4242-8d54-0b967893b7c3/crucible/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c@9c89efd0-432a-4885-9ad2-dd077d0ca990
282025-10-24T23:32:14.058ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_25a7dd80-6fb9-4242-8d54-0b967893b7c3/crucible/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c", "9c89efd0-432a-4885-9ad2-dd077d0ca990"]
292025-10-24T23:32:14.067ZINFOcrucible-agent (dropshot): request completed latency_us = 22162 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:65002 req_id = 145e4af9-3614-461e-8159-b1153119eb65 response_code = 200 uri = /crucible/0/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c/snapshots/9c89efd0-432a-4885-9ad2-dd077d0ca990
302025-10-24T23:32:14.070ZINFOcrucible-agent (datafile): path is "/data/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c"
312025-10-24T23:32:14.076ZINFOcrucible-agent (datafile): dataset is oxp_25a7dd80-6fb9-4242-8d54-0b967893b7c3/crucible/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c
322025-10-24T23:32:14.082ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_25a7dd80-6fb9-4242-8d54-0b967893b7c3/crucible/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c@9c89efd0-432a-4885-9ad2-dd077d0ca990
332025-10-24T23:32:14.082ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_25a7dd80-6fb9-4242-8d54-0b967893b7c3/crucible/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c", "9c89efd0-432a-4885-9ad2-dd077d0ca990"]
342025-10-24T23:32:14.089ZINFOcrucible-agent (datafile): requesting running snapshot 5dbdc63f-2f04-4e2f-9edf-91eaddca781c-9c89efd0-432a-4885-9ad2-dd077d0ca990 state: Requested
352025-10-24T23:32:14.089ZINFOcrucible-agent (dropshot): request completed latency_us = 18967 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65002 req_id = 4acfeb76-c758-4df5-ad75-8a5ec662d3b9 response_code = 200 uri = /crucible/0/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c/snapshots/9c89efd0-432a-4885-9ad2-dd077d0ca990/run
362025-10-24T23:32:14.089ZINFOcrucible-agent (worker): applying SMF actions for region 5dbdc63f-2f04-4e2f-9edf-91eaddca781c running snapshot 9c89efd0-432a-4885-9ad2-dd077d0ca990 (state Requested)...
372025-10-24T23:32:14.091ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-5dbdc63f-2f04-4e2f-9edf-91eaddca781c-9c89efd0-432a-4885-9ad2-dd077d0ca990
382025-10-24T23:32:14.124ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-5dbdc63f-2f04-4e2f-9edf-91eaddca781c-9c89efd0-432a-4885-9ad2-dd077d0ca990
392025-10-24T23:32:14.188ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-5dbdc63f-2f04-4e2f-9edf-91eaddca781c-9c89efd0-432a-4885-9ad2-dd077d0ca990
402025-10-24T23:32:14.188ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c/.zfs/snapshot/9c89efd0-432a-4885-9ad2-dd077d0ca990
412025-10-24T23:32:14.188ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422025-10-24T23:32:14.188ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432025-10-24T23:32:14.188ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
442025-10-24T23:32:14.188ZINFOcrucible-agent (worker): commit
452025-10-24T23:32:14.227ZINFOcrucible-agent (worker): ok!
462025-10-24T23:32:14.265ZINFOcrucible-agent (worker): SMF ok!
472025-10-24T23:32:14.265ZINFOcrucible-agent (datafile): region 5dbdc63f-2f04-4e2f-9edf-91eaddca781c running snapshot 9c89efd0-432a-4885-9ad2-dd077d0ca990 state: Requested -> Created
482025-10-24T23:32:14.334ZINFOcrucible-agent (datafile): path is "/data/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c"
492025-10-24T23:32:14.341ZINFOcrucible-agent (datafile): dataset is oxp_25a7dd80-6fb9-4242-8d54-0b967893b7c3/crucible/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c
502025-10-24T23:32:14.348ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_25a7dd80-6fb9-4242-8d54-0b967893b7c3/crucible/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c@9c89efd0-432a-4885-9ad2-dd077d0ca990
512025-10-24T23:32:14.348ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_25a7dd80-6fb9-4242-8d54-0b967893b7c3/crucible/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c", "9c89efd0-432a-4885-9ad2-dd077d0ca990"]
522025-10-24T23:32:14.354ZINFOcrucible-agent (dropshot): request completed latency_us = 20052 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65002 req_id = 3a514297-32e6-4deb-a0ca-a37c893c0e86 response_code = 200 uri = /crucible/0/regions/5dbdc63f-2f04-4e2f-9edf-91eaddca781c/snapshots/9c89efd0-432a-4885-9ad2-dd077d0ca990/run