Max level shown:
12025-12-03T17:06:07.343ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::c]:60659
22025-12-03T17:06:07.343ZINFOcrucible-agent (datafile): region b2ffcd9a-1343-4cf0-9260-4ba499a73391 state: Requested
32025-12-03T17:06:07.345ZINFOcrucible-agent (dropshot): request completed latency_us = 1267 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60659 req_id = b2239750-56cf-4fac-b8e7-ed012a790071 response_code = 200 uri = /crucible/0/regions
42025-12-03T17:06:07.345ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-12-03T17:06:07.360ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1fe109ba-7d30-43aa-a6ee-27c13c242449/crucible/regions/b2ffcd9a-1343-4cf0-9260-4ba499a73391
62025-12-03T17:06:07.360ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1fe109ba-7d30-43aa-a6ee-27c13c242449/crucible/regions/b2ffcd9a-1343-4cf0-9260-4ba499a73391
72025-12-03T17:06:07.433ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b2ffcd9a-1343-4cf0-9260-4ba499a73391"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b2ffcd9a-1343-4cf0-9260-4ba499a73391" region = b2ffcd9a-1343-4cf0-9260-4ba499a73391
82025-12-03T17:06:07.433ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b2ffcd9a-1343-4cf0-9260-4ba499a73391" "--data" "/data/regions/b2ffcd9a-1343-4cf0-9260-4ba499a73391" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b2ffcd9a-1343-4cf0-9260-4ba499a73391
92025-12-03T17:06:07.507ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60659 req_id = 29c31347-cf77-4e9d-a109-4695682647f7 response_code = 200 uri = /crucible/0/regions
102025-12-03T17:06:07.550ZINFOcrucible-agent (worker): region files created ok region = b2ffcd9a-1343-4cf0-9260-4ba499a73391
112025-12-03T17:06:07.550ZINFOcrucible-agent (datafile): region b2ffcd9a-1343-4cf0-9260-4ba499a73391 state: Requested -> Created
122025-12-03T17:06:07.550ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-12-03T17:06:07.551ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b2ffcd9a-1343-4cf0-9260-4ba499a73391
142025-12-03T17:06:07.561ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b2ffcd9a-1343-4cf0-9260-4ba499a73391
152025-12-03T17:06:07.583ZINFOcrucible-agent (worker): creating config property group
162025-12-03T17:06:07.585ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b2ffcd9a-1343-4cf0-9260-4ba499a73391
172025-12-03T17:06:07.586ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b2ffcd9a-1343-4cf0-9260-4ba499a73391
182025-12-03T17:06:07.586ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-12-03T17:06:07.586ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
202025-12-03T17:06:07.586ZINFOcrucible-agent (worker): commit
212025-12-03T17:06:07.590ZINFOcrucible-agent (worker): ok!
222025-12-03T17:06:07.607ZINFOcrucible-agent (worker): SMF ok!
232025-12-03T17:06:07.912ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60659 req_id = 2baf6842-904d-4058-9e16-5474bda7e889 response_code = 200 uri = /crucible/0/regions
242025-12-03T17:06:09.371ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:60659 req_id = 03f6c1b8-85ca-4ec2-9d1c-9a521d3af7f5 response_code = 200 uri = /crucible/0/regions/dd3c9ccd-f143-4771-990d-56440605268f
252025-12-03T17:06:09.374ZINFOcrucible-agent (datafile): path is "/data/regions/dd3c9ccd-f143-4771-990d-56440605268f"
262025-12-03T17:06:09.380ZINFOcrucible-agent (datafile): dataset is oxp_1fe109ba-7d30-43aa-a6ee-27c13c242449/crucible/regions/dd3c9ccd-f143-4771-990d-56440605268f
272025-12-03T17:06:09.386ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1fe109ba-7d30-43aa-a6ee-27c13c242449/crucible/regions/dd3c9ccd-f143-4771-990d-56440605268f@0f6c8698-04c5-4839-aca1-5d488eabd00e
282025-12-03T17:06:09.386ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1fe109ba-7d30-43aa-a6ee-27c13c242449/crucible/regions/dd3c9ccd-f143-4771-990d-56440605268f", "0f6c8698-04c5-4839-aca1-5d488eabd00e"]
292025-12-03T17:06:09.395ZINFOcrucible-agent (dropshot): request completed latency_us = 20768 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:60659 req_id = d535a106-bfed-4d08-94ed-4e50d025add3 response_code = 200 uri = /crucible/0/regions/dd3c9ccd-f143-4771-990d-56440605268f/snapshots/0f6c8698-04c5-4839-aca1-5d488eabd00e
302025-12-03T17:06:09.399ZINFOcrucible-agent (datafile): path is "/data/regions/dd3c9ccd-f143-4771-990d-56440605268f"
312025-12-03T17:06:09.404ZINFOcrucible-agent (datafile): dataset is oxp_1fe109ba-7d30-43aa-a6ee-27c13c242449/crucible/regions/dd3c9ccd-f143-4771-990d-56440605268f
322025-12-03T17:06:09.411ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1fe109ba-7d30-43aa-a6ee-27c13c242449/crucible/regions/dd3c9ccd-f143-4771-990d-56440605268f@0f6c8698-04c5-4839-aca1-5d488eabd00e
332025-12-03T17:06:09.411ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1fe109ba-7d30-43aa-a6ee-27c13c242449/crucible/regions/dd3c9ccd-f143-4771-990d-56440605268f", "0f6c8698-04c5-4839-aca1-5d488eabd00e"]
342025-12-03T17:06:09.418ZINFOcrucible-agent (datafile): requesting running snapshot dd3c9ccd-f143-4771-990d-56440605268f-0f6c8698-04c5-4839-aca1-5d488eabd00e state: Requested
352025-12-03T17:06:09.418ZINFOcrucible-agent (dropshot): request completed latency_us = 19474 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60659 req_id = 9135ebdd-bcfe-43b7-a908-f0aaae2c8a39 response_code = 200 uri = /crucible/0/regions/dd3c9ccd-f143-4771-990d-56440605268f/snapshots/0f6c8698-04c5-4839-aca1-5d488eabd00e/run
362025-12-03T17:06:09.418ZINFOcrucible-agent (worker): applying SMF actions for region dd3c9ccd-f143-4771-990d-56440605268f running snapshot 0f6c8698-04c5-4839-aca1-5d488eabd00e (state Requested)...
372025-12-03T17:06:09.423ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-dd3c9ccd-f143-4771-990d-56440605268f-0f6c8698-04c5-4839-aca1-5d488eabd00e
382025-12-03T17:06:09.432ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-dd3c9ccd-f143-4771-990d-56440605268f-0f6c8698-04c5-4839-aca1-5d488eabd00e
392025-12-03T17:06:09.441ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-dd3c9ccd-f143-4771-990d-56440605268f-0f6c8698-04c5-4839-aca1-5d488eabd00e
402025-12-03T17:06:09.441ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/dd3c9ccd-f143-4771-990d-56440605268f/.zfs/snapshot/0f6c8698-04c5-4839-aca1-5d488eabd00e
412025-12-03T17:06:09.441ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422025-12-03T17:06:09.441ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432025-12-03T17:06:09.441ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
442025-12-03T17:06:09.441ZINFOcrucible-agent (worker): commit
452025-12-03T17:06:09.445ZINFOcrucible-agent (worker): ok!
462025-12-03T17:06:09.449ZINFOcrucible-agent (worker): SMF ok!
472025-12-03T17:06:09.449ZINFOcrucible-agent (datafile): region dd3c9ccd-f143-4771-990d-56440605268f running snapshot 0f6c8698-04c5-4839-aca1-5d488eabd00e state: Requested -> Created
482025-12-03T17:06:09.699ZINFOcrucible-agent (datafile): path is "/data/regions/dd3c9ccd-f143-4771-990d-56440605268f"
492025-12-03T17:06:09.705ZINFOcrucible-agent (datafile): dataset is oxp_1fe109ba-7d30-43aa-a6ee-27c13c242449/crucible/regions/dd3c9ccd-f143-4771-990d-56440605268f
502025-12-03T17:06:09.711ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1fe109ba-7d30-43aa-a6ee-27c13c242449/crucible/regions/dd3c9ccd-f143-4771-990d-56440605268f@0f6c8698-04c5-4839-aca1-5d488eabd00e
512025-12-03T17:06:09.711ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1fe109ba-7d30-43aa-a6ee-27c13c242449/crucible/regions/dd3c9ccd-f143-4771-990d-56440605268f", "0f6c8698-04c5-4839-aca1-5d488eabd00e"]
522025-12-03T17:06:09.718ZINFOcrucible-agent (dropshot): request completed latency_us = 18683 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60659 req_id = b3824569-de01-48db-aa88-e9ef76db5e2e response_code = 200 uri = /crucible/0/regions/dd3c9ccd-f143-4771-990d-56440605268f/snapshots/0f6c8698-04c5-4839-aca1-5d488eabd00e/run