Max level shown:
12026-03-03T01:45:42.929ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:50161
22026-03-03T01:45:42.929ZINFOcrucible-agent (datafile): region 87796468-a58b-40f1-89bb-e7549cb37d4e state: Requested
32026-03-03T01:45:42.930ZINFOcrucible-agent (dropshot): request completed latency_us = 901 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50161 req_id = 4636518a-9824-407e-9694-bc9e420f349f response_code = 200 uri = /crucible/0/regions
42026-03-03T01:45:42.930ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-03-03T01:45:42.938ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_2ce91663-a87f-46e6-ba3b-6b7168b914af/crucible/regions/87796468-a58b-40f1-89bb-e7549cb37d4e
62026-03-03T01:45:42.938ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_2ce91663-a87f-46e6-ba3b-6b7168b914af/crucible/regions/87796468-a58b-40f1-89bb-e7549cb37d4e
72026-03-03T01:45:42.996ZINFOcrucible-agent (worker): creating region Region { id: RegionId("87796468-a58b-40f1-89bb-e7549cb37d4e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/87796468-a58b-40f1-89bb-e7549cb37d4e" region = 87796468-a58b-40f1-89bb-e7549cb37d4e
82026-03-03T01:45:42.996ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "87796468-a58b-40f1-89bb-e7549cb37d4e" "--data" "/data/regions/87796468-a58b-40f1-89bb-e7549cb37d4e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 87796468-a58b-40f1-89bb-e7549cb37d4e
92026-03-03T01:45:43.077ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50161 req_id = 928fd2c2-1f52-4626-85fc-8318e7ccfba4 response_code = 200 uri = /crucible/0/regions
102026-03-03T01:45:43.138ZINFOcrucible-agent (worker): region files created ok region = 87796468-a58b-40f1-89bb-e7549cb37d4e
112026-03-03T01:45:43.138ZINFOcrucible-agent (datafile): region 87796468-a58b-40f1-89bb-e7549cb37d4e state: Requested -> Created
122026-03-03T01:45:43.138ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-03-03T01:45:43.159ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-87796468-a58b-40f1-89bb-e7549cb37d4e
142026-03-03T01:45:43.164ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-87796468-a58b-40f1-89bb-e7549cb37d4e
152026-03-03T01:45:43.173ZINFOcrucible-agent (worker): creating config property group
162026-03-03T01:45:43.175ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-87796468-a58b-40f1-89bb-e7549cb37d4e
172026-03-03T01:45:43.176ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/87796468-a58b-40f1-89bb-e7549cb37d4e
182026-03-03T01:45:43.176ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-03-03T01:45:43.176ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202026-03-03T01:45:43.176ZINFOcrucible-agent (worker): commit
212026-03-03T01:45:43.180ZINFOcrucible-agent (worker): ok!
222026-03-03T01:45:43.184ZINFOcrucible-agent (worker): SMF ok!
232026-03-03T01:45:43.408ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50161 req_id = 8c2d5f81-4f02-4f3b-a1f0-6d9629dbf95c response_code = 200 uri = /crucible/0/regions
242026-03-03T01:45:44.358ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:50161 req_id = bd21f4fc-a6db-4425-87cc-822eaa50eb9c response_code = 200 uri = /crucible/0/regions/46a34461-d4b9-491f-8c00-413a40c3e663
252026-03-03T01:45:44.361ZINFOcrucible-agent (datafile): path is "/data/regions/46a34461-d4b9-491f-8c00-413a40c3e663"
262026-03-03T01:45:44.368ZINFOcrucible-agent (datafile): dataset is oxp_2ce91663-a87f-46e6-ba3b-6b7168b914af/crucible/regions/46a34461-d4b9-491f-8c00-413a40c3e663
272026-03-03T01:45:44.373ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2ce91663-a87f-46e6-ba3b-6b7168b914af/crucible/regions/46a34461-d4b9-491f-8c00-413a40c3e663@97dd1a42-8947-4e2f-9ada-8024073b3657
282026-03-03T01:45:44.373ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2ce91663-a87f-46e6-ba3b-6b7168b914af/crucible/regions/46a34461-d4b9-491f-8c00-413a40c3e663", "97dd1a42-8947-4e2f-9ada-8024073b3657"]
292026-03-03T01:45:44.382ZINFOcrucible-agent (dropshot): request completed latency_us = 21284 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:50161 req_id = 8ff33ad0-bd2b-47fb-aa67-e70ba1ca7040 response_code = 200 uri = /crucible/0/regions/46a34461-d4b9-491f-8c00-413a40c3e663/snapshots/97dd1a42-8947-4e2f-9ada-8024073b3657
302026-03-03T01:45:44.386ZINFOcrucible-agent (datafile): path is "/data/regions/46a34461-d4b9-491f-8c00-413a40c3e663"
312026-03-03T01:45:44.392ZINFOcrucible-agent (datafile): dataset is oxp_2ce91663-a87f-46e6-ba3b-6b7168b914af/crucible/regions/46a34461-d4b9-491f-8c00-413a40c3e663
322026-03-03T01:45:44.398ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2ce91663-a87f-46e6-ba3b-6b7168b914af/crucible/regions/46a34461-d4b9-491f-8c00-413a40c3e663@97dd1a42-8947-4e2f-9ada-8024073b3657
332026-03-03T01:45:44.398ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2ce91663-a87f-46e6-ba3b-6b7168b914af/crucible/regions/46a34461-d4b9-491f-8c00-413a40c3e663", "97dd1a42-8947-4e2f-9ada-8024073b3657"]
342026-03-03T01:45:44.405ZINFOcrucible-agent (datafile): requesting running snapshot 46a34461-d4b9-491f-8c00-413a40c3e663-97dd1a42-8947-4e2f-9ada-8024073b3657 state: Requested
352026-03-03T01:45:44.405ZINFOcrucible-agent (dropshot): request completed latency_us = 18884 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50161 req_id = 46d5abc9-1830-4279-a2a5-f4c4c5b815cb response_code = 200 uri = /crucible/0/regions/46a34461-d4b9-491f-8c00-413a40c3e663/snapshots/97dd1a42-8947-4e2f-9ada-8024073b3657/run
362026-03-03T01:45:44.405ZINFOcrucible-agent (worker): applying SMF actions for region 46a34461-d4b9-491f-8c00-413a40c3e663 running snapshot 97dd1a42-8947-4e2f-9ada-8024073b3657 (state Requested)...
372026-03-03T01:45:44.410ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-46a34461-d4b9-491f-8c00-413a40c3e663-97dd1a42-8947-4e2f-9ada-8024073b3657
382026-03-03T01:45:44.423ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-46a34461-d4b9-491f-8c00-413a40c3e663-97dd1a42-8947-4e2f-9ada-8024073b3657
392026-03-03T01:45:44.433ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-46a34461-d4b9-491f-8c00-413a40c3e663-97dd1a42-8947-4e2f-9ada-8024073b3657
402026-03-03T01:45:44.433ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/46a34461-d4b9-491f-8c00-413a40c3e663/.zfs/snapshot/97dd1a42-8947-4e2f-9ada-8024073b3657
412026-03-03T01:45:44.433ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-03-03T01:45:44.433ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-03-03T01:45:44.433ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
442026-03-03T01:45:44.433ZINFOcrucible-agent (worker): commit
452026-03-03T01:45:44.436ZINFOcrucible-agent (worker): ok!
462026-03-03T01:45:44.441ZINFOcrucible-agent (worker): SMF ok!
472026-03-03T01:45:44.441ZINFOcrucible-agent (datafile): region 46a34461-d4b9-491f-8c00-413a40c3e663 running snapshot 97dd1a42-8947-4e2f-9ada-8024073b3657 state: Requested -> Created
482026-03-03T01:45:44.713ZINFOcrucible-agent (datafile): path is "/data/regions/46a34461-d4b9-491f-8c00-413a40c3e663"
492026-03-03T01:45:44.720ZINFOcrucible-agent (datafile): dataset is oxp_2ce91663-a87f-46e6-ba3b-6b7168b914af/crucible/regions/46a34461-d4b9-491f-8c00-413a40c3e663
502026-03-03T01:45:44.726ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2ce91663-a87f-46e6-ba3b-6b7168b914af/crucible/regions/46a34461-d4b9-491f-8c00-413a40c3e663@97dd1a42-8947-4e2f-9ada-8024073b3657
512026-03-03T01:45:44.726ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2ce91663-a87f-46e6-ba3b-6b7168b914af/crucible/regions/46a34461-d4b9-491f-8c00-413a40c3e663", "97dd1a42-8947-4e2f-9ada-8024073b3657"]
522026-03-03T01:45:44.732ZINFOcrucible-agent (dropshot): request completed latency_us = 18895 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50161 req_id = 94ccf142-8b14-4645-a2fe-1849d35257a0 response_code = 200 uri = /crucible/0/regions/46a34461-d4b9-491f-8c00-413a40c3e663/snapshots/97dd1a42-8947-4e2f-9ada-8024073b3657/run