Max level shown:
12025-11-06T01:06:45.550ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:51687
22025-11-06T01:06:45.550ZINFOcrucible-agent (datafile): region cedb52df-7776-433c-a939-29de43d5a5f4 state: Requested
32025-11-06T01:06:45.551ZINFOcrucible-agent (dropshot): request completed latency_us = 1034 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51687 req_id = 25e28e83-9093-4f32-97a2-93dec915040c response_code = 200 uri = /crucible/0/regions
42025-11-06T01:06:45.551ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-11-06T01:06:45.560ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_2f43b1b1-3bf4-4e51-94f5-1d29a3e846a7/crucible/regions/cedb52df-7776-433c-a939-29de43d5a5f4
62025-11-06T01:06:45.560ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_2f43b1b1-3bf4-4e51-94f5-1d29a3e846a7/crucible/regions/cedb52df-7776-433c-a939-29de43d5a5f4
72025-11-06T01:06:45.607ZINFOcrucible-agent (worker): creating region Region { id: RegionId("cedb52df-7776-433c-a939-29de43d5a5f4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/cedb52df-7776-433c-a939-29de43d5a5f4" region = cedb52df-7776-433c-a939-29de43d5a5f4
82025-11-06T01:06:45.607ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "cedb52df-7776-433c-a939-29de43d5a5f4" "--data" "/data/regions/cedb52df-7776-433c-a939-29de43d5a5f4" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = cedb52df-7776-433c-a939-29de43d5a5f4
92025-11-06T01:06:45.697ZINFOcrucible-agent (worker): region files created ok region = cedb52df-7776-433c-a939-29de43d5a5f4
102025-11-06T01:06:45.697ZINFOcrucible-agent (datafile): region cedb52df-7776-433c-a939-29de43d5a5f4 state: Requested -> Created
112025-11-06T01:06:45.697ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-11-06T01:06:45.712ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-cedb52df-7776-433c-a939-29de43d5a5f4
132025-11-06T01:06:45.719ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-cedb52df-7776-433c-a939-29de43d5a5f4
142025-11-06T01:06:45.729ZINFOcrucible-agent (worker): creating config property group
152025-11-06T01:06:45.732ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-cedb52df-7776-433c-a939-29de43d5a5f4
162025-11-06T01:06:45.732ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cedb52df-7776-433c-a939-29de43d5a5f4
172025-11-06T01:06:45.732ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-11-06T01:06:45.733ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192025-11-06T01:06:45.733ZINFOcrucible-agent (worker): commit
202025-11-06T01:06:45.736ZINFOcrucible-agent (worker): ok!
212025-11-06T01:06:45.742ZINFOcrucible-agent (worker): SMF ok!
222025-11-06T01:06:45.877ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51687 req_id = b7a660ce-a22b-4a35-8a49-37e8e6557cbf response_code = 200 uri = /crucible/0/regions
232025-11-06T01:06:47.583ZINFOcrucible-agent (dropshot): request completed latency_us = 2993 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51687 req_id = 003e8325-7c69-4d21-889d-2cd551d0dbc1 response_code = 200 uri = /crucible/0/regions/b2aab4ae-c866-44da-bf01-d553c230288c
242025-11-06T01:06:47.587ZINFOcrucible-agent (datafile): path is "/data/regions/b2aab4ae-c866-44da-bf01-d553c230288c"
252025-11-06T01:06:47.593ZINFOcrucible-agent (datafile): dataset is oxp_2f43b1b1-3bf4-4e51-94f5-1d29a3e846a7/crucible/regions/b2aab4ae-c866-44da-bf01-d553c230288c
262025-11-06T01:06:47.599ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2f43b1b1-3bf4-4e51-94f5-1d29a3e846a7/crucible/regions/b2aab4ae-c866-44da-bf01-d553c230288c@5eed0a57-164e-45d9-aa70-24302628d223
272025-11-06T01:06:47.599ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2f43b1b1-3bf4-4e51-94f5-1d29a3e846a7/crucible/regions/b2aab4ae-c866-44da-bf01-d553c230288c", "5eed0a57-164e-45d9-aa70-24302628d223"]
282025-11-06T01:06:47.608ZINFOcrucible-agent (dropshot): request completed latency_us = 21544 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51687 req_id = 1632ac62-80d0-4f33-a219-86ff13f477d6 response_code = 200 uri = /crucible/0/regions/b2aab4ae-c866-44da-bf01-d553c230288c/snapshots/5eed0a57-164e-45d9-aa70-24302628d223
292025-11-06T01:06:47.612ZINFOcrucible-agent (datafile): path is "/data/regions/b2aab4ae-c866-44da-bf01-d553c230288c"
302025-11-06T01:06:47.618ZINFOcrucible-agent (datafile): dataset is oxp_2f43b1b1-3bf4-4e51-94f5-1d29a3e846a7/crucible/regions/b2aab4ae-c866-44da-bf01-d553c230288c
312025-11-06T01:06:47.624ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2f43b1b1-3bf4-4e51-94f5-1d29a3e846a7/crucible/regions/b2aab4ae-c866-44da-bf01-d553c230288c@5eed0a57-164e-45d9-aa70-24302628d223
322025-11-06T01:06:47.624ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2f43b1b1-3bf4-4e51-94f5-1d29a3e846a7/crucible/regions/b2aab4ae-c866-44da-bf01-d553c230288c", "5eed0a57-164e-45d9-aa70-24302628d223"]
332025-11-06T01:06:47.630ZINFOcrucible-agent (datafile): requesting running snapshot b2aab4ae-c866-44da-bf01-d553c230288c-5eed0a57-164e-45d9-aa70-24302628d223 state: Requested
342025-11-06T01:06:47.630ZINFOcrucible-agent (dropshot): request completed latency_us = 18599 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51687 req_id = 4ea681fc-1e68-482c-8e32-c13e54777fa4 response_code = 200 uri = /crucible/0/regions/b2aab4ae-c866-44da-bf01-d553c230288c/snapshots/5eed0a57-164e-45d9-aa70-24302628d223/run
352025-11-06T01:06:47.630ZINFOcrucible-agent (worker): applying SMF actions for region b2aab4ae-c866-44da-bf01-d553c230288c running snapshot 5eed0a57-164e-45d9-aa70-24302628d223 (state Requested)...
362025-11-06T01:06:47.632ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-b2aab4ae-c866-44da-bf01-d553c230288c-5eed0a57-164e-45d9-aa70-24302628d223
372025-11-06T01:06:47.640ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-b2aab4ae-c866-44da-bf01-d553c230288c-5eed0a57-164e-45d9-aa70-24302628d223
382025-11-06T01:06:47.649ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-b2aab4ae-c866-44da-bf01-d553c230288c-5eed0a57-164e-45d9-aa70-24302628d223
392025-11-06T01:06:47.649ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b2aab4ae-c866-44da-bf01-d553c230288c/.zfs/snapshot/5eed0a57-164e-45d9-aa70-24302628d223
402025-11-06T01:06:47.649ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-11-06T01:06:47.649ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-11-06T01:06:47.650ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
432025-11-06T01:06:47.650ZINFOcrucible-agent (worker): commit
442025-11-06T01:06:47.653ZINFOcrucible-agent (worker): ok!
452025-11-06T01:06:47.657ZINFOcrucible-agent (worker): SMF ok!
462025-11-06T01:06:47.657ZINFOcrucible-agent (datafile): region b2aab4ae-c866-44da-bf01-d553c230288c running snapshot 5eed0a57-164e-45d9-aa70-24302628d223 state: Requested -> Created
472025-11-06T01:06:47.941ZINFOcrucible-agent (datafile): path is "/data/regions/b2aab4ae-c866-44da-bf01-d553c230288c"
482025-11-06T01:06:47.947ZINFOcrucible-agent (datafile): dataset is oxp_2f43b1b1-3bf4-4e51-94f5-1d29a3e846a7/crucible/regions/b2aab4ae-c866-44da-bf01-d553c230288c
492025-11-06T01:06:47.953ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2f43b1b1-3bf4-4e51-94f5-1d29a3e846a7/crucible/regions/b2aab4ae-c866-44da-bf01-d553c230288c@5eed0a57-164e-45d9-aa70-24302628d223
502025-11-06T01:06:47.953ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2f43b1b1-3bf4-4e51-94f5-1d29a3e846a7/crucible/regions/b2aab4ae-c866-44da-bf01-d553c230288c", "5eed0a57-164e-45d9-aa70-24302628d223"]
512025-11-06T01:06:47.959ZINFOcrucible-agent (dropshot): request completed latency_us = 17600 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51687 req_id = 280d2ad6-75b8-4024-8775-168c9b421466 response_code = 200 uri = /crucible/0/regions/b2aab4ae-c866-44da-bf01-d553c230288c/snapshots/5eed0a57-164e-45d9-aa70-24302628d223/run