Max level shown:
12025-01-29T07:20:28.338ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:36485
22025-01-29T07:20:28.344ZINFOcrucible-agent (dropshot): request completed latency_us = 5678 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36485 req_id = 86b17a17-324a-4562-8ece-7901b7404479 response_code = 200 uri = /crucible/0/regions/f14881db-62db-4299-aaa1-34e199832a94
32025-01-29T07:20:28.349ZINFOcrucible-agent (datafile): path is "/data/regions/f14881db-62db-4299-aaa1-34e199832a94"
42025-01-29T07:20:28.358ZINFOcrucible-agent (datafile): dataset is oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crucible/regions/f14881db-62db-4299-aaa1-34e199832a94
52025-01-29T07:20:28.366ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crucible/regions/f14881db-62db-4299-aaa1-34e199832a94@8d18c031-6495-4508-9fab-b0e279bb4e77
62025-01-29T07:20:28.366ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crucible/regions/f14881db-62db-4299-aaa1-34e199832a94", "8d18c031-6495-4508-9fab-b0e279bb4e77"]
72025-01-29T07:20:28.380ZINFOcrucible-agent (dropshot): request completed latency_us = 31822 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36485 req_id = d638dc9e-63b5-47fd-83a7-b9f53f88a169 response_code = 200 uri = /crucible/0/regions/f14881db-62db-4299-aaa1-34e199832a94/snapshots/8d18c031-6495-4508-9fab-b0e279bb4e77
82025-01-29T07:20:28.384ZINFOcrucible-agent (datafile): path is "/data/regions/f14881db-62db-4299-aaa1-34e199832a94"
92025-01-29T07:20:28.392ZINFOcrucible-agent (datafile): dataset is oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crucible/regions/f14881db-62db-4299-aaa1-34e199832a94
102025-01-29T07:20:28.401ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crucible/regions/f14881db-62db-4299-aaa1-34e199832a94@8d18c031-6495-4508-9fab-b0e279bb4e77
112025-01-29T07:20:28.402ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crucible/regions/f14881db-62db-4299-aaa1-34e199832a94", "8d18c031-6495-4508-9fab-b0e279bb4e77"]
122025-01-29T07:20:28.410ZINFOcrucible-agent (datafile): requesting running snapshot f14881db-62db-4299-aaa1-34e199832a94-8d18c031-6495-4508-9fab-b0e279bb4e77 state: Requested
132025-01-29T07:20:28.411ZINFOcrucible-agent (worker): applying SMF actions for region f14881db-62db-4299-aaa1-34e199832a94 running snapshot 8d18c031-6495-4508-9fab-b0e279bb4e77 (state Requested)...
142025-01-29T07:20:28.411ZINFOcrucible-agent (dropshot): request completed latency_us = 27395 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36485 req_id = d14023f1-b929-4391-986d-dc81cc505b8d response_code = 200 uri = /crucible/0/regions/f14881db-62db-4299-aaa1-34e199832a94/snapshots/8d18c031-6495-4508-9fab-b0e279bb4e77/run
152025-01-29T07:20:28.415ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/f14881db-62db-4299-aaa1-34e199832a94
162025-01-29T07:20:28.415ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
172025-01-29T07:20:28.416ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::16
182025-01-29T07:20:28.416ZINFOcrucible-agent (worker): reconfig required
192025-01-29T07:20:28.416ZINFOcrucible-agent (worker): using existing config property group
202025-01-29T07:20:28.416ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f14881db-62db-4299-aaa1-34e199832a94
212025-01-29T07:20:28.416ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f14881db-62db-4299-aaa1-34e199832a94
222025-01-29T07:20:28.416ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
232025-01-29T07:20:28.416ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
242025-01-29T07:20:28.416ZINFOcrucible-agent (worker): commit
252025-01-29T07:20:28.421ZINFOcrucible-agent (worker): ok!
262025-01-29T07:20:28.422ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-f14881db-62db-4299-aaa1-34e199832a94-8d18c031-6495-4508-9fab-b0e279bb4e77
272025-01-29T07:20:28.424ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-f14881db-62db-4299-aaa1-34e199832a94-8d18c031-6495-4508-9fab-b0e279bb4e77
282025-01-29T07:20:28.434ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-f14881db-62db-4299-aaa1-34e199832a94-8d18c031-6495-4508-9fab-b0e279bb4e77
292025-01-29T07:20:28.434ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f14881db-62db-4299-aaa1-34e199832a94/.zfs/snapshot/8d18c031-6495-4508-9fab-b0e279bb4e77
302025-01-29T07:20:28.435ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
312025-01-29T07:20:28.435ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
322025-01-29T07:20:28.435ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
332025-01-29T07:20:28.435ZINFOcrucible-agent (worker): commit
342025-01-29T07:20:28.438ZINFOcrucible-agent (worker): ok!
352025-01-29T07:20:28.442ZINFOcrucible-agent (worker): SMF ok!
362025-01-29T07:20:28.442ZINFOcrucible-agent (datafile): region f14881db-62db-4299-aaa1-34e199832a94 running snapshot 8d18c031-6495-4508-9fab-b0e279bb4e77 state: Requested -> Created
372025-01-29T07:20:28.788ZINFOcrucible-agent (datafile): path is "/data/regions/f14881db-62db-4299-aaa1-34e199832a94"
382025-01-29T07:20:28.797ZINFOcrucible-agent (datafile): dataset is oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crucible/regions/f14881db-62db-4299-aaa1-34e199832a94
392025-01-29T07:20:28.806ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crucible/regions/f14881db-62db-4299-aaa1-34e199832a94@8d18c031-6495-4508-9fab-b0e279bb4e77
402025-01-29T07:20:28.806ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crucible/regions/f14881db-62db-4299-aaa1-34e199832a94", "8d18c031-6495-4508-9fab-b0e279bb4e77"]
412025-01-29T07:20:28.814ZINFOcrucible-agent (dropshot): request completed latency_us = 26538 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36485 req_id = 24cdb1f2-58c1-46a3-8831-d730303326f7 response_code = 200 uri = /crucible/0/regions/f14881db-62db-4299-aaa1-34e199832a94/snapshots/8d18c031-6495-4508-9fab-b0e279bb4e77/run