Max level shown:
12026-05-23T16:20:20.135ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:42464
22026-05-23T16:20:20.139ZINFOcrucible-agent (dropshot): request completed latency_us = 3967 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:42464 req_id = 6bbf3f27-18eb-43ba-b303-315ba841b92a response_code = 200 uri = /crucible/0/regions/b1862507-d97e-4a24-8b49-a43b503b8307
32026-05-23T16:20:20.143ZINFOcrucible-agent (datafile): path is "/data/regions/b1862507-d97e-4a24-8b49-a43b503b8307"
42026-05-23T16:20:20.149ZINFOcrucible-agent (datafile): dataset is oxp_f324ec6b-47a6-4139-996e-b201e8759aa5/crucible/regions/b1862507-d97e-4a24-8b49-a43b503b8307
52026-05-23T16:20:20.155ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f324ec6b-47a6-4139-996e-b201e8759aa5/crucible/regions/b1862507-d97e-4a24-8b49-a43b503b8307@2a1776ea-5d7b-46a5-8ef7-e5156168e0eb
62026-05-23T16:20:20.155ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f324ec6b-47a6-4139-996e-b201e8759aa5/crucible/regions/b1862507-d97e-4a24-8b49-a43b503b8307", "2a1776ea-5d7b-46a5-8ef7-e5156168e0eb"]
72026-05-23T16:20:20.164ZINFOcrucible-agent (dropshot): request completed latency_us = 21197 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:42464 req_id = 19990be5-e90f-4df2-883b-5d18d0e21b50 response_code = 200 uri = /crucible/0/regions/b1862507-d97e-4a24-8b49-a43b503b8307/snapshots/2a1776ea-5d7b-46a5-8ef7-e5156168e0eb
82026-05-23T16:20:20.167ZINFOcrucible-agent (datafile): path is "/data/regions/b1862507-d97e-4a24-8b49-a43b503b8307"
92026-05-23T16:20:20.173ZINFOcrucible-agent (datafile): dataset is oxp_f324ec6b-47a6-4139-996e-b201e8759aa5/crucible/regions/b1862507-d97e-4a24-8b49-a43b503b8307
102026-05-23T16:20:20.179ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f324ec6b-47a6-4139-996e-b201e8759aa5/crucible/regions/b1862507-d97e-4a24-8b49-a43b503b8307@2a1776ea-5d7b-46a5-8ef7-e5156168e0eb
112026-05-23T16:20:20.179ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f324ec6b-47a6-4139-996e-b201e8759aa5/crucible/regions/b1862507-d97e-4a24-8b49-a43b503b8307", "2a1776ea-5d7b-46a5-8ef7-e5156168e0eb"]
122026-05-23T16:20:20.186ZINFOcrucible-agent (datafile): requesting running snapshot b1862507-d97e-4a24-8b49-a43b503b8307-2a1776ea-5d7b-46a5-8ef7-e5156168e0eb state: Requested
132026-05-23T16:20:20.189ZINFOcrucible-agent (dropshot): request completed latency_us = 21395 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:42464 req_id = 387ba192-162a-478d-b12b-87fd0bdd3bd6 response_code = 200 uri = /crucible/0/regions/b1862507-d97e-4a24-8b49-a43b503b8307/snapshots/2a1776ea-5d7b-46a5-8ef7-e5156168e0eb/run
142026-05-23T16:20:20.189ZINFOcrucible-agent (worker): applying SMF actions for region b1862507-d97e-4a24-8b49-a43b503b8307 running snapshot 2a1776ea-5d7b-46a5-8ef7-e5156168e0eb (state Requested)...
152026-05-23T16:20:20.197ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/b1862507-d97e-4a24-8b49-a43b503b8307
162026-05-23T16:20:20.197ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
172026-05-23T16:20:20.197ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
182026-05-23T16:20:20.197ZINFOcrucible-agent (worker): reconfig required
192026-05-23T16:20:20.197ZINFOcrucible-agent (worker): using existing config property group
202026-05-23T16:20:20.197ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b1862507-d97e-4a24-8b49-a43b503b8307
212026-05-23T16:20:20.198ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b1862507-d97e-4a24-8b49-a43b503b8307
222026-05-23T16:20:20.198ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
232026-05-23T16:20:20.198ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
242026-05-23T16:20:20.198ZINFOcrucible-agent (worker): commit
252026-05-23T16:20:20.203ZINFOcrucible-agent (worker): ok!
262026-05-23T16:20:20.203ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-b1862507-d97e-4a24-8b49-a43b503b8307-2a1776ea-5d7b-46a5-8ef7-e5156168e0eb
272026-05-23T16:20:20.210ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-b1862507-d97e-4a24-8b49-a43b503b8307-2a1776ea-5d7b-46a5-8ef7-e5156168e0eb
282026-05-23T16:20:20.217ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-b1862507-d97e-4a24-8b49-a43b503b8307-2a1776ea-5d7b-46a5-8ef7-e5156168e0eb
292026-05-23T16:20:20.217ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b1862507-d97e-4a24-8b49-a43b503b8307/.zfs/snapshot/2a1776ea-5d7b-46a5-8ef7-e5156168e0eb
302026-05-23T16:20:20.217ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
312026-05-23T16:20:20.217ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
322026-05-23T16:20:20.217ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
332026-05-23T16:20:20.217ZINFOcrucible-agent (worker): commit
342026-05-23T16:20:20.219ZINFOcrucible-agent (worker): ok!
352026-05-23T16:20:20.222ZINFOcrucible-agent (worker): SMF ok!
362026-05-23T16:20:20.222ZINFOcrucible-agent (datafile): region b1862507-d97e-4a24-8b49-a43b503b8307 running snapshot 2a1776ea-5d7b-46a5-8ef7-e5156168e0eb state: Requested -> Created
372026-05-23T16:20:20.503ZINFOcrucible-agent (datafile): path is "/data/regions/b1862507-d97e-4a24-8b49-a43b503b8307"
382026-05-23T16:20:20.509ZINFOcrucible-agent (datafile): dataset is oxp_f324ec6b-47a6-4139-996e-b201e8759aa5/crucible/regions/b1862507-d97e-4a24-8b49-a43b503b8307
392026-05-23T16:20:20.515ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f324ec6b-47a6-4139-996e-b201e8759aa5/crucible/regions/b1862507-d97e-4a24-8b49-a43b503b8307@2a1776ea-5d7b-46a5-8ef7-e5156168e0eb
402026-05-23T16:20:20.515ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f324ec6b-47a6-4139-996e-b201e8759aa5/crucible/regions/b1862507-d97e-4a24-8b49-a43b503b8307", "2a1776ea-5d7b-46a5-8ef7-e5156168e0eb"]
412026-05-23T16:20:20.521ZINFOcrucible-agent (dropshot): request completed latency_us = 18620 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:42464 req_id = e29ca6ff-e79f-4eb6-be56-23445baf2bb3 response_code = 200 uri = /crucible/0/regions/b1862507-d97e-4a24-8b49-a43b503b8307/snapshots/2a1776ea-5d7b-46a5-8ef7-e5156168e0eb/run