Max level shown:
12025-02-23T14:23:27.280ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::b]:51783
22025-02-23T14:23:27.280ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:51783 req_id = 3cdecee9-8b81-4395-9941-0c5d001e049b response_code = 200 uri = /crucible/0/regions/380102d3-b239-4ba2-b0f9-815f57e74480
32025-02-23T14:23:27.287ZINFOcrucible-agent (datafile): path is "/data/regions/380102d3-b239-4ba2-b0f9-815f57e74480"
42025-02-23T14:23:27.297ZINFOcrucible-agent (datafile): dataset is oxp_52f008e5-42f0-4eff-9163-118834a02c2f/crucible/regions/380102d3-b239-4ba2-b0f9-815f57e74480
52025-02-23T14:23:27.305ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_52f008e5-42f0-4eff-9163-118834a02c2f/crucible/regions/380102d3-b239-4ba2-b0f9-815f57e74480@4c83e0f2-92e0-4900-9b63-6864604d712e
62025-02-23T14:23:27.305ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_52f008e5-42f0-4eff-9163-118834a02c2f/crucible/regions/380102d3-b239-4ba2-b0f9-815f57e74480", "4c83e0f2-92e0-4900-9b63-6864604d712e"]
72025-02-23T14:23:27.316ZINFOcrucible-agent (dropshot): request completed latency_us = 32394 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:51783 req_id = e52d1c5d-311f-4b97-aeb0-a951581ca36d response_code = 200 uri = /crucible/0/regions/380102d3-b239-4ba2-b0f9-815f57e74480/snapshots/4c83e0f2-92e0-4900-9b63-6864604d712e
82025-02-23T14:23:27.320ZINFOcrucible-agent (datafile): path is "/data/regions/380102d3-b239-4ba2-b0f9-815f57e74480"
92025-02-23T14:23:27.327ZINFOcrucible-agent (datafile): dataset is oxp_52f008e5-42f0-4eff-9163-118834a02c2f/crucible/regions/380102d3-b239-4ba2-b0f9-815f57e74480
102025-02-23T14:23:27.334ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_52f008e5-42f0-4eff-9163-118834a02c2f/crucible/regions/380102d3-b239-4ba2-b0f9-815f57e74480@4c83e0f2-92e0-4900-9b63-6864604d712e
112025-02-23T14:23:27.334ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_52f008e5-42f0-4eff-9163-118834a02c2f/crucible/regions/380102d3-b239-4ba2-b0f9-815f57e74480", "4c83e0f2-92e0-4900-9b63-6864604d712e"]
122025-02-23T14:23:27.342ZINFOcrucible-agent (datafile): requesting running snapshot 380102d3-b239-4ba2-b0f9-815f57e74480-4c83e0f2-92e0-4900-9b63-6864604d712e state: Requested
132025-02-23T14:23:27.343ZINFOcrucible-agent (worker): applying SMF actions for region 380102d3-b239-4ba2-b0f9-815f57e74480 running snapshot 4c83e0f2-92e0-4900-9b63-6864604d712e (state Requested)...
142025-02-23T14:23:27.343ZINFOcrucible-agent (dropshot): request completed latency_us = 23105 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:51783 req_id = 2d8eea2c-1f93-4161-b22d-0e43e1bdd5b4 response_code = 200 uri = /crucible/0/regions/380102d3-b239-4ba2-b0f9-815f57e74480/snapshots/4c83e0f2-92e0-4900-9b63-6864604d712e/run
152025-02-23T14:23:27.349ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/380102d3-b239-4ba2-b0f9-815f57e74480
162025-02-23T14:23:27.349ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
172025-02-23T14:23:27.349ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::19
182025-02-23T14:23:27.349ZINFOcrucible-agent (worker): reconfig required
192025-02-23T14:23:27.349ZINFOcrucible-agent (worker): using existing config property group
202025-02-23T14:23:27.349ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-380102d3-b239-4ba2-b0f9-815f57e74480
212025-02-23T14:23:27.349ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/380102d3-b239-4ba2-b0f9-815f57e74480
222025-02-23T14:23:27.349ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
232025-02-23T14:23:27.349ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
242025-02-23T14:23:27.349ZINFOcrucible-agent (worker): commit
252025-02-23T14:23:27.361ZINFOcrucible-agent (worker): ok!
262025-02-23T14:23:27.362ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-380102d3-b239-4ba2-b0f9-815f57e74480-4c83e0f2-92e0-4900-9b63-6864604d712e
272025-02-23T14:23:27.369ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-380102d3-b239-4ba2-b0f9-815f57e74480-4c83e0f2-92e0-4900-9b63-6864604d712e
282025-02-23T14:23:27.394ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-380102d3-b239-4ba2-b0f9-815f57e74480-4c83e0f2-92e0-4900-9b63-6864604d712e
292025-02-23T14:23:27.394ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/380102d3-b239-4ba2-b0f9-815f57e74480/.zfs/snapshot/4c83e0f2-92e0-4900-9b63-6864604d712e
302025-02-23T14:23:27.394ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
312025-02-23T14:23:27.394ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
322025-02-23T14:23:27.394ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
332025-02-23T14:23:27.394ZINFOcrucible-agent (worker): commit
342025-02-23T14:23:27.402ZINFOcrucible-agent (worker): ok!
352025-02-23T14:23:27.411ZINFOcrucible-agent (worker): SMF ok!
362025-02-23T14:23:27.411ZINFOcrucible-agent (datafile): region 380102d3-b239-4ba2-b0f9-815f57e74480 running snapshot 4c83e0f2-92e0-4900-9b63-6864604d712e state: Requested -> Created
372025-02-23T14:23:27.605ZINFOcrucible-agent (datafile): path is "/data/regions/380102d3-b239-4ba2-b0f9-815f57e74480"
382025-02-23T14:23:27.614ZINFOcrucible-agent (datafile): dataset is oxp_52f008e5-42f0-4eff-9163-118834a02c2f/crucible/regions/380102d3-b239-4ba2-b0f9-815f57e74480
392025-02-23T14:23:27.622ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_52f008e5-42f0-4eff-9163-118834a02c2f/crucible/regions/380102d3-b239-4ba2-b0f9-815f57e74480@4c83e0f2-92e0-4900-9b63-6864604d712e
402025-02-23T14:23:27.622ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_52f008e5-42f0-4eff-9163-118834a02c2f/crucible/regions/380102d3-b239-4ba2-b0f9-815f57e74480", "4c83e0f2-92e0-4900-9b63-6864604d712e"]
412025-02-23T14:23:27.630ZINFOcrucible-agent (dropshot): request completed latency_us = 25175 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:51783 req_id = 2d3da054-64cf-4e8a-bc93-f0dc46e09449 response_code = 200 uri = /crucible/0/regions/380102d3-b239-4ba2-b0f9-815f57e74480/snapshots/4c83e0f2-92e0-4900-9b63-6864604d712e/run