Max level shown:
12025-01-28T23:16:57.037ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:58812
22025-01-28T23:16:57.044ZINFOcrucible-agent (dropshot): request completed latency_us = 7294 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:58812 req_id = f96da07a-b689-4422-825c-f71bbe18d6a1 response_code = 200 uri = /crucible/0/regions/6f9751af-ca57-45a0-ace1-b9dce377c085
32025-01-28T23:16:57.048ZINFOcrucible-agent (datafile): path is "/data/regions/6f9751af-ca57-45a0-ace1-b9dce377c085"
42025-01-28T23:16:57.057ZINFOcrucible-agent (datafile): dataset is oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crucible/regions/6f9751af-ca57-45a0-ace1-b9dce377c085
52025-01-28T23:16:57.066ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crucible/regions/6f9751af-ca57-45a0-ace1-b9dce377c085@32a39717-ad54-4d49-b67c-49e50e569c98
62025-01-28T23:16:57.066ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crucible/regions/6f9751af-ca57-45a0-ace1-b9dce377c085", "32a39717-ad54-4d49-b67c-49e50e569c98"]
72025-01-28T23:16:57.089ZINFOcrucible-agent (dropshot): request completed latency_us = 41167 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:58812 req_id = 3a07066e-9adc-4371-9e79-612af23b8646 response_code = 200 uri = /crucible/0/regions/6f9751af-ca57-45a0-ace1-b9dce377c085/snapshots/32a39717-ad54-4d49-b67c-49e50e569c98
82025-01-28T23:16:57.093ZINFOcrucible-agent (datafile): path is "/data/regions/6f9751af-ca57-45a0-ace1-b9dce377c085"
92025-01-28T23:16:57.102ZINFOcrucible-agent (datafile): dataset is oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crucible/regions/6f9751af-ca57-45a0-ace1-b9dce377c085
102025-01-28T23:16:57.110ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crucible/regions/6f9751af-ca57-45a0-ace1-b9dce377c085@32a39717-ad54-4d49-b67c-49e50e569c98
112025-01-28T23:16:57.110ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crucible/regions/6f9751af-ca57-45a0-ace1-b9dce377c085", "32a39717-ad54-4d49-b67c-49e50e569c98"]
122025-01-28T23:16:57.119ZINFOcrucible-agent (datafile): requesting running snapshot 6f9751af-ca57-45a0-ace1-b9dce377c085-32a39717-ad54-4d49-b67c-49e50e569c98 state: Requested
132025-01-28T23:16:57.121ZINFOcrucible-agent (worker): applying SMF actions for region 6f9751af-ca57-45a0-ace1-b9dce377c085 running snapshot 32a39717-ad54-4d49-b67c-49e50e569c98 (state Requested)...
142025-01-28T23:16:57.121ZINFOcrucible-agent (dropshot): request completed latency_us = 27962 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58812 req_id = f2602ddc-7faf-4346-ba97-879599d52ffe response_code = 200 uri = /crucible/0/regions/6f9751af-ca57-45a0-ace1-b9dce377c085/snapshots/32a39717-ad54-4d49-b67c-49e50e569c98/run
152025-01-28T23:16:57.125ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/6f9751af-ca57-45a0-ace1-b9dce377c085
162025-01-28T23:16:57.125ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
172025-01-28T23:16:57.125ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::13
182025-01-28T23:16:57.125ZINFOcrucible-agent (worker): reconfig required
192025-01-28T23:16:57.125ZINFOcrucible-agent (worker): using existing config property group
202025-01-28T23:16:57.125ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6f9751af-ca57-45a0-ace1-b9dce377c085
212025-01-28T23:16:57.126ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6f9751af-ca57-45a0-ace1-b9dce377c085
222025-01-28T23:16:57.126ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
232025-01-28T23:16:57.126ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
242025-01-28T23:16:57.126ZINFOcrucible-agent (worker): commit
252025-01-28T23:16:57.140ZINFOcrucible-agent (worker): ok!
262025-01-28T23:16:57.141ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-6f9751af-ca57-45a0-ace1-b9dce377c085-32a39717-ad54-4d49-b67c-49e50e569c98
272025-01-28T23:16:57.154ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-6f9751af-ca57-45a0-ace1-b9dce377c085-32a39717-ad54-4d49-b67c-49e50e569c98
282025-01-28T23:16:57.184ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-6f9751af-ca57-45a0-ace1-b9dce377c085-32a39717-ad54-4d49-b67c-49e50e569c98
292025-01-28T23:16:57.184ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6f9751af-ca57-45a0-ace1-b9dce377c085/.zfs/snapshot/32a39717-ad54-4d49-b67c-49e50e569c98
302025-01-28T23:16:57.184ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
312025-01-28T23:16:57.184ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
322025-01-28T23:16:57.184ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
332025-01-28T23:16:57.185ZINFOcrucible-agent (worker): commit
342025-01-28T23:16:57.190ZINFOcrucible-agent (worker): ok!
352025-01-28T23:16:57.198ZINFOcrucible-agent (worker): SMF ok!
362025-01-28T23:16:57.198ZINFOcrucible-agent (datafile): region 6f9751af-ca57-45a0-ace1-b9dce377c085 running snapshot 32a39717-ad54-4d49-b67c-49e50e569c98 state: Requested -> Created
372025-01-28T23:16:57.321ZINFOcrucible-agent (datafile): path is "/data/regions/6f9751af-ca57-45a0-ace1-b9dce377c085"
382025-01-28T23:16:57.329ZINFOcrucible-agent (datafile): dataset is oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crucible/regions/6f9751af-ca57-45a0-ace1-b9dce377c085
392025-01-28T23:16:57.338ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crucible/regions/6f9751af-ca57-45a0-ace1-b9dce377c085@32a39717-ad54-4d49-b67c-49e50e569c98
402025-01-28T23:16:57.338ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crucible/regions/6f9751af-ca57-45a0-ace1-b9dce377c085", "32a39717-ad54-4d49-b67c-49e50e569c98"]
412025-01-28T23:16:57.347ZINFOcrucible-agent (dropshot): request completed latency_us = 26371 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58812 req_id = a84a6dca-01bc-4d36-bebb-c84e345f1039 response_code = 200 uri = /crucible/0/regions/6f9751af-ca57-45a0-ace1-b9dce377c085/snapshots/32a39717-ad54-4d49-b67c-49e50e569c98/run