Max level shown:
12025-02-01T02:19:37.681ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::b]:32955
22025-02-01T02:19:37.681ZINFOcrucible-agent (datafile): region 74970fbc-40fb-402a-87e8-4268f327e03d state: Requested
32025-02-01T02:19:37.681ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-02-01T02:19:37.681ZINFOcrucible-agent (dropshot): request completed latency_us = 424 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:32955 req_id = abfdeebf-585e-4925-b362-509f5e182048 response_code = 200 uri = /crucible/0/regions
52025-02-01T02:19:37.697ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b531588a-3566-4399-8139-f6e67067de42/crucible/regions/74970fbc-40fb-402a-87e8-4268f327e03d
62025-02-01T02:19:37.697ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b531588a-3566-4399-8139-f6e67067de42/crucible/regions/74970fbc-40fb-402a-87e8-4268f327e03d
72025-02-01T02:19:37.761ZINFOcrucible-agent (worker): creating region Region { id: RegionId("74970fbc-40fb-402a-87e8-4268f327e03d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/74970fbc-40fb-402a-87e8-4268f327e03d" region = 74970fbc-40fb-402a-87e8-4268f327e03d
82025-02-01T02:19:37.761ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "74970fbc-40fb-402a-87e8-4268f327e03d" "--data" "/data/regions/74970fbc-40fb-402a-87e8-4268f327e03d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 74970fbc-40fb-402a-87e8-4268f327e03d
92025-02-01T02:19:37.862ZINFOcrucible-agent (worker): region files created ok region = 74970fbc-40fb-402a-87e8-4268f327e03d
102025-02-01T02:19:37.862ZINFOcrucible-agent (datafile): region 74970fbc-40fb-402a-87e8-4268f327e03d state: Requested -> Created
112025-02-01T02:19:37.862ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-02-01T02:19:37.870ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-74970fbc-40fb-402a-87e8-4268f327e03d
132025-02-01T02:19:37.879ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-74970fbc-40fb-402a-87e8-4268f327e03d
142025-02-01T02:19:37.887ZINFOcrucible-agent (worker): creating config property group
152025-02-01T02:19:37.889ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-74970fbc-40fb-402a-87e8-4268f327e03d
162025-02-01T02:19:37.890ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/74970fbc-40fb-402a-87e8-4268f327e03d
172025-02-01T02:19:37.890ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-02-01T02:19:37.890ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
192025-02-01T02:19:37.890ZINFOcrucible-agent (worker): commit
202025-02-01T02:19:37.893ZINFOcrucible-agent (worker): ok!
212025-02-01T02:19:37.898ZINFOcrucible-agent (worker): SMF ok!
222025-02-01T02:19:37.987ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:32955 req_id = be7e7c44-73e5-44f5-845f-871788108e23 response_code = 200 uri = /crucible/0/regions
232025-02-01T02:19:39.552ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:32955 req_id = 1df4f541-0b96-490f-b987-05362ddeb9dd response_code = 200 uri = /crucible/0/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e
242025-02-01T02:19:39.555ZINFOcrucible-agent (datafile): path is "/data/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e"
252025-02-01T02:19:39.564ZINFOcrucible-agent (datafile): dataset is oxp_b531588a-3566-4399-8139-f6e67067de42/crucible/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e
262025-02-01T02:19:39.573ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b531588a-3566-4399-8139-f6e67067de42/crucible/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e@e8038fc9-6011-4367-ba02-0c2bca20a680
272025-02-01T02:19:39.573ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b531588a-3566-4399-8139-f6e67067de42/crucible/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e", "e8038fc9-6011-4367-ba02-0c2bca20a680"]
282025-02-01T02:19:39.585ZINFOcrucible-agent (dropshot): request completed latency_us = 29946 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:32955 req_id = 96d8065e-2861-4743-a36f-4817ef692897 response_code = 200 uri = /crucible/0/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e/snapshots/e8038fc9-6011-4367-ba02-0c2bca20a680
292025-02-01T02:19:39.588ZINFOcrucible-agent (datafile): path is "/data/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e"
302025-02-01T02:19:39.597ZINFOcrucible-agent (datafile): dataset is oxp_b531588a-3566-4399-8139-f6e67067de42/crucible/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e
312025-02-01T02:19:39.605ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b531588a-3566-4399-8139-f6e67067de42/crucible/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e@e8038fc9-6011-4367-ba02-0c2bca20a680
322025-02-01T02:19:39.605ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b531588a-3566-4399-8139-f6e67067de42/crucible/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e", "e8038fc9-6011-4367-ba02-0c2bca20a680"]
332025-02-01T02:19:39.614ZINFOcrucible-agent (datafile): requesting running snapshot 12a8af30-44cd-45b3-9c2f-e8de1e7eee0e-e8038fc9-6011-4367-ba02-0c2bca20a680 state: Requested
342025-02-01T02:19:39.614ZINFOcrucible-agent (worker): applying SMF actions for region 12a8af30-44cd-45b3-9c2f-e8de1e7eee0e running snapshot e8038fc9-6011-4367-ba02-0c2bca20a680 (state Requested)...
352025-02-01T02:19:39.614ZINFOcrucible-agent (dropshot): request completed latency_us = 25600 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:32955 req_id = 89348107-1ddf-4f35-835c-f7f8ef7efd41 response_code = 200 uri = /crucible/0/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e/snapshots/e8038fc9-6011-4367-ba02-0c2bca20a680/run
362025-02-01T02:19:39.617ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-12a8af30-44cd-45b3-9c2f-e8de1e7eee0e-e8038fc9-6011-4367-ba02-0c2bca20a680
372025-02-01T02:19:39.620ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-12a8af30-44cd-45b3-9c2f-e8de1e7eee0e-e8038fc9-6011-4367-ba02-0c2bca20a680
382025-02-01T02:19:39.628ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-12a8af30-44cd-45b3-9c2f-e8de1e7eee0e-e8038fc9-6011-4367-ba02-0c2bca20a680
392025-02-01T02:19:39.629ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e/.zfs/snapshot/e8038fc9-6011-4367-ba02-0c2bca20a680
402025-02-01T02:19:39.629ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-02-01T02:19:39.629ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-02-01T02:19:39.629ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
432025-02-01T02:19:39.629ZINFOcrucible-agent (worker): commit
442025-02-01T02:19:39.632ZINFOcrucible-agent (worker): ok!
452025-02-01T02:19:39.636ZINFOcrucible-agent (worker): SMF ok!
462025-02-01T02:19:39.636ZINFOcrucible-agent (datafile): region 12a8af30-44cd-45b3-9c2f-e8de1e7eee0e running snapshot e8038fc9-6011-4367-ba02-0c2bca20a680 state: Requested -> Created
472025-02-01T02:19:39.876ZINFOcrucible-agent (datafile): path is "/data/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e"
482025-02-01T02:19:39.886ZINFOcrucible-agent (datafile): dataset is oxp_b531588a-3566-4399-8139-f6e67067de42/crucible/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e
492025-02-01T02:19:39.895ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b531588a-3566-4399-8139-f6e67067de42/crucible/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e@e8038fc9-6011-4367-ba02-0c2bca20a680
502025-02-01T02:19:39.895ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b531588a-3566-4399-8139-f6e67067de42/crucible/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e", "e8038fc9-6011-4367-ba02-0c2bca20a680"]
512025-02-01T02:19:39.904ZINFOcrucible-agent (dropshot): request completed latency_us = 27881 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:32955 req_id = 6bd389e3-57d6-4ec2-b480-bc7e2468bf3c response_code = 200 uri = /crucible/0/regions/12a8af30-44cd-45b3-9c2f-e8de1e7eee0e/snapshots/e8038fc9-6011-4367-ba02-0c2bca20a680/run