Max level shown:
1 [ Jul 13 05:35:50 Enabled. ]
2 [ Jul 13 05:35:50 Rereading configuration. ]
3 [ Jul 13 05:35:53 Rereading configuration. ]
4 [ Jul 13 05:35:56 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_432cab0a-05d9-4bcc-bc2f-da40b04b5f48/crucible -l [fd00:1122:3344:101::15]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-07-13T05:35:56.305ZINFOcrucible-agent: dataset: "oxp_432cab0a-05d9-4bcc-bc2f-da40b04b5f48/crucible"
72024-07-13T05:35:56.310ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::15]:32345
82024-07-13T05:35:56.310ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-07-13T05:35:56.329ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-07-13T05:35:56.579ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::15]:32345
112024-07-13T05:37:10.760ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:40947
122024-07-13T05:37:10.780ZINFOcrucible-agent (datafile): region 0400f9fa-d869-45de-a7ab-01f868a52ab9 state: Requested
132024-07-13T05:37:10.787ZINFOcrucible-agent (dropshot): request completed latency_us = 15183 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40947 req_id = 24e96ce9-5a10-4370-bb98-99607884e71d response_code = 200 uri = /crucible/0/regions
142024-07-13T05:37:10.787ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152024-07-13T05:37:10.799ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_432cab0a-05d9-4bcc-bc2f-da40b04b5f48/crucible/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9
162024-07-13T05:37:10.799ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_432cab0a-05d9-4bcc-bc2f-da40b04b5f48/crucible/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9
172024-07-13T05:37:10.871ZINFOcrucible-agent (worker): creating region Region { id: RegionId("0400f9fa-d869-45de-a7ab-01f868a52ab9"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9" region = 0400f9fa-d869-45de-a7ab-01f868a52ab9
182024-07-13T05:37:10.873ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "0400f9fa-d869-45de-a7ab-01f868a52ab9" "--data" "/data/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 0400f9fa-d869-45de-a7ab-01f868a52ab9
192024-07-13T05:37:11.011ZINFOcrucible-agent (worker): region files created ok region = 0400f9fa-d869-45de-a7ab-01f868a52ab9
202024-07-13T05:37:11.011ZINFOcrucible-agent (datafile): region 0400f9fa-d869-45de-a7ab-01f868a52ab9 state: Requested -> Created
212024-07-13T05:37:11.011ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-07-13T05:37:11.012ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-0400f9fa-d869-45de-a7ab-01f868a52ab9
232024-07-13T05:37:11.019ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-0400f9fa-d869-45de-a7ab-01f868a52ab9
242024-07-13T05:37:11.037ZINFOcrucible-agent (worker): creating config property group
252024-07-13T05:37:11.040ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-0400f9fa-d869-45de-a7ab-01f868a52ab9
262024-07-13T05:37:11.041ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9
272024-07-13T05:37:11.045ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-07-13T05:37:11.045ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
292024-07-13T05:37:11.045ZINFOcrucible-agent (worker): commit
302024-07-13T05:37:11.051ZINFOcrucible-agent (dropshot): request completed latency_us = 603 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40947 req_id = 7d1a2f6a-e657-44c8-8112-cb08a942ede9 response_code = 200 uri = /crucible/0/regions
312024-07-13T05:37:11.053ZINFOcrucible-agent (worker): ok!
322024-07-13T05:37:11.061ZINFOcrucible-agent (worker): SMF ok!
332024-07-13T05:42:29.140ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:35587
342024-07-13T05:42:29.145ZINFOcrucible-agent (dropshot): request completed latency_us = 5131 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35587 req_id = c64109e5-3bf2-4d51-9226-190d23e0b3ef response_code = 200 uri = /crucible/0/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9
352024-07-13T05:42:29.149ZINFOcrucible-agent (datafile): path is "/data/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9"
362024-07-13T05:42:29.158ZINFOcrucible-agent (datafile): dataset is oxp_432cab0a-05d9-4bcc-bc2f-da40b04b5f48/crucible/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9
372024-07-13T05:42:29.166ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_432cab0a-05d9-4bcc-bc2f-da40b04b5f48/crucible/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9@5d2d3acf-ae8e-42b2-be21-a0630b25a89a
382024-07-13T05:42:29.166ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_432cab0a-05d9-4bcc-bc2f-da40b04b5f48/crucible/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9", "5d2d3acf-ae8e-42b2-be21-a0630b25a89a"]
392024-07-13T05:42:29.177ZINFOcrucible-agent (dropshot): request completed latency_us = 31968 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35587 req_id = 08b84126-841c-426c-a205-6123b9c529d7 response_code = 200 uri = /crucible/0/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9/snapshots/5d2d3acf-ae8e-42b2-be21-a0630b25a89a
402024-07-13T05:42:29.178ZINFOcrucible-agent (datafile): path is "/data/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9"
412024-07-13T05:42:29.185ZINFOcrucible-agent (datafile): dataset is oxp_432cab0a-05d9-4bcc-bc2f-da40b04b5f48/crucible/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9
422024-07-13T05:42:29.194ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_432cab0a-05d9-4bcc-bc2f-da40b04b5f48/crucible/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9@5d2d3acf-ae8e-42b2-be21-a0630b25a89a
432024-07-13T05:42:29.194ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_432cab0a-05d9-4bcc-bc2f-da40b04b5f48/crucible/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9", "5d2d3acf-ae8e-42b2-be21-a0630b25a89a"]
442024-07-13T05:42:29.204ZINFOcrucible-agent (datafile): requesting running snapshot 0400f9fa-d869-45de-a7ab-01f868a52ab9-5d2d3acf-ae8e-42b2-be21-a0630b25a89a state: Requested
452024-07-13T05:42:29.205ZINFOcrucible-agent (worker): applying SMF actions for region 0400f9fa-d869-45de-a7ab-01f868a52ab9 running snapshot 5d2d3acf-ae8e-42b2-be21-a0630b25a89a (state Requested)...
462024-07-13T05:42:29.205ZINFOcrucible-agent (dropshot): request completed latency_us = 26959 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35587 req_id = bff97f74-a4f6-4443-94c0-e27c7ded3d80 response_code = 200 uri = /crucible/0/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9/snapshots/5d2d3acf-ae8e-42b2-be21-a0630b25a89a/run
472024-07-13T05:42:29.219ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9
482024-07-13T05:42:29.219ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
492024-07-13T05:42:29.219ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::15
502024-07-13T05:42:29.219ZINFOcrucible-agent (worker): reconfig required
512024-07-13T05:42:29.219ZINFOcrucible-agent (worker): using existing config property group
522024-07-13T05:42:29.219ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-0400f9fa-d869-45de-a7ab-01f868a52ab9
532024-07-13T05:42:29.219ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9
542024-07-13T05:42:29.219ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
552024-07-13T05:42:29.219ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
562024-07-13T05:42:29.219ZINFOcrucible-agent (worker): commit
572024-07-13T05:42:29.231ZINFOcrucible-agent (worker): ok!
582024-07-13T05:42:29.232ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-0400f9fa-d869-45de-a7ab-01f868a52ab9-5d2d3acf-ae8e-42b2-be21-a0630b25a89a
592024-07-13T05:42:29.237ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-0400f9fa-d869-45de-a7ab-01f868a52ab9-5d2d3acf-ae8e-42b2-be21-a0630b25a89a
602024-07-13T05:42:29.263ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-0400f9fa-d869-45de-a7ab-01f868a52ab9-5d2d3acf-ae8e-42b2-be21-a0630b25a89a
612024-07-13T05:42:29.263ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0400f9fa-d869-45de-a7ab-01f868a52ab9/.zfs/snapshot/5d2d3acf-ae8e-42b2-be21-a0630b25a89a
622024-07-13T05:42:29.264ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
632024-07-13T05:42:29.264ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
642024-07-13T05:42:29.264ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
652024-07-13T05:42:29.264ZINFOcrucible-agent (worker): commit
662024-07-13T05:42:29.271ZINFOcrucible-agent (worker): ok!
672024-07-13T05:42:29.277ZINFOcrucible-agent (worker): SMF ok!
682024-07-13T05:42:29.277ZINFOcrucible-agent (datafile): region 0400f9fa-d869-45de-a7ab-01f868a52ab9 running snapshot 5d2d3acf-ae8e-42b2-be21-a0630b25a89a state: Requested -> Created