Max level shown:
1 [ Jul 15 19:54:09 Enabled. ]
2 [ Jul 15 19:54:09 Rereading configuration. ]
3 [ Jul 15 19:54:10 Rereading configuration. ]
4 [ Jul 15 19:54:12 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_baa85674-440a-42a0-8e73-5b3d3824ba07/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-07-15T19:54:12.307ZINFOcrucible-agent: dataset: "oxp_baa85674-440a-42a0-8e73-5b3d3824ba07/crucible"
72024-07-15T19:54:12.315ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
82024-07-15T19:54:12.315ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-07-15T19:54:12.340ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-07-15T19:54:12.463ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
112024-07-15T19:54:50.970ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:39550
122024-07-15T19:54:50.988ZINFOcrucible-agent (datafile): region d219159d-b079-4e2a-b22d-2ccee197af37 state: Requested
132024-07-15T19:54:51.003ZINFOcrucible-agent (dropshot): request completed latency_us = 22746 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39550 req_id = 8a059090-fa17-42c5-a6cc-a7d2a90aeada response_code = 200 uri = /crucible/0/regions
142024-07-15T19:54:51.004ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152024-07-15T19:54:51.015ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_baa85674-440a-42a0-8e73-5b3d3824ba07/crucible/regions/d219159d-b079-4e2a-b22d-2ccee197af37
162024-07-15T19:54:51.015ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_baa85674-440a-42a0-8e73-5b3d3824ba07/crucible/regions/d219159d-b079-4e2a-b22d-2ccee197af37
172024-07-15T19:54:51.193ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d219159d-b079-4e2a-b22d-2ccee197af37"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d219159d-b079-4e2a-b22d-2ccee197af37" region = d219159d-b079-4e2a-b22d-2ccee197af37
182024-07-15T19:54:51.195ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d219159d-b079-4e2a-b22d-2ccee197af37" "--data" "/data/regions/d219159d-b079-4e2a-b22d-2ccee197af37" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d219159d-b079-4e2a-b22d-2ccee197af37
192024-07-15T19:54:51.372ZINFOcrucible-agent (dropshot): request completed latency_us = 778 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39550 req_id = 37ad77fa-84fe-4579-a5a3-5a045fb3f3e0 response_code = 200 uri = /crucible/0/regions
202024-07-15T19:54:51.596ZINFOcrucible-agent (worker): region files created ok region = d219159d-b079-4e2a-b22d-2ccee197af37
212024-07-15T19:54:51.596ZINFOcrucible-agent (datafile): region d219159d-b079-4e2a-b22d-2ccee197af37 state: Requested -> Created
222024-07-15T19:54:51.596ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-07-15T19:54:51.597ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d219159d-b079-4e2a-b22d-2ccee197af37
242024-07-15T19:54:51.624ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d219159d-b079-4e2a-b22d-2ccee197af37
252024-07-15T19:54:51.673ZINFOcrucible-agent (worker): creating config property group
262024-07-15T19:54:51.686ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d219159d-b079-4e2a-b22d-2ccee197af37
272024-07-15T19:54:51.687ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d219159d-b079-4e2a-b22d-2ccee197af37
282024-07-15T19:54:51.691ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-07-15T19:54:51.691ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
302024-07-15T19:54:51.691ZINFOcrucible-agent (worker): commit
312024-07-15T19:54:51.727ZINFOcrucible-agent (worker): ok!
322024-07-15T19:54:51.811ZINFOcrucible-agent (worker): SMF ok!
332024-07-15T19:54:51.878ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39550 req_id = a0320f0a-411f-4e45-b74a-5739768c5a58 response_code = 200 uri = /crucible/0/regions
342024-07-15T20:00:00.211ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:63520
352024-07-15T20:00:00.214ZINFOcrucible-agent (dropshot): request completed latency_us = 3194 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63520 req_id = 5dbf2378-1b76-4ec3-bbf4-ca467b814f6a response_code = 200 uri = /crucible/0/regions/d219159d-b079-4e2a-b22d-2ccee197af37
362024-07-15T20:00:00.218ZINFOcrucible-agent (datafile): path is "/data/regions/d219159d-b079-4e2a-b22d-2ccee197af37"
372024-07-15T20:00:00.231ZINFOcrucible-agent (datafile): dataset is oxp_baa85674-440a-42a0-8e73-5b3d3824ba07/crucible/regions/d219159d-b079-4e2a-b22d-2ccee197af37
382024-07-15T20:00:00.244ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_baa85674-440a-42a0-8e73-5b3d3824ba07/crucible/regions/d219159d-b079-4e2a-b22d-2ccee197af37@960a2b67-7152-477d-a1d3-11128f024a61
392024-07-15T20:00:00.244ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_baa85674-440a-42a0-8e73-5b3d3824ba07/crucible/regions/d219159d-b079-4e2a-b22d-2ccee197af37", "960a2b67-7152-477d-a1d3-11128f024a61"]
402024-07-15T20:00:00.260ZINFOcrucible-agent (dropshot): request completed latency_us = 45224 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63520 req_id = a466990a-1bf0-4be9-8af1-318f7aba7c6c response_code = 200 uri = /crucible/0/regions/d219159d-b079-4e2a-b22d-2ccee197af37/snapshots/960a2b67-7152-477d-a1d3-11128f024a61
412024-07-15T20:00:00.260ZINFOcrucible-agent (datafile): path is "/data/regions/d219159d-b079-4e2a-b22d-2ccee197af37"
422024-07-15T20:00:00.273ZINFOcrucible-agent (datafile): dataset is oxp_baa85674-440a-42a0-8e73-5b3d3824ba07/crucible/regions/d219159d-b079-4e2a-b22d-2ccee197af37
432024-07-15T20:00:00.285ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_baa85674-440a-42a0-8e73-5b3d3824ba07/crucible/regions/d219159d-b079-4e2a-b22d-2ccee197af37@960a2b67-7152-477d-a1d3-11128f024a61
442024-07-15T20:00:00.285ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_baa85674-440a-42a0-8e73-5b3d3824ba07/crucible/regions/d219159d-b079-4e2a-b22d-2ccee197af37", "960a2b67-7152-477d-a1d3-11128f024a61"]
452024-07-15T20:00:00.299ZINFOcrucible-agent (datafile): requesting running snapshot d219159d-b079-4e2a-b22d-2ccee197af37-960a2b67-7152-477d-a1d3-11128f024a61 state: Requested
462024-07-15T20:00:00.300ZINFOcrucible-agent (worker): applying SMF actions for region d219159d-b079-4e2a-b22d-2ccee197af37 running snapshot 960a2b67-7152-477d-a1d3-11128f024a61 (state Requested)...
472024-07-15T20:00:00.300ZINFOcrucible-agent (dropshot): request completed latency_us = 39645 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63520 req_id = 4e3f9b1b-3de0-48e7-8a92-fab90200e6c3 response_code = 200 uri = /crucible/0/regions/d219159d-b079-4e2a-b22d-2ccee197af37/snapshots/960a2b67-7152-477d-a1d3-11128f024a61/run
482024-07-15T20:00:00.312ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/d219159d-b079-4e2a-b22d-2ccee197af37
492024-07-15T20:00:00.312ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
502024-07-15T20:00:00.313ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
512024-07-15T20:00:00.313ZINFOcrucible-agent (worker): reconfig required
522024-07-15T20:00:00.313ZINFOcrucible-agent (worker): using existing config property group
532024-07-15T20:00:00.313ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d219159d-b079-4e2a-b22d-2ccee197af37
542024-07-15T20:00:00.313ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d219159d-b079-4e2a-b22d-2ccee197af37
552024-07-15T20:00:00.313ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
562024-07-15T20:00:00.313ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
572024-07-15T20:00:00.313ZINFOcrucible-agent (worker): commit
582024-07-15T20:00:00.321ZINFOcrucible-agent (worker): ok!
592024-07-15T20:00:00.322ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-d219159d-b079-4e2a-b22d-2ccee197af37-960a2b67-7152-477d-a1d3-11128f024a61
602024-07-15T20:00:00.325ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-d219159d-b079-4e2a-b22d-2ccee197af37-960a2b67-7152-477d-a1d3-11128f024a61
612024-07-15T20:00:00.340ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-d219159d-b079-4e2a-b22d-2ccee197af37-960a2b67-7152-477d-a1d3-11128f024a61
622024-07-15T20:00:00.340ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d219159d-b079-4e2a-b22d-2ccee197af37/.zfs/snapshot/960a2b67-7152-477d-a1d3-11128f024a61
632024-07-15T20:00:00.340ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
642024-07-15T20:00:00.340ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
652024-07-15T20:00:00.340ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
662024-07-15T20:00:00.341ZINFOcrucible-agent (worker): commit
672024-07-15T20:00:00.345ZINFOcrucible-agent (worker): ok!
682024-07-15T20:00:00.350ZINFOcrucible-agent (worker): SMF ok!
692024-07-15T20:00:00.350ZINFOcrucible-agent (datafile): region d219159d-b079-4e2a-b22d-2ccee197af37 running snapshot 960a2b67-7152-477d-a1d3-11128f024a61 state: Requested -> Created