Max level shown:
12024-06-21T21:47:49.161ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:56164
22024-06-21T21:47:49.161ZINFOcrucible-agent (datafile): region 2263b071-4a84-4d0d-9aa6-ff3583365403 state: Requested
32024-06-21T21:47:49.162ZINFOcrucible-agent (dropshot): request completed latency_us = 698 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56164 req_id = 68ad62ad-214c-4e6c-abad-8cfa398164a6 response_code = 200 uri = /crucible/0/regions
42024-06-21T21:47:49.162ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52024-06-21T21:47:49.173ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8ce4d8fb-4017-46e3-ac55-3c40125a531b/crucible/regions/2263b071-4a84-4d0d-9aa6-ff3583365403
62024-06-21T21:47:49.173ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8ce4d8fb-4017-46e3-ac55-3c40125a531b/crucible/regions/2263b071-4a84-4d0d-9aa6-ff3583365403
72024-06-21T21:47:49.235ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2263b071-4a84-4d0d-9aa6-ff3583365403"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2263b071-4a84-4d0d-9aa6-ff3583365403" region = 2263b071-4a84-4d0d-9aa6-ff3583365403
82024-06-21T21:47:49.237ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2263b071-4a84-4d0d-9aa6-ff3583365403" "--data" "/data/regions/2263b071-4a84-4d0d-9aa6-ff3583365403" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2263b071-4a84-4d0d-9aa6-ff3583365403
92024-06-21T21:47:49.303ZINFOcrucible-agent (worker): region files created ok region = 2263b071-4a84-4d0d-9aa6-ff3583365403
102024-06-21T21:47:49.303ZINFOcrucible-agent (datafile): region 2263b071-4a84-4d0d-9aa6-ff3583365403 state: Requested -> Created
112024-06-21T21:47:49.303ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-06-21T21:47:49.304ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2263b071-4a84-4d0d-9aa6-ff3583365403
132024-06-21T21:47:49.309ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2263b071-4a84-4d0d-9aa6-ff3583365403
142024-06-21T21:47:49.323ZINFOcrucible-agent (worker): creating config property group
152024-06-21T21:47:49.326ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2263b071-4a84-4d0d-9aa6-ff3583365403
162024-06-21T21:47:49.327ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2263b071-4a84-4d0d-9aa6-ff3583365403
172024-06-21T21:47:49.327ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-06-21T21:47:49.327ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
192024-06-21T21:47:49.327ZINFOcrucible-agent (worker): commit
202024-06-21T21:47:49.331ZINFOcrucible-agent (worker): ok!
212024-06-21T21:47:49.337ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843
222024-06-21T21:47:49.338ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
232024-06-21T21:47:49.338ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::16
242024-06-21T21:47:49.338ZINFOcrucible-agent (worker): reconfig required
252024-06-21T21:47:49.338ZINFOcrucible-agent (worker): using existing config property group
262024-06-21T21:47:49.338ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9c49c180-1b0d-4b83-bcb9-e64a118a4843
272024-06-21T21:47:49.338ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843
282024-06-21T21:47:49.338ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-06-21T21:47:49.338ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
302024-06-21T21:47:49.338ZINFOcrucible-agent (worker): commit
312024-06-21T21:47:49.350ZINFOcrucible-agent (worker): ok!
322024-06-21T21:47:49.351ZINFOcrucible-agent (worker): SMF ok!
332024-06-21T21:47:49.495ZINFOcrucible-agent (dropshot): request completed latency_us = 112 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56164 req_id = 5727ac14-cc38-426e-9895-88544331d012 response_code = 200 uri = /crucible/0/regions
342024-06-21T21:47:50.037ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:38535
352024-06-21T21:47:50.042ZINFOcrucible-agent (dropshot): request completed latency_us = 2834 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:38535 req_id = 9a6d76dd-79b3-41b8-98dd-5c64e42f64df response_code = 200 uri = /crucible/0/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843
362024-06-21T21:47:50.043ZINFOcrucible-agent (datafile): path is "/data/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843"
372024-06-21T21:47:50.052ZINFOcrucible-agent (datafile): dataset is oxp_8ce4d8fb-4017-46e3-ac55-3c40125a531b/crucible/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843
382024-06-21T21:47:50.061ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8ce4d8fb-4017-46e3-ac55-3c40125a531b/crucible/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843@14b3da32-64d1-4e69-9e70-02ab88a313bd
392024-06-21T21:47:50.061ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8ce4d8fb-4017-46e3-ac55-3c40125a531b/crucible/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843", "14b3da32-64d1-4e69-9e70-02ab88a313bd"]
402024-06-21T21:47:50.075ZINFOcrucible-agent (dropshot): request completed latency_us = 32173 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:38535 req_id = 26a83d97-41e3-42c2-a47e-a390fc570051 response_code = 200 uri = /crucible/0/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843/snapshots/14b3da32-64d1-4e69-9e70-02ab88a313bd
412024-06-21T21:47:50.075ZINFOcrucible-agent (datafile): path is "/data/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843"
422024-06-21T21:47:50.083ZINFOcrucible-agent (datafile): dataset is oxp_8ce4d8fb-4017-46e3-ac55-3c40125a531b/crucible/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843
432024-06-21T21:47:50.091ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8ce4d8fb-4017-46e3-ac55-3c40125a531b/crucible/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843@14b3da32-64d1-4e69-9e70-02ab88a313bd
442024-06-21T21:47:50.091ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8ce4d8fb-4017-46e3-ac55-3c40125a531b/crucible/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843", "14b3da32-64d1-4e69-9e70-02ab88a313bd"]
452024-06-21T21:47:50.099ZINFOcrucible-agent (datafile): requesting running snapshot 9c49c180-1b0d-4b83-bcb9-e64a118a4843-14b3da32-64d1-4e69-9e70-02ab88a313bd state: Requested
462024-06-21T21:47:50.099ZINFOcrucible-agent (worker): applying SMF actions for region 9c49c180-1b0d-4b83-bcb9-e64a118a4843 running snapshot 14b3da32-64d1-4e69-9e70-02ab88a313bd (state Requested)...
472024-06-21T21:47:50.099ZINFOcrucible-agent (dropshot): request completed latency_us = 24063 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38535 req_id = d336a2e1-93c3-4964-9c01-032c2004ef43 response_code = 200 uri = /crucible/0/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843/snapshots/14b3da32-64d1-4e69-9e70-02ab88a313bd/run
482024-06-21T21:47:50.101ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843
492024-06-21T21:47:50.101ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
502024-06-21T21:47:50.101ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::16
512024-06-21T21:47:50.101ZINFOcrucible-agent (worker): reconfig required
522024-06-21T21:47:50.101ZINFOcrucible-agent (worker): using existing config property group
532024-06-21T21:47:50.101ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9c49c180-1b0d-4b83-bcb9-e64a118a4843
542024-06-21T21:47:50.101ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843
552024-06-21T21:47:50.101ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
562024-06-21T21:47:50.101ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
572024-06-21T21:47:50.101ZINFOcrucible-agent (worker): commit
582024-06-21T21:47:50.105ZINFOcrucible-agent (worker): ok!
592024-06-21T21:47:50.105ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-9c49c180-1b0d-4b83-bcb9-e64a118a4843-14b3da32-64d1-4e69-9e70-02ab88a313bd
602024-06-21T21:47:50.110ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-9c49c180-1b0d-4b83-bcb9-e64a118a4843-14b3da32-64d1-4e69-9e70-02ab88a313bd
612024-06-21T21:47:50.120ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-9c49c180-1b0d-4b83-bcb9-e64a118a4843-14b3da32-64d1-4e69-9e70-02ab88a313bd
622024-06-21T21:47:50.120ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9c49c180-1b0d-4b83-bcb9-e64a118a4843/.zfs/snapshot/14b3da32-64d1-4e69-9e70-02ab88a313bd
632024-06-21T21:47:50.120ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
642024-06-21T21:47:50.120ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
652024-06-21T21:47:50.120ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
662024-06-21T21:47:50.120ZINFOcrucible-agent (worker): commit
672024-06-21T21:47:50.124ZINFOcrucible-agent (worker): ok!
682024-06-21T21:47:50.128ZINFOcrucible-agent (worker): SMF ok!
692024-06-21T21:47:50.128ZINFOcrucible-agent (datafile): region 9c49c180-1b0d-4b83-bcb9-e64a118a4843 running snapshot 14b3da32-64d1-4e69-9e70-02ab88a313bd state: Requested -> Created