Max level shown:
12025-02-23T14:23:25.675ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::b]:34891
22025-02-23T14:23:25.675ZINFOcrucible-agent (datafile): region d35d5e73-e2a0-430e-8bc8-0b52c0484746 state: Requested
32025-02-23T14:23:25.677ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-02-23T14:23:25.677ZINFOcrucible-agent (dropshot): request completed latency_us = 2043 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:34891 req_id = 28ddf7d3-d639-49e5-99f8-06115db9c495 response_code = 200 uri = /crucible/0/regions
52025-02-23T14:23:25.700ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ee068547-8984-439c-b598-f02cc0127ab9/crucible/regions/d35d5e73-e2a0-430e-8bc8-0b52c0484746
62025-02-23T14:23:25.700ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ee068547-8984-439c-b598-f02cc0127ab9/crucible/regions/d35d5e73-e2a0-430e-8bc8-0b52c0484746
72025-02-23T14:23:25.757ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d35d5e73-e2a0-430e-8bc8-0b52c0484746"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d35d5e73-e2a0-430e-8bc8-0b52c0484746" region = d35d5e73-e2a0-430e-8bc8-0b52c0484746
82025-02-23T14:23:25.759ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d35d5e73-e2a0-430e-8bc8-0b52c0484746" "--data" "/data/regions/d35d5e73-e2a0-430e-8bc8-0b52c0484746" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d35d5e73-e2a0-430e-8bc8-0b52c0484746
92025-02-23T14:23:25.846ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:34891 req_id = 889c5e88-62f4-4435-afc1-376e7bcf65ac response_code = 200 uri = /crucible/0/regions
102025-02-23T14:23:25.899ZINFOcrucible-agent (worker): region files created ok region = d35d5e73-e2a0-430e-8bc8-0b52c0484746
112025-02-23T14:23:25.899ZINFOcrucible-agent (datafile): region d35d5e73-e2a0-430e-8bc8-0b52c0484746 state: Requested -> Created
122025-02-23T14:23:25.899ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-02-23T14:23:25.905ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d35d5e73-e2a0-430e-8bc8-0b52c0484746
142025-02-23T14:23:25.914ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d35d5e73-e2a0-430e-8bc8-0b52c0484746
152025-02-23T14:23:25.930ZINFOcrucible-agent (worker): creating config property group
162025-02-23T14:23:25.935ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d35d5e73-e2a0-430e-8bc8-0b52c0484746
172025-02-23T14:23:25.935ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d35d5e73-e2a0-430e-8bc8-0b52c0484746
182025-02-23T14:23:25.935ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-02-23T14:23:25.935ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
202025-02-23T14:23:25.935ZINFOcrucible-agent (worker): commit
212025-02-23T14:23:25.942ZINFOcrucible-agent (worker): ok!
222025-02-23T14:23:25.952ZINFOcrucible-agent (worker): SMF ok!
232025-02-23T14:23:26.469ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:34891 req_id = b903046a-6ad2-4d2a-a02f-9504171e0ea6 response_code = 200 uri = /crucible/0/regions
242025-02-23T14:23:27.648ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:34891 req_id = 344b599c-bf9d-4263-ae73-00c8bec6eff1 response_code = 200 uri = /crucible/0/regions/5faea10c-99a3-4c84-9c1e-536a91418802
252025-02-23T14:23:27.652ZINFOcrucible-agent (datafile): path is "/data/regions/5faea10c-99a3-4c84-9c1e-536a91418802"
262025-02-23T14:23:27.661ZINFOcrucible-agent (datafile): dataset is oxp_ee068547-8984-439c-b598-f02cc0127ab9/crucible/regions/5faea10c-99a3-4c84-9c1e-536a91418802
272025-02-23T14:23:27.669ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ee068547-8984-439c-b598-f02cc0127ab9/crucible/regions/5faea10c-99a3-4c84-9c1e-536a91418802@4c83e0f2-92e0-4900-9b63-6864604d712e
282025-02-23T14:23:27.669ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ee068547-8984-439c-b598-f02cc0127ab9/crucible/regions/5faea10c-99a3-4c84-9c1e-536a91418802", "4c83e0f2-92e0-4900-9b63-6864604d712e"]
292025-02-23T14:23:27.680ZINFOcrucible-agent (dropshot): request completed latency_us = 28567 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:34891 req_id = 2c53aba9-cf40-440a-99e4-3189f925bb35 response_code = 200 uri = /crucible/0/regions/5faea10c-99a3-4c84-9c1e-536a91418802/snapshots/4c83e0f2-92e0-4900-9b63-6864604d712e
302025-02-23T14:23:27.685ZINFOcrucible-agent (datafile): path is "/data/regions/5faea10c-99a3-4c84-9c1e-536a91418802"
312025-02-23T14:23:27.693ZINFOcrucible-agent (datafile): dataset is oxp_ee068547-8984-439c-b598-f02cc0127ab9/crucible/regions/5faea10c-99a3-4c84-9c1e-536a91418802
322025-02-23T14:23:27.701ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ee068547-8984-439c-b598-f02cc0127ab9/crucible/regions/5faea10c-99a3-4c84-9c1e-536a91418802@4c83e0f2-92e0-4900-9b63-6864604d712e
332025-02-23T14:23:27.701ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ee068547-8984-439c-b598-f02cc0127ab9/crucible/regions/5faea10c-99a3-4c84-9c1e-536a91418802", "4c83e0f2-92e0-4900-9b63-6864604d712e"]
342025-02-23T14:23:27.710ZINFOcrucible-agent (datafile): requesting running snapshot 5faea10c-99a3-4c84-9c1e-536a91418802-4c83e0f2-92e0-4900-9b63-6864604d712e state: Requested
352025-02-23T14:23:27.710ZINFOcrucible-agent (worker): applying SMF actions for region 5faea10c-99a3-4c84-9c1e-536a91418802 running snapshot 4c83e0f2-92e0-4900-9b63-6864604d712e (state Requested)...
362025-02-23T14:23:27.710ZINFOcrucible-agent (dropshot): request completed latency_us = 26039 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:34891 req_id = 951936ad-8b1a-4886-b11d-4714b31d0001 response_code = 200 uri = /crucible/0/regions/5faea10c-99a3-4c84-9c1e-536a91418802/snapshots/4c83e0f2-92e0-4900-9b63-6864604d712e/run
372025-02-23T14:23:27.713ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-5faea10c-99a3-4c84-9c1e-536a91418802-4c83e0f2-92e0-4900-9b63-6864604d712e
382025-02-23T14:23:27.722ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-5faea10c-99a3-4c84-9c1e-536a91418802-4c83e0f2-92e0-4900-9b63-6864604d712e
392025-02-23T14:23:27.747ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-5faea10c-99a3-4c84-9c1e-536a91418802-4c83e0f2-92e0-4900-9b63-6864604d712e
402025-02-23T14:23:27.747ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5faea10c-99a3-4c84-9c1e-536a91418802/.zfs/snapshot/4c83e0f2-92e0-4900-9b63-6864604d712e
412025-02-23T14:23:27.747ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422025-02-23T14:23:27.747ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432025-02-23T14:23:27.747ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
442025-02-23T14:23:27.747ZINFOcrucible-agent (worker): commit
452025-02-23T14:23:27.756ZINFOcrucible-agent (worker): ok!
462025-02-23T14:23:27.768ZINFOcrucible-agent (worker): SMF ok!
472025-02-23T14:23:27.768ZINFOcrucible-agent (datafile): region 5faea10c-99a3-4c84-9c1e-536a91418802 running snapshot 4c83e0f2-92e0-4900-9b63-6864604d712e state: Requested -> Created
482025-02-23T14:23:28.047ZINFOcrucible-agent (datafile): path is "/data/regions/5faea10c-99a3-4c84-9c1e-536a91418802"
492025-02-23T14:23:28.056ZINFOcrucible-agent (datafile): dataset is oxp_ee068547-8984-439c-b598-f02cc0127ab9/crucible/regions/5faea10c-99a3-4c84-9c1e-536a91418802
502025-02-23T14:23:28.064ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ee068547-8984-439c-b598-f02cc0127ab9/crucible/regions/5faea10c-99a3-4c84-9c1e-536a91418802@4c83e0f2-92e0-4900-9b63-6864604d712e
512025-02-23T14:23:28.064ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ee068547-8984-439c-b598-f02cc0127ab9/crucible/regions/5faea10c-99a3-4c84-9c1e-536a91418802", "4c83e0f2-92e0-4900-9b63-6864604d712e"]
522025-02-23T14:23:28.073ZINFOcrucible-agent (dropshot): request completed latency_us = 25762 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:34891 req_id = d7d4ee73-ac39-4708-803d-1fa8cc1fe09b response_code = 200 uri = /crucible/0/regions/5faea10c-99a3-4c84-9c1e-536a91418802/snapshots/4c83e0f2-92e0-4900-9b63-6864604d712e/run