Max level shown:
12024-09-25T17:31:31.208ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:35312
22024-09-25T17:31:31.209ZINFOcrucible-agent (datafile): region 01c599ce-6a6d-46a0-b1fb-49576e5840d7 state: Requested
32024-09-25T17:31:31.210ZINFOcrucible-agent (dropshot): request completed latency_us = 1416 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35312 req_id = 296fac2a-fc76-48aa-ac94-16ddd0e84a74 response_code = 200 uri = /crucible/0/regions
42024-09-25T17:31:31.210ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52024-09-25T17:31:31.221ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/01c599ce-6a6d-46a0-b1fb-49576e5840d7
62024-09-25T17:31:31.221ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/01c599ce-6a6d-46a0-b1fb-49576e5840d7
72024-09-25T17:31:31.292ZINFOcrucible-agent (worker): creating region Region { id: RegionId("01c599ce-6a6d-46a0-b1fb-49576e5840d7"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/01c599ce-6a6d-46a0-b1fb-49576e5840d7" region = 01c599ce-6a6d-46a0-b1fb-49576e5840d7
82024-09-25T17:31:31.294ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "01c599ce-6a6d-46a0-b1fb-49576e5840d7" "--data" "/data/regions/01c599ce-6a6d-46a0-b1fb-49576e5840d7" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 01c599ce-6a6d-46a0-b1fb-49576e5840d7
92024-09-25T17:31:31.357ZINFOcrucible-agent (worker): region files created ok region = 01c599ce-6a6d-46a0-b1fb-49576e5840d7
102024-09-25T17:31:31.357ZINFOcrucible-agent (datafile): region 01c599ce-6a6d-46a0-b1fb-49576e5840d7 state: Requested -> Created
112024-09-25T17:31:31.357ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-09-25T17:31:31.359ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-01c599ce-6a6d-46a0-b1fb-49576e5840d7
132024-09-25T17:31:31.368ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-01c599ce-6a6d-46a0-b1fb-49576e5840d7
142024-09-25T17:31:31.380ZINFOcrucible-agent (worker): creating config property group
152024-09-25T17:31:31.384ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-01c599ce-6a6d-46a0-b1fb-49576e5840d7
162024-09-25T17:31:31.384ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/01c599ce-6a6d-46a0-b1fb-49576e5840d7
172024-09-25T17:31:31.384ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-09-25T17:31:31.384ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192024-09-25T17:31:31.384ZINFOcrucible-agent (worker): commit
202024-09-25T17:31:31.388ZINFOcrucible-agent (worker): ok!
212024-09-25T17:31:31.394ZINFOcrucible-agent (worker): SMF ok!
222024-09-25T17:31:31.487ZINFOcrucible-agent (dropshot): request completed latency_us = 125 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35312 req_id = a68a154f-e47d-41d9-af03-ca5b630ec967 response_code = 200 uri = /crucible/0/regions
232024-09-25T17:31:32.712ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35312 req_id = 7d350902-335f-4410-a145-4f216915482c response_code = 200 uri = /crucible/0/regions/786adca2-2581-4274-8ed6-21e58a33089b
242024-09-25T17:31:32.716ZINFOcrucible-agent (datafile): path is "/data/regions/786adca2-2581-4274-8ed6-21e58a33089b"
252024-09-25T17:31:32.725ZINFOcrucible-agent (datafile): dataset is oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/786adca2-2581-4274-8ed6-21e58a33089b
262024-09-25T17:31:32.733ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/786adca2-2581-4274-8ed6-21e58a33089b@63c69f1a-b579-4f6f-aa85-a4d0208cd7ff
272024-09-25T17:31:32.733ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/786adca2-2581-4274-8ed6-21e58a33089b", "63c69f1a-b579-4f6f-aa85-a4d0208cd7ff"]
282024-09-25T17:31:32.743ZINFOcrucible-agent (dropshot): request completed latency_us = 26778 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35312 req_id = c65c28f1-8ed1-48e8-929e-e17601022787 response_code = 200 uri = /crucible/0/regions/786adca2-2581-4274-8ed6-21e58a33089b/snapshots/63c69f1a-b579-4f6f-aa85-a4d0208cd7ff
292024-09-25T17:31:32.746ZINFOcrucible-agent (datafile): path is "/data/regions/786adca2-2581-4274-8ed6-21e58a33089b"
302024-09-25T17:31:32.754ZINFOcrucible-agent (datafile): dataset is oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/786adca2-2581-4274-8ed6-21e58a33089b
312024-09-25T17:31:32.761ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/786adca2-2581-4274-8ed6-21e58a33089b@63c69f1a-b579-4f6f-aa85-a4d0208cd7ff
322024-09-25T17:31:32.761ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/786adca2-2581-4274-8ed6-21e58a33089b", "63c69f1a-b579-4f6f-aa85-a4d0208cd7ff"]
332024-09-25T17:31:32.769ZINFOcrucible-agent (datafile): requesting running snapshot 786adca2-2581-4274-8ed6-21e58a33089b-63c69f1a-b579-4f6f-aa85-a4d0208cd7ff state: Requested
342024-09-25T17:31:32.769ZINFOcrucible-agent (worker): applying SMF actions for region 786adca2-2581-4274-8ed6-21e58a33089b running snapshot 63c69f1a-b579-4f6f-aa85-a4d0208cd7ff (state Requested)...
352024-09-25T17:31:32.769ZINFOcrucible-agent (dropshot): request completed latency_us = 23043 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35312 req_id = d1da48b7-e8ef-4eb1-b545-b935a1365ac9 response_code = 200 uri = /crucible/0/regions/786adca2-2581-4274-8ed6-21e58a33089b/snapshots/63c69f1a-b579-4f6f-aa85-a4d0208cd7ff/run
362024-09-25T17:31:32.772ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-786adca2-2581-4274-8ed6-21e58a33089b-63c69f1a-b579-4f6f-aa85-a4d0208cd7ff
372024-09-25T17:31:32.776ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-786adca2-2581-4274-8ed6-21e58a33089b-63c69f1a-b579-4f6f-aa85-a4d0208cd7ff
382024-09-25T17:31:32.785ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-786adca2-2581-4274-8ed6-21e58a33089b-63c69f1a-b579-4f6f-aa85-a4d0208cd7ff
392024-09-25T17:31:32.785ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/786adca2-2581-4274-8ed6-21e58a33089b/.zfs/snapshot/63c69f1a-b579-4f6f-aa85-a4d0208cd7ff
402024-09-25T17:31:32.785ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412024-09-25T17:31:32.785ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422024-09-25T17:31:32.785ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
432024-09-25T17:31:32.785ZINFOcrucible-agent (worker): commit
442024-09-25T17:31:32.789ZINFOcrucible-agent (worker): ok!
452024-09-25T17:31:32.793ZINFOcrucible-agent (worker): SMF ok!
462024-09-25T17:31:32.793ZINFOcrucible-agent (datafile): region 786adca2-2581-4274-8ed6-21e58a33089b running snapshot 63c69f1a-b579-4f6f-aa85-a4d0208cd7ff state: Requested -> Created
472024-09-25T17:31:33.091ZINFOcrucible-agent (datafile): path is "/data/regions/786adca2-2581-4274-8ed6-21e58a33089b"
482024-09-25T17:31:33.100ZINFOcrucible-agent (datafile): dataset is oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/786adca2-2581-4274-8ed6-21e58a33089b
492024-09-25T17:31:33.108ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/786adca2-2581-4274-8ed6-21e58a33089b@63c69f1a-b579-4f6f-aa85-a4d0208cd7ff
502024-09-25T17:31:33.108ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fe3d10a1-f7bd-456b-9a54-72c3651a7862/crucible/regions/786adca2-2581-4274-8ed6-21e58a33089b", "63c69f1a-b579-4f6f-aa85-a4d0208cd7ff"]
512024-09-25T17:31:33.116ZINFOcrucible-agent (dropshot): request completed latency_us = 25297 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35312 req_id = 8925b2f5-d314-4e9c-ad0d-715dcbbca45f response_code = 200 uri = /crucible/0/regions/786adca2-2581-4274-8ed6-21e58a33089b/snapshots/63c69f1a-b579-4f6f-aa85-a4d0208cd7ff/run