Max level shown:
12026-05-19T20:15:08.937ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:50846
22026-05-19T20:15:08.937ZINFOcrucible-agent (datafile): region bf9903a6-0553-42a0-b573-167d1f921259 state: Requested
32026-05-19T20:15:08.939ZINFOcrucible-agent (dropshot): request completed latency_us = 2292 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50846 req_id = 0d706401-bf42-4dd9-9916-8fd2ff66be78 response_code = 200 uri = /crucible/0/regions
42026-05-19T20:15:08.939ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-05-19T20:15:08.951ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_5d653a63-c398-4932-9454-a6f807060158/crucible/regions/bf9903a6-0553-42a0-b573-167d1f921259
62026-05-19T20:15:08.951ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_5d653a63-c398-4932-9454-a6f807060158/crucible/regions/bf9903a6-0553-42a0-b573-167d1f921259
72026-05-19T20:15:09.072ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50846 req_id = 4e1c6c9e-334f-4ad9-83aa-47a6d423eef9 response_code = 200 uri = /crucible/0/regions
82026-05-19T20:15:09.601ZINFOcrucible-agent (worker): creating region Region { id: RegionId("bf9903a6-0553-42a0-b573-167d1f921259"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/bf9903a6-0553-42a0-b573-167d1f921259" region = bf9903a6-0553-42a0-b573-167d1f921259
92026-05-19T20:15:09.601ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "bf9903a6-0553-42a0-b573-167d1f921259" "--data" "/data/regions/bf9903a6-0553-42a0-b573-167d1f921259" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = bf9903a6-0553-42a0-b573-167d1f921259
102026-05-19T20:15:09.627ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50846 req_id = f953985e-6b04-4684-a09a-8c3b3ad5c532 response_code = 200 uri = /crucible/0/regions
112026-05-19T20:15:09.747ZINFOcrucible-agent (worker): region files created ok region = bf9903a6-0553-42a0-b573-167d1f921259
122026-05-19T20:15:09.747ZINFOcrucible-agent (datafile): region bf9903a6-0553-42a0-b573-167d1f921259 state: Requested -> Created
132026-05-19T20:15:09.747ZINFOcrucible-agent (worker): applying SMF actions post create...
142026-05-19T20:15:09.767ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-bf9903a6-0553-42a0-b573-167d1f921259
152026-05-19T20:15:09.774ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-bf9903a6-0553-42a0-b573-167d1f921259
162026-05-19T20:15:09.788ZINFOcrucible-agent (worker): creating config property group
172026-05-19T20:15:09.791ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-bf9903a6-0553-42a0-b573-167d1f921259
182026-05-19T20:15:09.792ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bf9903a6-0553-42a0-b573-167d1f921259
192026-05-19T20:15:09.792ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
202026-05-19T20:15:09.792ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
212026-05-19T20:15:09.792ZINFOcrucible-agent (worker): commit
222026-05-19T20:15:09.795ZINFOcrucible-agent (worker): ok!
232026-05-19T20:15:09.801ZINFOcrucible-agent (worker): SMF ok!
242026-05-19T20:15:10.288ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50846 req_id = 404ebca0-6778-46dc-b0d3-d4b474246a0e response_code = 200 uri = /crucible/0/regions
252026-05-19T20:15:11.380ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:50846 req_id = 06138d9d-07e2-4050-946b-e20b339a8b0f response_code = 200 uri = /crucible/0/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6
262026-05-19T20:15:11.383ZINFOcrucible-agent (datafile): path is "/data/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6"
272026-05-19T20:15:11.389ZINFOcrucible-agent (datafile): dataset is oxp_5d653a63-c398-4932-9454-a6f807060158/crucible/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6
282026-05-19T20:15:11.395ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_5d653a63-c398-4932-9454-a6f807060158/crucible/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6@67819a7a-9ac6-41e3-9914-01e877dd2567
292026-05-19T20:15:11.395ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_5d653a63-c398-4932-9454-a6f807060158/crucible/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6", "67819a7a-9ac6-41e3-9914-01e877dd2567"]
302026-05-19T20:15:11.405ZINFOcrucible-agent (dropshot): request completed latency_us = 21807 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:50846 req_id = b4426ef0-5977-4a50-8c2a-f97f28c05921 response_code = 200 uri = /crucible/0/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6/snapshots/67819a7a-9ac6-41e3-9914-01e877dd2567
312026-05-19T20:15:11.408ZINFOcrucible-agent (datafile): path is "/data/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6"
322026-05-19T20:15:11.414ZINFOcrucible-agent (datafile): dataset is oxp_5d653a63-c398-4932-9454-a6f807060158/crucible/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6
332026-05-19T20:15:11.420ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_5d653a63-c398-4932-9454-a6f807060158/crucible/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6@67819a7a-9ac6-41e3-9914-01e877dd2567
342026-05-19T20:15:11.420ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_5d653a63-c398-4932-9454-a6f807060158/crucible/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6", "67819a7a-9ac6-41e3-9914-01e877dd2567"]
352026-05-19T20:15:11.427ZINFOcrucible-agent (datafile): requesting running snapshot 65d7e0c2-43f9-4b01-b02e-7d131a05dee6-67819a7a-9ac6-41e3-9914-01e877dd2567 state: Requested
362026-05-19T20:15:11.427ZINFOcrucible-agent (dropshot): request completed latency_us = 19711 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50846 req_id = 4507df48-7887-41d1-9e02-350cb74b15ab response_code = 200 uri = /crucible/0/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6/snapshots/67819a7a-9ac6-41e3-9914-01e877dd2567/run
372026-05-19T20:15:11.427ZINFOcrucible-agent (worker): applying SMF actions for region 65d7e0c2-43f9-4b01-b02e-7d131a05dee6 running snapshot 67819a7a-9ac6-41e3-9914-01e877dd2567 (state Requested)...
382026-05-19T20:15:11.432ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-65d7e0c2-43f9-4b01-b02e-7d131a05dee6-67819a7a-9ac6-41e3-9914-01e877dd2567
392026-05-19T20:15:11.438ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-65d7e0c2-43f9-4b01-b02e-7d131a05dee6-67819a7a-9ac6-41e3-9914-01e877dd2567
402026-05-19T20:15:11.448ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-65d7e0c2-43f9-4b01-b02e-7d131a05dee6-67819a7a-9ac6-41e3-9914-01e877dd2567
412026-05-19T20:15:11.448ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6/.zfs/snapshot/67819a7a-9ac6-41e3-9914-01e877dd2567
422026-05-19T20:15:11.448ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
432026-05-19T20:15:11.448ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442026-05-19T20:15:11.448ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
452026-05-19T20:15:11.449ZINFOcrucible-agent (worker): commit
462026-05-19T20:15:11.452ZINFOcrucible-agent (worker): ok!
472026-05-19T20:15:11.456ZINFOcrucible-agent (worker): SMF ok!
482026-05-19T20:15:11.456ZINFOcrucible-agent (datafile): region 65d7e0c2-43f9-4b01-b02e-7d131a05dee6 running snapshot 67819a7a-9ac6-41e3-9914-01e877dd2567 state: Requested -> Created
492026-05-19T20:15:11.628ZINFOcrucible-agent (datafile): path is "/data/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6"
502026-05-19T20:15:11.634ZINFOcrucible-agent (datafile): dataset is oxp_5d653a63-c398-4932-9454-a6f807060158/crucible/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6
512026-05-19T20:15:11.640ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_5d653a63-c398-4932-9454-a6f807060158/crucible/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6@67819a7a-9ac6-41e3-9914-01e877dd2567
522026-05-19T20:15:11.640ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_5d653a63-c398-4932-9454-a6f807060158/crucible/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6", "67819a7a-9ac6-41e3-9914-01e877dd2567"]
532026-05-19T20:15:11.646ZINFOcrucible-agent (dropshot): request completed latency_us = 18057 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50846 req_id = 5fedcaa7-2bc8-4468-93f7-4e7858e144b5 response_code = 200 uri = /crucible/0/regions/65d7e0c2-43f9-4b01-b02e-7d131a05dee6/snapshots/67819a7a-9ac6-41e3-9914-01e877dd2567/run