Max level shown:
12025-11-06T23:32:21.378ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::b]:34895
22025-11-06T23:32:21.378ZINFOcrucible-agent (datafile): region 8bf98a30-53ee-4c92-9d34-5e4219a5e7e1 state: Requested
32025-11-06T23:32:21.378ZINFOcrucible-agent (dropshot): request completed latency_us = 613 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:34895 req_id = 3bb7f2be-bd6d-44d7-9098-44071a5a44a3 response_code = 200 uri = /crucible/0/regions
42025-11-06T23:32:21.378ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-11-06T23:32:21.386ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_dab3e035-1d0e-4d86-be0e-30f0ca33b8c0/crucible/regions/8bf98a30-53ee-4c92-9d34-5e4219a5e7e1
62025-11-06T23:32:21.386ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_dab3e035-1d0e-4d86-be0e-30f0ca33b8c0/crucible/regions/8bf98a30-53ee-4c92-9d34-5e4219a5e7e1
72025-11-06T23:32:21.433ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8bf98a30-53ee-4c92-9d34-5e4219a5e7e1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8bf98a30-53ee-4c92-9d34-5e4219a5e7e1" region = 8bf98a30-53ee-4c92-9d34-5e4219a5e7e1
82025-11-06T23:32:21.433ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8bf98a30-53ee-4c92-9d34-5e4219a5e7e1" "--data" "/data/regions/8bf98a30-53ee-4c92-9d34-5e4219a5e7e1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 8bf98a30-53ee-4c92-9d34-5e4219a5e7e1
92025-11-06T23:32:21.516ZINFOcrucible-agent (worker): region files created ok region = 8bf98a30-53ee-4c92-9d34-5e4219a5e7e1
102025-11-06T23:32:21.516ZINFOcrucible-agent (datafile): region 8bf98a30-53ee-4c92-9d34-5e4219a5e7e1 state: Requested -> Created
112025-11-06T23:32:21.516ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-11-06T23:32:21.535ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8bf98a30-53ee-4c92-9d34-5e4219a5e7e1
132025-11-06T23:32:21.547ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8bf98a30-53ee-4c92-9d34-5e4219a5e7e1
142025-11-06T23:32:21.557ZINFOcrucible-agent (worker): creating config property group
152025-11-06T23:32:21.559ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8bf98a30-53ee-4c92-9d34-5e4219a5e7e1
162025-11-06T23:32:21.560ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8bf98a30-53ee-4c92-9d34-5e4219a5e7e1
172025-11-06T23:32:21.560ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-11-06T23:32:21.560ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
192025-11-06T23:32:21.560ZINFOcrucible-agent (worker): commit
202025-11-06T23:32:21.563ZINFOcrucible-agent (worker): ok!
212025-11-06T23:32:21.568ZINFOcrucible-agent (worker): SMF ok!
222025-11-06T23:32:21.691ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:34895 req_id = dc465840-3db1-4dc9-86a5-c1074fcefd2b response_code = 200 uri = /crucible/0/regions
232025-11-06T23:32:23.482ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:34895 req_id = 7e497853-bf05-46d9-8a2f-b794761ab01c response_code = 200 uri = /crucible/0/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd
242025-11-06T23:32:23.485ZINFOcrucible-agent (datafile): path is "/data/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd"
252025-11-06T23:32:23.492ZINFOcrucible-agent (datafile): dataset is oxp_dab3e035-1d0e-4d86-be0e-30f0ca33b8c0/crucible/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd
262025-11-06T23:32:23.498ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_dab3e035-1d0e-4d86-be0e-30f0ca33b8c0/crucible/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd@5363e31b-f1c1-44bb-bba8-96d72fb141be
272025-11-06T23:32:23.498ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_dab3e035-1d0e-4d86-be0e-30f0ca33b8c0/crucible/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd", "5363e31b-f1c1-44bb-bba8-96d72fb141be"]
282025-11-06T23:32:23.506ZINFOcrucible-agent (dropshot): request completed latency_us = 20917 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:34895 req_id = 2d4e92a2-fc43-4345-af5e-514ab0992a14 response_code = 200 uri = /crucible/0/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd/snapshots/5363e31b-f1c1-44bb-bba8-96d72fb141be
292025-11-06T23:32:23.509ZINFOcrucible-agent (datafile): path is "/data/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd"
302025-11-06T23:32:23.515ZINFOcrucible-agent (datafile): dataset is oxp_dab3e035-1d0e-4d86-be0e-30f0ca33b8c0/crucible/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd
312025-11-06T23:32:23.519ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_dab3e035-1d0e-4d86-be0e-30f0ca33b8c0/crucible/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd@5363e31b-f1c1-44bb-bba8-96d72fb141be
322025-11-06T23:32:23.519ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_dab3e035-1d0e-4d86-be0e-30f0ca33b8c0/crucible/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd", "5363e31b-f1c1-44bb-bba8-96d72fb141be"]
332025-11-06T23:32:23.528ZINFOcrucible-agent (datafile): requesting running snapshot 641a01af-4e84-4c91-874b-e9b09c9c03dd-5363e31b-f1c1-44bb-bba8-96d72fb141be state: Requested
342025-11-06T23:32:23.528ZINFOcrucible-agent (dropshot): request completed latency_us = 19280 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:34895 req_id = 0e00bce3-0650-4998-a500-52b7e31ad7fe response_code = 200 uri = /crucible/0/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd/snapshots/5363e31b-f1c1-44bb-bba8-96d72fb141be/run
352025-11-06T23:32:23.529ZINFOcrucible-agent (worker): applying SMF actions for region 641a01af-4e84-4c91-874b-e9b09c9c03dd running snapshot 5363e31b-f1c1-44bb-bba8-96d72fb141be (state Requested)...
362025-11-06T23:32:23.534ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-641a01af-4e84-4c91-874b-e9b09c9c03dd-5363e31b-f1c1-44bb-bba8-96d72fb141be
372025-11-06T23:32:23.537ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-641a01af-4e84-4c91-874b-e9b09c9c03dd-5363e31b-f1c1-44bb-bba8-96d72fb141be
382025-11-06T23:32:23.546ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-641a01af-4e84-4c91-874b-e9b09c9c03dd-5363e31b-f1c1-44bb-bba8-96d72fb141be
392025-11-06T23:32:23.547ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd/.zfs/snapshot/5363e31b-f1c1-44bb-bba8-96d72fb141be
402025-11-06T23:32:23.547ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-11-06T23:32:23.547ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-11-06T23:32:23.547ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
432025-11-06T23:32:23.547ZINFOcrucible-agent (worker): commit
442025-11-06T23:32:23.551ZINFOcrucible-agent (worker): ok!
452025-11-06T23:32:23.555ZINFOcrucible-agent (worker): SMF ok!
462025-11-06T23:32:23.555ZINFOcrucible-agent (datafile): region 641a01af-4e84-4c91-874b-e9b09c9c03dd running snapshot 5363e31b-f1c1-44bb-bba8-96d72fb141be state: Requested -> Created
472025-11-06T23:32:23.798ZINFOcrucible-agent (datafile): path is "/data/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd"
482025-11-06T23:32:23.804ZINFOcrucible-agent (datafile): dataset is oxp_dab3e035-1d0e-4d86-be0e-30f0ca33b8c0/crucible/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd
492025-11-06T23:32:23.810ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_dab3e035-1d0e-4d86-be0e-30f0ca33b8c0/crucible/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd@5363e31b-f1c1-44bb-bba8-96d72fb141be
502025-11-06T23:32:23.810ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_dab3e035-1d0e-4d86-be0e-30f0ca33b8c0/crucible/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd", "5363e31b-f1c1-44bb-bba8-96d72fb141be"]
512025-11-06T23:32:23.817ZINFOcrucible-agent (dropshot): request completed latency_us = 18702 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:34895 req_id = 5e002314-6821-426d-b9f5-34383dd8944c response_code = 200 uri = /crucible/0/regions/641a01af-4e84-4c91-874b-e9b09c9c03dd/snapshots/5363e31b-f1c1-44bb-bba8-96d72fb141be/run