Max level shown:
12026-02-26T17:22:38.091ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::b]:45016
22026-02-26T17:22:38.091ZINFOcrucible-agent (datafile): region e148ea20-1aa9-4af1-b8a1-9a3d8200fb33 state: Requested
32026-02-26T17:22:38.092ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-02-26T17:22:38.092ZINFOcrucible-agent (dropshot): request completed latency_us = 994 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45016 req_id = c8a03727-293b-429e-ae99-9e1121a90f9d response_code = 200 uri = /crucible/0/regions
52026-02-26T17:22:38.103ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8fd0bb3d-a239-4ff7-b9e7-89f6d4e03205/crucible/regions/e148ea20-1aa9-4af1-b8a1-9a3d8200fb33
62026-02-26T17:22:38.103ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8fd0bb3d-a239-4ff7-b9e7-89f6d4e03205/crucible/regions/e148ea20-1aa9-4af1-b8a1-9a3d8200fb33
72026-02-26T17:22:38.166ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e148ea20-1aa9-4af1-b8a1-9a3d8200fb33"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e148ea20-1aa9-4af1-b8a1-9a3d8200fb33" region = e148ea20-1aa9-4af1-b8a1-9a3d8200fb33
82026-02-26T17:22:38.167ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e148ea20-1aa9-4af1-b8a1-9a3d8200fb33" "--data" "/data/regions/e148ea20-1aa9-4af1-b8a1-9a3d8200fb33" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e148ea20-1aa9-4af1-b8a1-9a3d8200fb33
92026-02-26T17:22:38.300ZINFOcrucible-agent (worker): region files created ok region = e148ea20-1aa9-4af1-b8a1-9a3d8200fb33
102026-02-26T17:22:38.300ZINFOcrucible-agent (datafile): region e148ea20-1aa9-4af1-b8a1-9a3d8200fb33 state: Requested -> Created
112026-02-26T17:22:38.301ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-02-26T17:22:38.324ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e148ea20-1aa9-4af1-b8a1-9a3d8200fb33
132026-02-26T17:22:38.341ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e148ea20-1aa9-4af1-b8a1-9a3d8200fb33
142026-02-26T17:22:38.342ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45016 req_id = d362ab03-3d74-4382-8450-01426ba33700 response_code = 200 uri = /crucible/0/regions
152026-02-26T17:22:38.365ZINFOcrucible-agent (worker): creating config property group
162026-02-26T17:22:38.371ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e148ea20-1aa9-4af1-b8a1-9a3d8200fb33
172026-02-26T17:22:38.372ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e148ea20-1aa9-4af1-b8a1-9a3d8200fb33
182026-02-26T17:22:38.372ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-02-26T17:22:38.372ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
202026-02-26T17:22:38.372ZINFOcrucible-agent (worker): commit
212026-02-26T17:22:38.376ZINFOcrucible-agent (worker): ok!
222026-02-26T17:22:38.382ZINFOcrucible-agent (worker): SMF ok!
232026-02-26T17:22:40.066ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45016 req_id = 0e00ffe1-698c-43c3-b50c-6042e149ab2a response_code = 200 uri = /crucible/0/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b
242026-02-26T17:22:40.070ZINFOcrucible-agent (datafile): path is "/data/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b"
252026-02-26T17:22:40.077ZINFOcrucible-agent (datafile): dataset is oxp_8fd0bb3d-a239-4ff7-b9e7-89f6d4e03205/crucible/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b
262026-02-26T17:22:40.083ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8fd0bb3d-a239-4ff7-b9e7-89f6d4e03205/crucible/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b@027eb217-6e32-42b8-8392-0bbba9fd1ef4
272026-02-26T17:22:40.083ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8fd0bb3d-a239-4ff7-b9e7-89f6d4e03205/crucible/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b", "027eb217-6e32-42b8-8392-0bbba9fd1ef4"]
282026-02-26T17:22:40.092ZINFOcrucible-agent (dropshot): request completed latency_us = 21920 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45016 req_id = bba4db58-91be-4f85-a4db-8022da4719c6 response_code = 200 uri = /crucible/0/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b/snapshots/027eb217-6e32-42b8-8392-0bbba9fd1ef4
292026-02-26T17:22:40.095ZINFOcrucible-agent (datafile): path is "/data/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b"
302026-02-26T17:22:40.101ZINFOcrucible-agent (datafile): dataset is oxp_8fd0bb3d-a239-4ff7-b9e7-89f6d4e03205/crucible/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b
312026-02-26T17:22:40.106ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8fd0bb3d-a239-4ff7-b9e7-89f6d4e03205/crucible/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b@027eb217-6e32-42b8-8392-0bbba9fd1ef4
322026-02-26T17:22:40.106ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8fd0bb3d-a239-4ff7-b9e7-89f6d4e03205/crucible/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b", "027eb217-6e32-42b8-8392-0bbba9fd1ef4"]
332026-02-26T17:22:40.113ZINFOcrucible-agent (datafile): requesting running snapshot 5e510003-38f8-4051-b168-a3f3c4c11c1b-027eb217-6e32-42b8-8392-0bbba9fd1ef4 state: Requested
342026-02-26T17:22:40.113ZINFOcrucible-agent (worker): applying SMF actions for region 5e510003-38f8-4051-b168-a3f3c4c11c1b running snapshot 027eb217-6e32-42b8-8392-0bbba9fd1ef4 (state Requested)...
352026-02-26T17:22:40.114ZINFOcrucible-agent (dropshot): request completed latency_us = 18224 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45016 req_id = 96934f70-b8d9-4f81-9507-786601c067ef response_code = 200 uri = /crucible/0/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b/snapshots/027eb217-6e32-42b8-8392-0bbba9fd1ef4/run
362026-02-26T17:22:40.119ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-5e510003-38f8-4051-b168-a3f3c4c11c1b-027eb217-6e32-42b8-8392-0bbba9fd1ef4
372026-02-26T17:22:40.130ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-5e510003-38f8-4051-b168-a3f3c4c11c1b-027eb217-6e32-42b8-8392-0bbba9fd1ef4
382026-02-26T17:22:40.147ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-5e510003-38f8-4051-b168-a3f3c4c11c1b-027eb217-6e32-42b8-8392-0bbba9fd1ef4
392026-02-26T17:22:40.148ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b/.zfs/snapshot/027eb217-6e32-42b8-8392-0bbba9fd1ef4
402026-02-26T17:22:40.148ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-02-26T17:22:40.148ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-02-26T17:22:40.148ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
432026-02-26T17:22:40.148ZINFOcrucible-agent (worker): commit
442026-02-26T17:22:40.157ZINFOcrucible-agent (worker): ok!
452026-02-26T17:22:40.162ZINFOcrucible-agent (worker): SMF ok!
462026-02-26T17:22:40.162ZINFOcrucible-agent (datafile): region 5e510003-38f8-4051-b168-a3f3c4c11c1b running snapshot 027eb217-6e32-42b8-8392-0bbba9fd1ef4 state: Requested -> Created
472026-02-26T17:22:40.300ZINFOcrucible-agent (datafile): path is "/data/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b"
482026-02-26T17:22:40.307ZINFOcrucible-agent (datafile): dataset is oxp_8fd0bb3d-a239-4ff7-b9e7-89f6d4e03205/crucible/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b
492026-02-26T17:22:40.312ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8fd0bb3d-a239-4ff7-b9e7-89f6d4e03205/crucible/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b@027eb217-6e32-42b8-8392-0bbba9fd1ef4
502026-02-26T17:22:40.312ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8fd0bb3d-a239-4ff7-b9e7-89f6d4e03205/crucible/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b", "027eb217-6e32-42b8-8392-0bbba9fd1ef4"]
512026-02-26T17:22:40.316ZINFOcrucible-agent (dropshot): request completed latency_us = 16354 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45016 req_id = 8f47551e-931a-4aa7-aedc-ecec4ace45fb response_code = 200 uri = /crucible/0/regions/5e510003-38f8-4051-b168-a3f3c4c11c1b/snapshots/027eb217-6e32-42b8-8392-0bbba9fd1ef4/run