Max level shown:
12026-02-24T00:47:36.285ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::b]:45298
22026-02-24T00:47:36.286ZINFOcrucible-agent (datafile): region 1e039a77-6408-4d10-97d2-763faf5485a4 state: Requested
32026-02-24T00:47:36.286ZINFOcrucible-agent (dropshot): request completed latency_us = 646 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45298 req_id = e900a2bc-b637-405e-ad60-3f85f596ca7a response_code = 200 uri = /crucible/0/regions
42026-02-24T00:47:36.286ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-02-24T00:47:36.295ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_068190f6-df3a-43f8-b589-e5c0aae5069d/crucible/regions/1e039a77-6408-4d10-97d2-763faf5485a4
62026-02-24T00:47:36.295ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_068190f6-df3a-43f8-b589-e5c0aae5069d/crucible/regions/1e039a77-6408-4d10-97d2-763faf5485a4
72026-02-24T00:47:36.371ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1e039a77-6408-4d10-97d2-763faf5485a4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1e039a77-6408-4d10-97d2-763faf5485a4" region = 1e039a77-6408-4d10-97d2-763faf5485a4
82026-02-24T00:47:36.371ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1e039a77-6408-4d10-97d2-763faf5485a4" "--data" "/data/regions/1e039a77-6408-4d10-97d2-763faf5485a4" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 1e039a77-6408-4d10-97d2-763faf5485a4
92026-02-24T00:47:36.444ZINFOcrucible-agent (worker): region files created ok region = 1e039a77-6408-4d10-97d2-763faf5485a4
102026-02-24T00:47:36.444ZINFOcrucible-agent (datafile): region 1e039a77-6408-4d10-97d2-763faf5485a4 state: Requested -> Created
112026-02-24T00:47:36.444ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-02-24T00:47:36.445ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1e039a77-6408-4d10-97d2-763faf5485a4
132026-02-24T00:47:36.459ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1e039a77-6408-4d10-97d2-763faf5485a4
142026-02-24T00:47:36.471ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45298 req_id = 5ded4506-7b9b-4edb-97f2-b4bc26d11536 response_code = 200 uri = /crucible/0/regions
152026-02-24T00:47:36.484ZINFOcrucible-agent (worker): creating config property group
162026-02-24T00:47:36.488ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1e039a77-6408-4d10-97d2-763faf5485a4
172026-02-24T00:47:36.488ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1e039a77-6408-4d10-97d2-763faf5485a4
182026-02-24T00:47:36.488ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-02-24T00:47:36.488ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202026-02-24T00:47:36.488ZINFOcrucible-agent (worker): commit
212026-02-24T00:47:36.493ZINFOcrucible-agent (worker): ok!
222026-02-24T00:47:36.508ZINFOcrucible-agent (worker): SMF ok!
232026-02-24T00:47:37.795ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45298 req_id = 92a50385-27e1-4a4f-8c72-d5a47779b1a0 response_code = 200 uri = /crucible/0/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0
242026-02-24T00:47:37.798ZINFOcrucible-agent (datafile): path is "/data/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0"
252026-02-24T00:47:37.804ZINFOcrucible-agent (datafile): dataset is oxp_068190f6-df3a-43f8-b589-e5c0aae5069d/crucible/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0
262026-02-24T00:47:37.811ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_068190f6-df3a-43f8-b589-e5c0aae5069d/crucible/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0@a687cd89-224e-4181-9816-c559b4698106
272026-02-24T00:47:37.811ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_068190f6-df3a-43f8-b589-e5c0aae5069d/crucible/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0", "a687cd89-224e-4181-9816-c559b4698106"]
282026-02-24T00:47:37.820ZINFOcrucible-agent (dropshot): request completed latency_us = 21489 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45298 req_id = 61c3f14e-eab7-45bf-aa9e-fb7741cc8746 response_code = 200 uri = /crucible/0/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0/snapshots/a687cd89-224e-4181-9816-c559b4698106
292026-02-24T00:47:37.823ZINFOcrucible-agent (datafile): path is "/data/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0"
302026-02-24T00:47:37.830ZINFOcrucible-agent (datafile): dataset is oxp_068190f6-df3a-43f8-b589-e5c0aae5069d/crucible/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0
312026-02-24T00:47:37.836ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_068190f6-df3a-43f8-b589-e5c0aae5069d/crucible/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0@a687cd89-224e-4181-9816-c559b4698106
322026-02-24T00:47:37.836ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_068190f6-df3a-43f8-b589-e5c0aae5069d/crucible/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0", "a687cd89-224e-4181-9816-c559b4698106"]
332026-02-24T00:47:37.844ZINFOcrucible-agent (datafile): requesting running snapshot cb29718f-3c29-4e31-85d2-ce546d7431b0-a687cd89-224e-4181-9816-c559b4698106 state: Requested
342026-02-24T00:47:37.844ZINFOcrucible-agent (dropshot): request completed latency_us = 20600 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45298 req_id = f4576928-b805-40c7-9a35-9206222a7346 response_code = 200 uri = /crucible/0/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0/snapshots/a687cd89-224e-4181-9816-c559b4698106/run
352026-02-24T00:47:37.844ZINFOcrucible-agent (worker): applying SMF actions for region cb29718f-3c29-4e31-85d2-ce546d7431b0 running snapshot a687cd89-224e-4181-9816-c559b4698106 (state Requested)...
362026-02-24T00:47:37.849ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-cb29718f-3c29-4e31-85d2-ce546d7431b0-a687cd89-224e-4181-9816-c559b4698106
372026-02-24T00:47:37.857ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-cb29718f-3c29-4e31-85d2-ce546d7431b0-a687cd89-224e-4181-9816-c559b4698106
382026-02-24T00:47:37.867ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-cb29718f-3c29-4e31-85d2-ce546d7431b0-a687cd89-224e-4181-9816-c559b4698106
392026-02-24T00:47:37.867ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0/.zfs/snapshot/a687cd89-224e-4181-9816-c559b4698106
402026-02-24T00:47:37.867ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-02-24T00:47:37.867ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-02-24T00:47:37.867ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
432026-02-24T00:47:37.867ZINFOcrucible-agent (worker): commit
442026-02-24T00:47:37.871ZINFOcrucible-agent (worker): ok!
452026-02-24T00:47:37.875ZINFOcrucible-agent (worker): SMF ok!
462026-02-24T00:47:37.875ZINFOcrucible-agent (datafile): region cb29718f-3c29-4e31-85d2-ce546d7431b0 running snapshot a687cd89-224e-4181-9816-c559b4698106 state: Requested -> Created
472026-02-24T00:47:38.197ZINFOcrucible-agent (datafile): path is "/data/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0"
482026-02-24T00:47:38.205ZINFOcrucible-agent (datafile): dataset is oxp_068190f6-df3a-43f8-b589-e5c0aae5069d/crucible/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0
492026-02-24T00:47:38.211ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_068190f6-df3a-43f8-b589-e5c0aae5069d/crucible/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0@a687cd89-224e-4181-9816-c559b4698106
502026-02-24T00:47:38.211ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_068190f6-df3a-43f8-b589-e5c0aae5069d/crucible/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0", "a687cd89-224e-4181-9816-c559b4698106"]
512026-02-24T00:47:38.221ZINFOcrucible-agent (dropshot): request completed latency_us = 23892 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45298 req_id = 89fd38e7-5820-44ed-86dd-e1e3496e3cbb response_code = 200 uri = /crucible/0/regions/cb29718f-3c29-4e31-85d2-ce546d7431b0/snapshots/a687cd89-224e-4181-9816-c559b4698106/run