Max level shown:
12026-01-31T02:55:36.662ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:48453
22026-01-31T02:55:36.663ZINFOcrucible-agent (datafile): region 3c9eeb19-9051-4670-ba46-1c55ea1b5478 state: Requested
32026-01-31T02:55:36.663ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-01-31T02:55:36.663ZINFOcrucible-agent (dropshot): request completed latency_us = 678 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48453 req_id = 407c8b9a-1fe0-4519-a524-be9c7e997e0b response_code = 200 uri = /crucible/0/regions
52026-01-31T02:55:36.673ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f7848ecd-0094-454b-b92e-0d864cdfd2e2/crucible/regions/3c9eeb19-9051-4670-ba46-1c55ea1b5478
62026-01-31T02:55:36.673ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f7848ecd-0094-454b-b92e-0d864cdfd2e2/crucible/regions/3c9eeb19-9051-4670-ba46-1c55ea1b5478
72026-01-31T02:55:36.722ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3c9eeb19-9051-4670-ba46-1c55ea1b5478"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3c9eeb19-9051-4670-ba46-1c55ea1b5478" region = 3c9eeb19-9051-4670-ba46-1c55ea1b5478
82026-01-31T02:55:36.722ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3c9eeb19-9051-4670-ba46-1c55ea1b5478" "--data" "/data/regions/3c9eeb19-9051-4670-ba46-1c55ea1b5478" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3c9eeb19-9051-4670-ba46-1c55ea1b5478
92026-01-31T02:55:36.795ZINFOcrucible-agent (worker): region files created ok region = 3c9eeb19-9051-4670-ba46-1c55ea1b5478
102026-01-31T02:55:36.795ZINFOcrucible-agent (datafile): region 3c9eeb19-9051-4670-ba46-1c55ea1b5478 state: Requested -> Created
112026-01-31T02:55:36.795ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-01-31T02:55:36.795ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3c9eeb19-9051-4670-ba46-1c55ea1b5478
132026-01-31T02:55:36.804ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3c9eeb19-9051-4670-ba46-1c55ea1b5478
142026-01-31T02:55:36.826ZINFOcrucible-agent (worker): creating config property group
152026-01-31T02:55:36.829ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3c9eeb19-9051-4670-ba46-1c55ea1b5478
162026-01-31T02:55:36.829ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3c9eeb19-9051-4670-ba46-1c55ea1b5478
172026-01-31T02:55:36.829ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-01-31T02:55:36.830ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
192026-01-31T02:55:36.830ZINFOcrucible-agent (worker): commit
202026-01-31T02:55:36.833ZINFOcrucible-agent (worker): ok!
212026-01-31T02:55:36.851ZINFOcrucible-agent (worker): SMF ok!
222026-01-31T02:55:36.947ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48453 req_id = 3b4d1b4c-0d8d-4bc6-ab63-3100e50bb80a response_code = 200 uri = /crucible/0/regions
232026-01-31T02:55:37.686ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48453 req_id = f74c7d19-7aae-4634-84fe-051af9710455 response_code = 200 uri = /crucible/0/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5
242026-01-31T02:55:37.689ZINFOcrucible-agent (datafile): path is "/data/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5"
252026-01-31T02:55:37.696ZINFOcrucible-agent (datafile): dataset is oxp_f7848ecd-0094-454b-b92e-0d864cdfd2e2/crucible/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5
262026-01-31T02:55:37.702ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f7848ecd-0094-454b-b92e-0d864cdfd2e2/crucible/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5@8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8
272026-01-31T02:55:37.702ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f7848ecd-0094-454b-b92e-0d864cdfd2e2/crucible/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5", "8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8"]
282026-01-31T02:55:37.712ZINFOcrucible-agent (dropshot): request completed latency_us = 22528 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48453 req_id = c08da8fd-3682-4d31-b4d9-e5b30591a762 response_code = 200 uri = /crucible/0/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5/snapshots/8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8
292026-01-31T02:55:37.715ZINFOcrucible-agent (datafile): path is "/data/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5"
302026-01-31T02:55:37.720ZINFOcrucible-agent (datafile): dataset is oxp_f7848ecd-0094-454b-b92e-0d864cdfd2e2/crucible/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5
312026-01-31T02:55:37.727ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f7848ecd-0094-454b-b92e-0d864cdfd2e2/crucible/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5@8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8
322026-01-31T02:55:37.727ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f7848ecd-0094-454b-b92e-0d864cdfd2e2/crucible/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5", "8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8"]
332026-01-31T02:55:37.735ZINFOcrucible-agent (datafile): requesting running snapshot 8bea09d8-e04d-4c69-88de-f560ede4f0c5-8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8 state: Requested
342026-01-31T02:55:37.735ZINFOcrucible-agent (worker): applying SMF actions for region 8bea09d8-e04d-4c69-88de-f560ede4f0c5 running snapshot 8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8 (state Requested)...
352026-01-31T02:55:37.735ZINFOcrucible-agent (dropshot): request completed latency_us = 19973 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48453 req_id = 2158955a-cc6b-4be5-bb41-3509c5f0929c response_code = 200 uri = /crucible/0/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5/snapshots/8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8/run
362026-01-31T02:55:37.739ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-8bea09d8-e04d-4c69-88de-f560ede4f0c5-8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8
372026-01-31T02:55:37.749ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-8bea09d8-e04d-4c69-88de-f560ede4f0c5-8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8
382026-01-31T02:55:37.759ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-8bea09d8-e04d-4c69-88de-f560ede4f0c5-8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8
392026-01-31T02:55:37.759ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5/.zfs/snapshot/8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8
402026-01-31T02:55:37.759ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-01-31T02:55:37.759ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-01-31T02:55:37.759ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
432026-01-31T02:55:37.759ZINFOcrucible-agent (worker): commit
442026-01-31T02:55:37.762ZINFOcrucible-agent (worker): ok!
452026-01-31T02:55:37.767ZINFOcrucible-agent (worker): SMF ok!
462026-01-31T02:55:37.767ZINFOcrucible-agent (datafile): region 8bea09d8-e04d-4c69-88de-f560ede4f0c5 running snapshot 8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8 state: Requested -> Created
472026-01-31T02:55:37.895ZINFOcrucible-agent (datafile): path is "/data/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5"
482026-01-31T02:55:37.901ZINFOcrucible-agent (datafile): dataset is oxp_f7848ecd-0094-454b-b92e-0d864cdfd2e2/crucible/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5
492026-01-31T02:55:37.907ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f7848ecd-0094-454b-b92e-0d864cdfd2e2/crucible/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5@8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8
502026-01-31T02:55:37.907ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f7848ecd-0094-454b-b92e-0d864cdfd2e2/crucible/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5", "8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8"]
512026-01-31T02:55:37.913ZINFOcrucible-agent (dropshot): request completed latency_us = 18890 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48453 req_id = 4a3e4e6d-04d1-49c8-bd8b-d022cd3169b5 response_code = 200 uri = /crucible/0/regions/8bea09d8-e04d-4c69-88de-f560ede4f0c5/snapshots/8db2e0fc-52dc-47ee-b4c2-7eeaf8793db8/run