Max level shown:
12026-01-30T16:46:31.116ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:64860
22026-01-30T16:46:31.117ZINFOcrucible-agent (datafile): region 1231de93-7dee-4835-9cde-2cc226d4b874 state: Requested
32026-01-30T16:46:31.117ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-01-30T16:46:31.117ZINFOcrucible-agent (dropshot): request completed latency_us = 731 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:64860 req_id = 84441344-267e-4169-81ff-6bc7360deb6f response_code = 200 uri = /crucible/0/regions
52026-01-30T16:46:31.125ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_2e515e49-02d4-4aa1-80e7-4871f755efbc/crucible/regions/1231de93-7dee-4835-9cde-2cc226d4b874
62026-01-30T16:46:31.125ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_2e515e49-02d4-4aa1-80e7-4871f755efbc/crucible/regions/1231de93-7dee-4835-9cde-2cc226d4b874
72026-01-30T16:46:31.196ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1231de93-7dee-4835-9cde-2cc226d4b874"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1231de93-7dee-4835-9cde-2cc226d4b874" region = 1231de93-7dee-4835-9cde-2cc226d4b874
82026-01-30T16:46:31.196ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1231de93-7dee-4835-9cde-2cc226d4b874" "--data" "/data/regions/1231de93-7dee-4835-9cde-2cc226d4b874" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 1231de93-7dee-4835-9cde-2cc226d4b874
92026-01-30T16:46:31.302ZINFOcrucible-agent (worker): region files created ok region = 1231de93-7dee-4835-9cde-2cc226d4b874
102026-01-30T16:46:31.302ZINFOcrucible-agent (datafile): region 1231de93-7dee-4835-9cde-2cc226d4b874 state: Requested -> Created
112026-01-30T16:46:31.302ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-01-30T16:46:31.303ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1231de93-7dee-4835-9cde-2cc226d4b874
132026-01-30T16:46:31.312ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1231de93-7dee-4835-9cde-2cc226d4b874
142026-01-30T16:46:31.336ZINFOcrucible-agent (worker): creating config property group
152026-01-30T16:46:31.340ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1231de93-7dee-4835-9cde-2cc226d4b874
162026-01-30T16:46:31.340ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1231de93-7dee-4835-9cde-2cc226d4b874
172026-01-30T16:46:31.340ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-01-30T16:46:31.340ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
192026-01-30T16:46:31.340ZINFOcrucible-agent (worker): commit
202026-01-30T16:46:31.344ZINFOcrucible-agent (worker): ok!
212026-01-30T16:46:31.361ZINFOcrucible-agent (worker): SMF ok!
222026-01-30T16:46:31.447ZINFOcrucible-agent (dropshot): request completed latency_us = 95 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:64860 req_id = 789a6bbd-bc19-4fcd-ab20-241bec040d49 response_code = 200 uri = /crucible/0/regions
232026-01-30T16:46:31.755ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::c]:36260
242026-01-30T16:46:31.755ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:36260 req_id = e50c2791-58f6-4df8-9ceb-e02decb40d11 response_code = 200 uri = /crucible/0/regions/1231de93-7dee-4835-9cde-2cc226d4b874
252026-01-30T16:46:31.876ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:48357
262026-01-30T16:46:31.876ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48357 req_id = d0a1ecbe-d9d3-4957-bf5e-8e03b3d9505f response_code = 200 uri = /crucible/0/regions/1231de93-7dee-4835-9cde-2cc226d4b874
272026-01-30T16:46:32.325ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:64860 req_id = 5ca35008-1f7b-450f-bf4d-f129697cb45a response_code = 200 uri = /crucible/0/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634
282026-01-30T16:46:32.331ZINFOcrucible-agent (datafile): path is "/data/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634"
292026-01-30T16:46:32.338ZINFOcrucible-agent (datafile): dataset is oxp_2e515e49-02d4-4aa1-80e7-4871f755efbc/crucible/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634
302026-01-30T16:46:32.346ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2e515e49-02d4-4aa1-80e7-4871f755efbc/crucible/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634@b37c9f1e-c473-4967-bb6b-8d1939804129
312026-01-30T16:46:32.346ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2e515e49-02d4-4aa1-80e7-4871f755efbc/crucible/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634", "b37c9f1e-c473-4967-bb6b-8d1939804129"]
322026-01-30T16:46:32.358ZINFOcrucible-agent (dropshot): request completed latency_us = 26671 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:64860 req_id = 362831f4-f1a7-495c-8280-8b97097b3512 response_code = 200 uri = /crucible/0/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634/snapshots/b37c9f1e-c473-4967-bb6b-8d1939804129
332026-01-30T16:46:32.362ZINFOcrucible-agent (datafile): path is "/data/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634"
342026-01-30T16:46:32.369ZINFOcrucible-agent (datafile): dataset is oxp_2e515e49-02d4-4aa1-80e7-4871f755efbc/crucible/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634
352026-01-30T16:46:32.376ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2e515e49-02d4-4aa1-80e7-4871f755efbc/crucible/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634@b37c9f1e-c473-4967-bb6b-8d1939804129
362026-01-30T16:46:32.376ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2e515e49-02d4-4aa1-80e7-4871f755efbc/crucible/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634", "b37c9f1e-c473-4967-bb6b-8d1939804129"]
372026-01-30T16:46:32.383ZINFOcrucible-agent (datafile): requesting running snapshot 28706b01-5d97-47a2-b46b-5d3e4f6d3634-b37c9f1e-c473-4967-bb6b-8d1939804129 state: Requested
382026-01-30T16:46:32.384ZINFOcrucible-agent (worker): applying SMF actions for region 28706b01-5d97-47a2-b46b-5d3e4f6d3634 running snapshot b37c9f1e-c473-4967-bb6b-8d1939804129 (state Requested)...
392026-01-30T16:46:32.384ZINFOcrucible-agent (dropshot): request completed latency_us = 22113 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:64860 req_id = 9d394151-dee6-4da0-96d5-e80bc10fda51 response_code = 200 uri = /crucible/0/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634/snapshots/b37c9f1e-c473-4967-bb6b-8d1939804129/run
402026-01-30T16:46:32.388ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-28706b01-5d97-47a2-b46b-5d3e4f6d3634-b37c9f1e-c473-4967-bb6b-8d1939804129
412026-01-30T16:46:32.398ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-28706b01-5d97-47a2-b46b-5d3e4f6d3634-b37c9f1e-c473-4967-bb6b-8d1939804129
422026-01-30T16:46:32.409ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-28706b01-5d97-47a2-b46b-5d3e4f6d3634-b37c9f1e-c473-4967-bb6b-8d1939804129
432026-01-30T16:46:32.409ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634/.zfs/snapshot/b37c9f1e-c473-4967-bb6b-8d1939804129
442026-01-30T16:46:32.409ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
452026-01-30T16:46:32.409ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
462026-01-30T16:46:32.409ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
472026-01-30T16:46:32.409ZINFOcrucible-agent (worker): commit
482026-01-30T16:46:32.414ZINFOcrucible-agent (worker): ok!
492026-01-30T16:46:32.419ZINFOcrucible-agent (worker): SMF ok!
502026-01-30T16:46:32.419ZINFOcrucible-agent (datafile): region 28706b01-5d97-47a2-b46b-5d3e4f6d3634 running snapshot b37c9f1e-c473-4967-bb6b-8d1939804129 state: Requested -> Created
512026-01-30T16:46:32.622ZINFOcrucible-agent (datafile): path is "/data/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634"
522026-01-30T16:46:32.629ZINFOcrucible-agent (datafile): dataset is oxp_2e515e49-02d4-4aa1-80e7-4871f755efbc/crucible/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634
532026-01-30T16:46:32.635ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2e515e49-02d4-4aa1-80e7-4871f755efbc/crucible/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634@b37c9f1e-c473-4967-bb6b-8d1939804129
542026-01-30T16:46:32.635ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2e515e49-02d4-4aa1-80e7-4871f755efbc/crucible/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634", "b37c9f1e-c473-4967-bb6b-8d1939804129"]
552026-01-30T16:46:32.643ZINFOcrucible-agent (dropshot): request completed latency_us = 21044 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:64860 req_id = 2ac98a26-c81a-4243-8783-4fe4705f9d09 response_code = 200 uri = /crucible/0/regions/28706b01-5d97-47a2-b46b-5d3e4f6d3634/snapshots/b37c9f1e-c473-4967-bb6b-8d1939804129/run