Max level shown:
12025-01-09T20:50:53.321ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::c]:55782
22025-01-09T20:50:53.321ZINFOcrucible-agent (datafile): region 43fa3079-b498-4015-8fc4-df2f662fb034 state: Requested
32025-01-09T20:50:53.321ZINFOcrucible-agent (dropshot): request completed latency_us = 662 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55782 req_id = 8a698d15-9f5e-48ee-9397-5ad3e971e22c response_code = 200 uri = /crucible/0/regions
42025-01-09T20:50:53.321ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-01-09T20:50:53.335ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_7c28e2e1-3590-4595-bc22-4324f6ba0ef1/crucible/regions/43fa3079-b498-4015-8fc4-df2f662fb034
62025-01-09T20:50:53.335ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_7c28e2e1-3590-4595-bc22-4324f6ba0ef1/crucible/regions/43fa3079-b498-4015-8fc4-df2f662fb034
72025-01-09T20:50:53.413ZINFOcrucible-agent (worker): creating region Region { id: RegionId("43fa3079-b498-4015-8fc4-df2f662fb034"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/43fa3079-b498-4015-8fc4-df2f662fb034" region = 43fa3079-b498-4015-8fc4-df2f662fb034
82025-01-09T20:50:53.413ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "43fa3079-b498-4015-8fc4-df2f662fb034" "--data" "/data/regions/43fa3079-b498-4015-8fc4-df2f662fb034" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 43fa3079-b498-4015-8fc4-df2f662fb034
92025-01-09T20:50:53.540ZINFOcrucible-agent (worker): region files created ok region = 43fa3079-b498-4015-8fc4-df2f662fb034
102025-01-09T20:50:53.540ZINFOcrucible-agent (datafile): region 43fa3079-b498-4015-8fc4-df2f662fb034 state: Requested -> Created
112025-01-09T20:50:53.540ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-01-09T20:50:53.553ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-43fa3079-b498-4015-8fc4-df2f662fb034
132025-01-09T20:50:53.557ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-43fa3079-b498-4015-8fc4-df2f662fb034
142025-01-09T20:50:53.570ZINFOcrucible-agent (worker): creating config property group
152025-01-09T20:50:53.574ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-43fa3079-b498-4015-8fc4-df2f662fb034
162025-01-09T20:50:53.574ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/43fa3079-b498-4015-8fc4-df2f662fb034
172025-01-09T20:50:53.574ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-01-09T20:50:53.575ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
192025-01-09T20:50:53.575ZINFOcrucible-agent (worker): commit
202025-01-09T20:50:53.579ZINFOcrucible-agent (worker): ok!
212025-01-09T20:50:53.587ZINFOcrucible-agent (worker): SMF ok!
222025-01-09T20:50:53.595ZINFOcrucible-agent (dropshot): request completed latency_us = 107 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55782 req_id = fb4acfa2-ecfe-4b35-bf39-2fb7e979398c response_code = 200 uri = /crucible/0/regions
232025-01-09T20:50:55.561ZINFOcrucible-agent (dropshot): request completed latency_us = 2373 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:55782 req_id = 8f7797e9-ae08-418e-8ed5-dbde4735749f response_code = 200 uri = /crucible/0/regions/05f450f6-11b8-486b-98f0-00eb873699d5
242025-01-09T20:50:55.564ZINFOcrucible-agent (datafile): path is "/data/regions/05f450f6-11b8-486b-98f0-00eb873699d5"
252025-01-09T20:50:55.575ZINFOcrucible-agent (datafile): dataset is oxp_7c28e2e1-3590-4595-bc22-4324f6ba0ef1/crucible/regions/05f450f6-11b8-486b-98f0-00eb873699d5
262025-01-09T20:50:55.584ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7c28e2e1-3590-4595-bc22-4324f6ba0ef1/crucible/regions/05f450f6-11b8-486b-98f0-00eb873699d5@767abb4d-61bf-47f3-b595-e1ac8d322b3e
272025-01-09T20:50:55.584ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7c28e2e1-3590-4595-bc22-4324f6ba0ef1/crucible/regions/05f450f6-11b8-486b-98f0-00eb873699d5", "767abb4d-61bf-47f3-b595-e1ac8d322b3e"]
282025-01-09T20:50:55.595ZINFOcrucible-agent (dropshot): request completed latency_us = 30729 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:55782 req_id = 5787ed87-2625-49ab-af96-01b4ab0d1bb8 response_code = 200 uri = /crucible/0/regions/05f450f6-11b8-486b-98f0-00eb873699d5/snapshots/767abb4d-61bf-47f3-b595-e1ac8d322b3e
292025-01-09T20:50:55.599ZINFOcrucible-agent (datafile): path is "/data/regions/05f450f6-11b8-486b-98f0-00eb873699d5"
302025-01-09T20:50:55.608ZINFOcrucible-agent (datafile): dataset is oxp_7c28e2e1-3590-4595-bc22-4324f6ba0ef1/crucible/regions/05f450f6-11b8-486b-98f0-00eb873699d5
312025-01-09T20:50:55.616ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7c28e2e1-3590-4595-bc22-4324f6ba0ef1/crucible/regions/05f450f6-11b8-486b-98f0-00eb873699d5@767abb4d-61bf-47f3-b595-e1ac8d322b3e
322025-01-09T20:50:55.616ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7c28e2e1-3590-4595-bc22-4324f6ba0ef1/crucible/regions/05f450f6-11b8-486b-98f0-00eb873699d5", "767abb4d-61bf-47f3-b595-e1ac8d322b3e"]
332025-01-09T20:50:55.625ZINFOcrucible-agent (datafile): requesting running snapshot 05f450f6-11b8-486b-98f0-00eb873699d5-767abb4d-61bf-47f3-b595-e1ac8d322b3e state: Requested
342025-01-09T20:50:55.625ZINFOcrucible-agent (worker): applying SMF actions for region 05f450f6-11b8-486b-98f0-00eb873699d5 running snapshot 767abb4d-61bf-47f3-b595-e1ac8d322b3e (state Requested)...
352025-01-09T20:50:55.625ZINFOcrucible-agent (dropshot): request completed latency_us = 26040 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55782 req_id = ed51ed2d-de10-413f-bead-186e1fa9f3a8 response_code = 200 uri = /crucible/0/regions/05f450f6-11b8-486b-98f0-00eb873699d5/snapshots/767abb4d-61bf-47f3-b595-e1ac8d322b3e/run
362025-01-09T20:50:55.627ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-05f450f6-11b8-486b-98f0-00eb873699d5-767abb4d-61bf-47f3-b595-e1ac8d322b3e
372025-01-09T20:50:55.634ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-05f450f6-11b8-486b-98f0-00eb873699d5-767abb4d-61bf-47f3-b595-e1ac8d322b3e
382025-01-09T20:50:55.643ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-05f450f6-11b8-486b-98f0-00eb873699d5-767abb4d-61bf-47f3-b595-e1ac8d322b3e
392025-01-09T20:50:55.644ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/05f450f6-11b8-486b-98f0-00eb873699d5/.zfs/snapshot/767abb4d-61bf-47f3-b595-e1ac8d322b3e
402025-01-09T20:50:55.644ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-01-09T20:50:55.644ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-01-09T20:50:55.644ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
432025-01-09T20:50:55.644ZINFOcrucible-agent (worker): commit
442025-01-09T20:50:55.647ZINFOcrucible-agent (worker): ok!
452025-01-09T20:50:55.652ZINFOcrucible-agent (worker): SMF ok!
462025-01-09T20:50:55.652ZINFOcrucible-agent (datafile): region 05f450f6-11b8-486b-98f0-00eb873699d5 running snapshot 767abb4d-61bf-47f3-b595-e1ac8d322b3e state: Requested -> Created
472025-01-09T20:50:55.786ZINFOcrucible-agent (datafile): path is "/data/regions/05f450f6-11b8-486b-98f0-00eb873699d5"
482025-01-09T20:50:55.795ZINFOcrucible-agent (datafile): dataset is oxp_7c28e2e1-3590-4595-bc22-4324f6ba0ef1/crucible/regions/05f450f6-11b8-486b-98f0-00eb873699d5
492025-01-09T20:50:55.804ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7c28e2e1-3590-4595-bc22-4324f6ba0ef1/crucible/regions/05f450f6-11b8-486b-98f0-00eb873699d5@767abb4d-61bf-47f3-b595-e1ac8d322b3e
502025-01-09T20:50:55.804ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7c28e2e1-3590-4595-bc22-4324f6ba0ef1/crucible/regions/05f450f6-11b8-486b-98f0-00eb873699d5", "767abb4d-61bf-47f3-b595-e1ac8d322b3e"]
512025-01-09T20:50:55.813ZINFOcrucible-agent (dropshot): request completed latency_us = 27146 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55782 req_id = c210a584-069d-401e-90b9-96ff66dcb306 response_code = 200 uri = /crucible/0/regions/05f450f6-11b8-486b-98f0-00eb873699d5/snapshots/767abb4d-61bf-47f3-b595-e1ac8d322b3e/run