Max level shown:
12025-03-12T22:46:37.217ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:48228
22025-03-12T22:46:37.218ZINFOcrucible-agent (datafile): region 30aaac76-40f7-4fff-a646-abfd58481efb state: Requested
32025-03-12T22:46:37.218ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-03-12T22:46:37.218ZINFOcrucible-agent (dropshot): request completed latency_us = 872 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48228 req_id = c7fb15e3-12a5-4c45-b49d-b7fd506e9edb response_code = 200 uri = /crucible/0/regions
52025-03-12T22:46:37.229ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_a8d13dfd-2585-43cf-b398-bd588dcb66be/crucible/regions/30aaac76-40f7-4fff-a646-abfd58481efb
62025-03-12T22:46:37.229ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_a8d13dfd-2585-43cf-b398-bd588dcb66be/crucible/regions/30aaac76-40f7-4fff-a646-abfd58481efb
72025-03-12T22:46:37.278ZINFOcrucible-agent (worker): creating region Region { id: RegionId("30aaac76-40f7-4fff-a646-abfd58481efb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/30aaac76-40f7-4fff-a646-abfd58481efb" region = 30aaac76-40f7-4fff-a646-abfd58481efb
82025-03-12T22:46:37.278ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "30aaac76-40f7-4fff-a646-abfd58481efb" "--data" "/data/regions/30aaac76-40f7-4fff-a646-abfd58481efb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 30aaac76-40f7-4fff-a646-abfd58481efb
92025-03-12T22:46:37.410ZINFOcrucible-agent (worker): region files created ok region = 30aaac76-40f7-4fff-a646-abfd58481efb
102025-03-12T22:46:37.410ZINFOcrucible-agent (datafile): region 30aaac76-40f7-4fff-a646-abfd58481efb state: Requested -> Created
112025-03-12T22:46:37.411ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-03-12T22:46:37.411ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-30aaac76-40f7-4fff-a646-abfd58481efb
132025-03-12T22:46:37.416ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-30aaac76-40f7-4fff-a646-abfd58481efb
142025-03-12T22:46:37.426ZINFOcrucible-agent (worker): creating config property group
152025-03-12T22:46:37.429ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-30aaac76-40f7-4fff-a646-abfd58481efb
162025-03-12T22:46:37.429ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/30aaac76-40f7-4fff-a646-abfd58481efb
172025-03-12T22:46:37.429ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-03-12T22:46:37.429ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
192025-03-12T22:46:37.429ZINFOcrucible-agent (worker): commit
202025-03-12T22:46:37.433ZINFOcrucible-agent (worker): ok!
212025-03-12T22:46:37.438ZINFOcrucible-agent (worker): SMF ok!
222025-03-12T22:46:37.472ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48228 req_id = 2ec813b5-01eb-461d-a254-f86f7de2a1da response_code = 200 uri = /crucible/0/regions
232025-03-12T22:46:38.780ZINFOcrucible-agent (dropshot): request completed latency_us = 2963 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48228 req_id = 23af5db8-a2eb-4d8a-8d8d-be5d70ebcab8 response_code = 200 uri = /crucible/0/regions/cdbde507-475e-4c0a-9225-7e197f14a99f
242025-03-12T22:46:38.787ZINFOcrucible-agent (datafile): path is "/data/regions/cdbde507-475e-4c0a-9225-7e197f14a99f"
252025-03-12T22:46:38.796ZINFOcrucible-agent (datafile): dataset is oxp_a8d13dfd-2585-43cf-b398-bd588dcb66be/crucible/regions/cdbde507-475e-4c0a-9225-7e197f14a99f
262025-03-12T22:46:38.804ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a8d13dfd-2585-43cf-b398-bd588dcb66be/crucible/regions/cdbde507-475e-4c0a-9225-7e197f14a99f@7e4511fe-0841-45d7-8db8-1645e8c40bfb
272025-03-12T22:46:38.804ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a8d13dfd-2585-43cf-b398-bd588dcb66be/crucible/regions/cdbde507-475e-4c0a-9225-7e197f14a99f", "7e4511fe-0841-45d7-8db8-1645e8c40bfb"]
282025-03-12T22:46:38.813ZINFOcrucible-agent (dropshot): request completed latency_us = 28718 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48228 req_id = fbf6ea58-01bd-4e8f-8c53-3c8a537d57af response_code = 200 uri = /crucible/0/regions/cdbde507-475e-4c0a-9225-7e197f14a99f/snapshots/7e4511fe-0841-45d7-8db8-1645e8c40bfb
292025-03-12T22:46:38.816ZINFOcrucible-agent (datafile): path is "/data/regions/cdbde507-475e-4c0a-9225-7e197f14a99f"
302025-03-12T22:46:38.824ZINFOcrucible-agent (datafile): dataset is oxp_a8d13dfd-2585-43cf-b398-bd588dcb66be/crucible/regions/cdbde507-475e-4c0a-9225-7e197f14a99f
312025-03-12T22:46:38.832ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a8d13dfd-2585-43cf-b398-bd588dcb66be/crucible/regions/cdbde507-475e-4c0a-9225-7e197f14a99f@7e4511fe-0841-45d7-8db8-1645e8c40bfb
322025-03-12T22:46:38.832ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a8d13dfd-2585-43cf-b398-bd588dcb66be/crucible/regions/cdbde507-475e-4c0a-9225-7e197f14a99f", "7e4511fe-0841-45d7-8db8-1645e8c40bfb"]
332025-03-12T22:46:38.840ZINFOcrucible-agent (datafile): requesting running snapshot cdbde507-475e-4c0a-9225-7e197f14a99f-7e4511fe-0841-45d7-8db8-1645e8c40bfb state: Requested
342025-03-12T22:46:38.841ZINFOcrucible-agent (worker): applying SMF actions for region cdbde507-475e-4c0a-9225-7e197f14a99f running snapshot 7e4511fe-0841-45d7-8db8-1645e8c40bfb (state Requested)...
352025-03-12T22:46:38.841ZINFOcrucible-agent (dropshot): request completed latency_us = 24839 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48228 req_id = fc0bc058-5828-4e3d-83ca-11067cc693e1 response_code = 200 uri = /crucible/0/regions/cdbde507-475e-4c0a-9225-7e197f14a99f/snapshots/7e4511fe-0841-45d7-8db8-1645e8c40bfb/run
362025-03-12T22:46:38.843ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-cdbde507-475e-4c0a-9225-7e197f14a99f-7e4511fe-0841-45d7-8db8-1645e8c40bfb
372025-03-12T22:46:38.851ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-cdbde507-475e-4c0a-9225-7e197f14a99f-7e4511fe-0841-45d7-8db8-1645e8c40bfb
382025-03-12T22:46:38.861ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-cdbde507-475e-4c0a-9225-7e197f14a99f-7e4511fe-0841-45d7-8db8-1645e8c40bfb
392025-03-12T22:46:38.861ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cdbde507-475e-4c0a-9225-7e197f14a99f/.zfs/snapshot/7e4511fe-0841-45d7-8db8-1645e8c40bfb
402025-03-12T22:46:38.862ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-03-12T22:46:38.862ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-03-12T22:46:38.862ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
432025-03-12T22:46:38.862ZINFOcrucible-agent (worker): commit
442025-03-12T22:46:38.865ZINFOcrucible-agent (worker): ok!
452025-03-12T22:46:38.870ZINFOcrucible-agent (worker): SMF ok!
462025-03-12T22:46:38.870ZINFOcrucible-agent (datafile): region cdbde507-475e-4c0a-9225-7e197f14a99f running snapshot 7e4511fe-0841-45d7-8db8-1645e8c40bfb state: Requested -> Created
472025-03-12T22:46:39.139ZINFOcrucible-agent (datafile): path is "/data/regions/cdbde507-475e-4c0a-9225-7e197f14a99f"
482025-03-12T22:46:39.149ZINFOcrucible-agent (datafile): dataset is oxp_a8d13dfd-2585-43cf-b398-bd588dcb66be/crucible/regions/cdbde507-475e-4c0a-9225-7e197f14a99f
492025-03-12T22:46:39.158ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_a8d13dfd-2585-43cf-b398-bd588dcb66be/crucible/regions/cdbde507-475e-4c0a-9225-7e197f14a99f@7e4511fe-0841-45d7-8db8-1645e8c40bfb
502025-03-12T22:46:39.158ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_a8d13dfd-2585-43cf-b398-bd588dcb66be/crucible/regions/cdbde507-475e-4c0a-9225-7e197f14a99f", "7e4511fe-0841-45d7-8db8-1645e8c40bfb"]
512025-03-12T22:46:39.167ZINFOcrucible-agent (dropshot): request completed latency_us = 27495 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48228 req_id = bdfd5a3d-bc99-4457-8d19-a7b7084c942f response_code = 200 uri = /crucible/0/regions/cdbde507-475e-4c0a-9225-7e197f14a99f/snapshots/7e4511fe-0841-45d7-8db8-1645e8c40bfb/run