Max level shown:
12024-12-18T22:25:12.445ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:59565
22024-12-18T22:25:12.445ZINFOcrucible-agent (datafile): region 065a38cf-5d36-416e-9314-4bebac9e1351 state: Requested
32024-12-18T22:25:12.445ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-12-18T22:25:12.445ZINFOcrucible-agent (dropshot): request completed latency_us = 327 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59565 req_id = b93f48af-e9ee-47b6-b664-a00a45facf1e response_code = 200 uri = /crucible/0/regions
52024-12-18T22:25:12.456ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crucible/regions/065a38cf-5d36-416e-9314-4bebac9e1351
62024-12-18T22:25:12.456ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crucible/regions/065a38cf-5d36-416e-9314-4bebac9e1351
72024-12-18T22:25:12.521ZINFOcrucible-agent (worker): creating region Region { id: RegionId("065a38cf-5d36-416e-9314-4bebac9e1351"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/065a38cf-5d36-416e-9314-4bebac9e1351" region = 065a38cf-5d36-416e-9314-4bebac9e1351
82024-12-18T22:25:12.521ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "065a38cf-5d36-416e-9314-4bebac9e1351" "--data" "/data/regions/065a38cf-5d36-416e-9314-4bebac9e1351" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 065a38cf-5d36-416e-9314-4bebac9e1351
92024-12-18T22:25:12.603ZINFOcrucible-agent (worker): region files created ok region = 065a38cf-5d36-416e-9314-4bebac9e1351
102024-12-18T22:25:12.603ZINFOcrucible-agent (datafile): region 065a38cf-5d36-416e-9314-4bebac9e1351 state: Requested -> Created
112024-12-18T22:25:12.603ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-12-18T22:25:12.603ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-065a38cf-5d36-416e-9314-4bebac9e1351
132024-12-18T22:25:12.609ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-065a38cf-5d36-416e-9314-4bebac9e1351
142024-12-18T22:25:12.623ZINFOcrucible-agent (worker): creating config property group
152024-12-18T22:25:12.627ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-065a38cf-5d36-416e-9314-4bebac9e1351
162024-12-18T22:25:12.627ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/065a38cf-5d36-416e-9314-4bebac9e1351
172024-12-18T22:25:12.627ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-12-18T22:25:12.627ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
192024-12-18T22:25:12.627ZINFOcrucible-agent (worker): commit
202024-12-18T22:25:12.631ZINFOcrucible-agent (worker): ok!
212024-12-18T22:25:12.640ZINFOcrucible-agent (worker): SMF ok!
222024-12-18T22:25:12.826ZINFOcrucible-agent (dropshot): request completed latency_us = 101 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59565 req_id = 97552121-1f2d-48a2-b97a-72ab1aa49ef7 response_code = 200 uri = /crucible/0/regions
232024-12-18T22:25:13.002ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:65388
242024-12-18T22:25:13.005ZINFOcrucible-agent (dropshot): request completed latency_us = 3008 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:65388 req_id = ca925f56-bcf8-417d-8f49-6a55ecb3cdee response_code = 200 uri = /crucible/0/regions/065a38cf-5d36-416e-9314-4bebac9e1351
252024-12-18T22:25:13.110ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:41542
262024-12-18T22:25:13.112ZINFOcrucible-agent (dropshot): request completed latency_us = 2261 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41542 req_id = d72c3a5a-4d4f-4967-8916-2b8806466169 response_code = 200 uri = /crucible/0/regions/065a38cf-5d36-416e-9314-4bebac9e1351
272024-12-18T22:25:14.319ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59565 req_id = 602d813b-2135-4f17-84ca-a7b31a366266 response_code = 200 uri = /crucible/0/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7
282024-12-18T22:25:14.332ZINFOcrucible-agent (datafile): path is "/data/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7"
292024-12-18T22:25:14.341ZINFOcrucible-agent (datafile): dataset is oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crucible/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7
302024-12-18T22:25:14.349ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crucible/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7@9553da52-52d5-4afb-af76-5e73541740db
312024-12-18T22:25:14.349ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crucible/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7", "9553da52-52d5-4afb-af76-5e73541740db"]
322024-12-18T22:25:14.359ZINFOcrucible-agent (dropshot): request completed latency_us = 26931 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59565 req_id = d2e28ba1-6b55-4ce3-927d-2a8e863ff6a5 response_code = 200 uri = /crucible/0/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7/snapshots/9553da52-52d5-4afb-af76-5e73541740db
332024-12-18T22:25:14.365ZINFOcrucible-agent (datafile): path is "/data/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7"
342024-12-18T22:25:14.372ZINFOcrucible-agent (datafile): dataset is oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crucible/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7
352024-12-18T22:25:14.380ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crucible/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7@9553da52-52d5-4afb-af76-5e73541740db
362024-12-18T22:25:14.380ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crucible/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7", "9553da52-52d5-4afb-af76-5e73541740db"]
372024-12-18T22:25:14.388ZINFOcrucible-agent (datafile): requesting running snapshot a1fb39e9-1f42-4920-9dc2-b9561e9101f7-9553da52-52d5-4afb-af76-5e73541740db state: Requested
382024-12-18T22:25:14.388ZINFOcrucible-agent (worker): applying SMF actions for region a1fb39e9-1f42-4920-9dc2-b9561e9101f7 running snapshot 9553da52-52d5-4afb-af76-5e73541740db (state Requested)...
392024-12-18T22:25:14.388ZINFOcrucible-agent (dropshot): request completed latency_us = 23568 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59565 req_id = a07f697b-ab45-47b3-8695-d8477785abb8 response_code = 200 uri = /crucible/0/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7/snapshots/9553da52-52d5-4afb-af76-5e73541740db/run
402024-12-18T22:25:14.391ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-a1fb39e9-1f42-4920-9dc2-b9561e9101f7-9553da52-52d5-4afb-af76-5e73541740db
412024-12-18T22:25:14.404ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-a1fb39e9-1f42-4920-9dc2-b9561e9101f7-9553da52-52d5-4afb-af76-5e73541740db
422024-12-18T22:25:14.452ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-a1fb39e9-1f42-4920-9dc2-b9561e9101f7-9553da52-52d5-4afb-af76-5e73541740db
432024-12-18T22:25:14.452ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7/.zfs/snapshot/9553da52-52d5-4afb-af76-5e73541740db
442024-12-18T22:25:14.452ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
452024-12-18T22:25:14.452ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
462024-12-18T22:25:14.452ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
472024-12-18T22:25:14.452ZINFOcrucible-agent (worker): commit
482024-12-18T22:25:14.470ZINFOcrucible-agent (worker): ok!
492024-12-18T22:25:14.484ZINFOcrucible-agent (worker): SMF ok!
502024-12-18T22:25:14.484ZINFOcrucible-agent (datafile): region a1fb39e9-1f42-4920-9dc2-b9561e9101f7 running snapshot 9553da52-52d5-4afb-af76-5e73541740db state: Requested -> Created
512024-12-18T22:25:14.547ZINFOcrucible-agent (datafile): path is "/data/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7"
522024-12-18T22:25:14.557ZINFOcrucible-agent (datafile): dataset is oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crucible/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7
532024-12-18T22:25:14.566ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crucible/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7@9553da52-52d5-4afb-af76-5e73541740db
542024-12-18T22:25:14.566ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_45dbe21c-5eaa-4707-b822-d1348b4d8afc/crucible/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7", "9553da52-52d5-4afb-af76-5e73541740db"]
552024-12-18T22:25:14.573ZINFOcrucible-agent (dropshot): request completed latency_us = 26644 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59565 req_id = 72d146a6-4cd7-46e9-aaaf-075d4353f19d response_code = 200 uri = /crucible/0/regions/a1fb39e9-1f42-4920-9dc2-b9561e9101f7/snapshots/9553da52-52d5-4afb-af76-5e73541740db/run