Max level shown:
12024-12-19T21:52:28.040ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:34542
22024-12-19T21:52:28.041ZINFOcrucible-agent (datafile): region 94074df9-416b-41a6-9e1b-9973ea0cbde0 state: Requested
32024-12-19T21:52:28.042ZINFOcrucible-agent (dropshot): request completed latency_us = 1577 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34542 req_id = fb868cf0-f024-4901-bcc2-0adce5542111 response_code = 200 uri = /crucible/0/regions
42024-12-19T21:52:28.042ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52024-12-19T21:52:28.053ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/94074df9-416b-41a6-9e1b-9973ea0cbde0
62024-12-19T21:52:28.053ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/94074df9-416b-41a6-9e1b-9973ea0cbde0
72024-12-19T21:52:28.119ZINFOcrucible-agent (worker): creating region Region { id: RegionId("94074df9-416b-41a6-9e1b-9973ea0cbde0"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/94074df9-416b-41a6-9e1b-9973ea0cbde0" region = 94074df9-416b-41a6-9e1b-9973ea0cbde0
82024-12-19T21:52:28.121ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "94074df9-416b-41a6-9e1b-9973ea0cbde0" "--data" "/data/regions/94074df9-416b-41a6-9e1b-9973ea0cbde0" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 94074df9-416b-41a6-9e1b-9973ea0cbde0
92024-12-19T21:52:28.186ZINFOcrucible-agent (worker): region files created ok region = 94074df9-416b-41a6-9e1b-9973ea0cbde0
102024-12-19T21:52:28.186ZINFOcrucible-agent (datafile): region 94074df9-416b-41a6-9e1b-9973ea0cbde0 state: Requested -> Created
112024-12-19T21:52:28.186ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-12-19T21:52:28.187ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-94074df9-416b-41a6-9e1b-9973ea0cbde0
132024-12-19T21:52:28.196ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-94074df9-416b-41a6-9e1b-9973ea0cbde0
142024-12-19T21:52:28.208ZINFOcrucible-agent (worker): creating config property group
152024-12-19T21:52:28.212ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-94074df9-416b-41a6-9e1b-9973ea0cbde0
162024-12-19T21:52:28.212ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/94074df9-416b-41a6-9e1b-9973ea0cbde0
172024-12-19T21:52:28.212ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-12-19T21:52:28.212ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
192024-12-19T21:52:28.212ZINFOcrucible-agent (worker): commit
202024-12-19T21:52:28.215ZINFOcrucible-agent (worker): ok!
212024-12-19T21:52:28.221ZINFOcrucible-agent (worker): SMF ok!
222024-12-19T21:52:28.381ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34542 req_id = 21b4f54d-f484-43ae-8e76-6f4f65fb1656 response_code = 200 uri = /crucible/0/regions
232024-12-19T21:52:29.992ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34542 req_id = 90aaf82b-4fa8-4b64-a149-7b51aa3258b8 response_code = 200 uri = /crucible/0/regions/c2e08d21-26f5-4194-9a2c-235f9413967f
242024-12-19T21:52:29.996ZINFOcrucible-agent (datafile): path is "/data/regions/c2e08d21-26f5-4194-9a2c-235f9413967f"
252024-12-19T21:52:30.005ZINFOcrucible-agent (datafile): dataset is oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/c2e08d21-26f5-4194-9a2c-235f9413967f
262024-12-19T21:52:30.014ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/c2e08d21-26f5-4194-9a2c-235f9413967f@7076a379-b110-44db-b9de-9525ba9ba766
272024-12-19T21:52:30.014ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/c2e08d21-26f5-4194-9a2c-235f9413967f", "7076a379-b110-44db-b9de-9525ba9ba766"]
282024-12-19T21:52:30.026ZINFOcrucible-agent (dropshot): request completed latency_us = 30691 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34542 req_id = bfdec447-e255-4f39-aae2-8521233bbfc0 response_code = 200 uri = /crucible/0/regions/c2e08d21-26f5-4194-9a2c-235f9413967f/snapshots/7076a379-b110-44db-b9de-9525ba9ba766
292024-12-19T21:52:30.030ZINFOcrucible-agent (datafile): path is "/data/regions/c2e08d21-26f5-4194-9a2c-235f9413967f"
302024-12-19T21:52:30.040ZINFOcrucible-agent (datafile): dataset is oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/c2e08d21-26f5-4194-9a2c-235f9413967f
312024-12-19T21:52:30.048ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/c2e08d21-26f5-4194-9a2c-235f9413967f@7076a379-b110-44db-b9de-9525ba9ba766
322024-12-19T21:52:30.048ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/c2e08d21-26f5-4194-9a2c-235f9413967f", "7076a379-b110-44db-b9de-9525ba9ba766"]
332024-12-19T21:52:30.057ZINFOcrucible-agent (datafile): requesting running snapshot c2e08d21-26f5-4194-9a2c-235f9413967f-7076a379-b110-44db-b9de-9525ba9ba766 state: Requested
342024-12-19T21:52:30.057ZINFOcrucible-agent (worker): applying SMF actions for region c2e08d21-26f5-4194-9a2c-235f9413967f running snapshot 7076a379-b110-44db-b9de-9525ba9ba766 (state Requested)...
352024-12-19T21:52:30.057ZINFOcrucible-agent (dropshot): request completed latency_us = 27324 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34542 req_id = 72acdc24-f015-442a-a1ad-ee5b6c6a7253 response_code = 200 uri = /crucible/0/regions/c2e08d21-26f5-4194-9a2c-235f9413967f/snapshots/7076a379-b110-44db-b9de-9525ba9ba766/run
362024-12-19T21:52:30.060ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-c2e08d21-26f5-4194-9a2c-235f9413967f-7076a379-b110-44db-b9de-9525ba9ba766
372024-12-19T21:52:30.063ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-c2e08d21-26f5-4194-9a2c-235f9413967f-7076a379-b110-44db-b9de-9525ba9ba766
382024-12-19T21:52:30.074ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-c2e08d21-26f5-4194-9a2c-235f9413967f-7076a379-b110-44db-b9de-9525ba9ba766
392024-12-19T21:52:30.075ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c2e08d21-26f5-4194-9a2c-235f9413967f/.zfs/snapshot/7076a379-b110-44db-b9de-9525ba9ba766
402024-12-19T21:52:30.075ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412024-12-19T21:52:30.075ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422024-12-19T21:52:30.075ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
432024-12-19T21:52:30.075ZINFOcrucible-agent (worker): commit
442024-12-19T21:52:30.078ZINFOcrucible-agent (worker): ok!
452024-12-19T21:52:30.083ZINFOcrucible-agent (worker): SMF ok!
462024-12-19T21:52:30.083ZINFOcrucible-agent (datafile): region c2e08d21-26f5-4194-9a2c-235f9413967f running snapshot 7076a379-b110-44db-b9de-9525ba9ba766 state: Requested -> Created
472024-12-19T21:52:30.254ZINFOcrucible-agent (datafile): path is "/data/regions/c2e08d21-26f5-4194-9a2c-235f9413967f"
482024-12-19T21:52:30.262ZINFOcrucible-agent (datafile): dataset is oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/c2e08d21-26f5-4194-9a2c-235f9413967f
492024-12-19T21:52:30.271ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/c2e08d21-26f5-4194-9a2c-235f9413967f@7076a379-b110-44db-b9de-9525ba9ba766
502024-12-19T21:52:30.271ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/c2e08d21-26f5-4194-9a2c-235f9413967f", "7076a379-b110-44db-b9de-9525ba9ba766"]
512024-12-19T21:52:30.280ZINFOcrucible-agent (dropshot): request completed latency_us = 25742 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34542 req_id = 0376c164-ce8c-4c71-a259-1c56e67062fb response_code = 200 uri = /crucible/0/regions/c2e08d21-26f5-4194-9a2c-235f9413967f/snapshots/7076a379-b110-44db-b9de-9525ba9ba766/run