Max level shown:
1 [ Jul 5 23:25:57 Enabled. ]
2 [ Jul 5 23:25:57 Rereading configuration. ]
3 [ Jul 5 23:25:59 Rereading configuration. ]
4 [ Jul 5 23:26:00 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_3ab867f2-64d4-4ee6-b11c-97c14ece4a19/crucible -l [fd00:1122:3344:101::1a]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-07-05T23:26:00.898ZINFOcrucible-agent: dataset: "oxp_3ab867f2-64d4-4ee6-b11c-97c14ece4a19/crucible"
72024-07-05T23:26:00.903ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::1a]:32345
82024-07-05T23:26:00.903ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-07-05T23:26:00.920ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-07-05T23:26:01.000ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::1a]:32345
112024-07-05T23:27:09.946ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::b]:45404
122024-07-05T23:27:09.955ZINFOcrucible-agent (datafile): region d54c8c54-a538-4c41-a6b7-4741115b8166 state: Requested
132024-07-05T23:27:09.960ZINFOcrucible-agent (dropshot): request completed latency_us = 9440 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45404 req_id = 2661828a-0c0d-4b38-a854-b29f53f4740e response_code = 200 uri = /crucible/0/regions
142024-07-05T23:27:09.960ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-07-05T23:27:09.971ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_3ab867f2-64d4-4ee6-b11c-97c14ece4a19/crucible/regions/d54c8c54-a538-4c41-a6b7-4741115b8166
162024-07-05T23:27:09.971ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_3ab867f2-64d4-4ee6-b11c-97c14ece4a19/crucible/regions/d54c8c54-a538-4c41-a6b7-4741115b8166
172024-07-05T23:27:10.019ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d54c8c54-a538-4c41-a6b7-4741115b8166"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d54c8c54-a538-4c41-a6b7-4741115b8166" region = d54c8c54-a538-4c41-a6b7-4741115b8166
182024-07-05T23:27:10.019ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d54c8c54-a538-4c41-a6b7-4741115b8166" "--data" "/data/regions/d54c8c54-a538-4c41-a6b7-4741115b8166" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = d54c8c54-a538-4c41-a6b7-4741115b8166
192024-07-05T23:27:10.209ZINFOcrucible-agent (dropshot): request completed latency_us = 747 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45404 req_id = 6257d968-6c57-4b82-b641-3bdf5778ecd3 response_code = 200 uri = /crucible/0/regions
202024-07-05T23:27:10.279ZINFOcrucible-agent (worker): region files created ok region = d54c8c54-a538-4c41-a6b7-4741115b8166
212024-07-05T23:27:10.279ZINFOcrucible-agent (datafile): region d54c8c54-a538-4c41-a6b7-4741115b8166 state: Requested -> Created
222024-07-05T23:27:10.280ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-07-05T23:27:10.280ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d54c8c54-a538-4c41-a6b7-4741115b8166
242024-07-05T23:27:10.285ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d54c8c54-a538-4c41-a6b7-4741115b8166
252024-07-05T23:27:10.293ZINFOcrucible-agent (worker): creating config property group
262024-07-05T23:27:10.296ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d54c8c54-a538-4c41-a6b7-4741115b8166
272024-07-05T23:27:10.296ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d54c8c54-a538-4c41-a6b7-4741115b8166
282024-07-05T23:27:10.296ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-07-05T23:27:10.296ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
302024-07-05T23:27:10.297ZINFOcrucible-agent (worker): commit
312024-07-05T23:27:10.301ZINFOcrucible-agent (worker): ok!
322024-07-05T23:27:10.309ZINFOcrucible-agent (worker): SMF ok!
332024-07-05T23:27:10.497ZINFOcrucible-agent (dropshot): request completed latency_us = 97 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45404 req_id = 8f9f43af-954e-4fec-94fd-545856585a4c response_code = 200 uri = /crucible/0/regions
342024-07-05T23:27:11.034ZINFOcrucible-agent (dropshot): request completed latency_us = 88 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45404 req_id = cffe7a11-9017-4e86-b70e-edfab88320c1 response_code = 200 uri = /crucible/0/regions/d54c8c54-a538-4c41-a6b7-4741115b8166
352024-07-05T23:27:11.037ZINFOcrucible-agent (datafile): path is "/data/regions/d54c8c54-a538-4c41-a6b7-4741115b8166"
362024-07-05T23:27:11.047ZINFOcrucible-agent (datafile): dataset is oxp_3ab867f2-64d4-4ee6-b11c-97c14ece4a19/crucible/regions/d54c8c54-a538-4c41-a6b7-4741115b8166
372024-07-05T23:27:11.055ZINFOcrucible-agent (datafile): region d54c8c54-a538-4c41-a6b7-4741115b8166 state: Created -> Tombstoned
382024-07-05T23:27:11.055ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-07-05T23:27:11.055ZINFOcrucible-agent (dropshot): request completed latency_us = 18868 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:45404 req_id = bcf7d48c-dc08-4220-b6de-5e9c200ebc91 response_code = 204 uri = /crucible/0/regions/d54c8c54-a538-4c41-a6b7-4741115b8166
402024-07-05T23:27:11.056ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-d54c8c54-a538-4c41-a6b7-4741115b8166 (instance states: (Some(Online), None))
412024-07-05T23:27:11.058ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45404 req_id = 17fea80a-851a-48c7-a987-5985a2bd7b25 response_code = 200 uri = /crucible/0/regions/d54c8c54-a538-4c41-a6b7-4741115b8166
422024-07-05T23:27:11.061ZINFOcrucible-agent (worker): SMF ok!
432024-07-05T23:27:11.069ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_3ab867f2-64d4-4ee6-b11c-97c14ece4a19/crucible/regions/d54c8c54-a538-4c41-a6b7-4741115b8166" region = d54c8c54-a538-4c41-a6b7-4741115b8166
442024-07-05T23:27:11.116ZINFOcrucible-agent (datafile): region d54c8c54-a538-4c41-a6b7-4741115b8166 state: Tombstoned -> Destroyed
452024-07-05T23:27:11.190ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45404 req_id = bff22f26-867e-47e4-a0d7-43732d66cc7a response_code = 200 uri = /crucible/0/regions/d54c8c54-a538-4c41-a6b7-4741115b8166
462024-07-05T23:27:15.069ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:43077
472024-07-05T23:27:15.069ZINFOcrucible-agent (datafile): region d0658516-3635-4c04-93b1-95aed8baad6a state: Requested
482024-07-05T23:27:15.071ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492024-07-05T23:27:15.071ZINFOcrucible-agent (dropshot): request completed latency_us = 2107 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43077 req_id = b1f20b29-4312-4e73-97d1-6e8fc61798fb response_code = 200 uri = /crucible/0/regions
502024-07-05T23:27:15.080ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_3ab867f2-64d4-4ee6-b11c-97c14ece4a19/crucible/regions/d0658516-3635-4c04-93b1-95aed8baad6a
512024-07-05T23:27:15.080ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_3ab867f2-64d4-4ee6-b11c-97c14ece4a19/crucible/regions/d0658516-3635-4c04-93b1-95aed8baad6a
522024-07-05T23:27:15.122ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d0658516-3635-4c04-93b1-95aed8baad6a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d0658516-3635-4c04-93b1-95aed8baad6a" region = d0658516-3635-4c04-93b1-95aed8baad6a
532024-07-05T23:27:15.123ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d0658516-3635-4c04-93b1-95aed8baad6a" "--data" "/data/regions/d0658516-3635-4c04-93b1-95aed8baad6a" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d0658516-3635-4c04-93b1-95aed8baad6a
542024-07-05T23:27:15.228ZINFOcrucible-agent (worker): region files created ok region = d0658516-3635-4c04-93b1-95aed8baad6a
552024-07-05T23:27:15.229ZINFOcrucible-agent (datafile): region d0658516-3635-4c04-93b1-95aed8baad6a state: Requested -> Created
562024-07-05T23:27:15.229ZINFOcrucible-agent (worker): applying SMF actions post create...
572024-07-05T23:27:15.230ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d0658516-3635-4c04-93b1-95aed8baad6a
582024-07-05T23:27:15.233ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d0658516-3635-4c04-93b1-95aed8baad6a
592024-07-05T23:27:15.241ZINFOcrucible-agent (worker): creating config property group
602024-07-05T23:27:15.244ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d0658516-3635-4c04-93b1-95aed8baad6a
612024-07-05T23:27:15.245ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d0658516-3635-4c04-93b1-95aed8baad6a
622024-07-05T23:27:15.245ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
632024-07-05T23:27:15.245ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
642024-07-05T23:27:15.245ZINFOcrucible-agent (worker): commit
652024-07-05T23:27:15.250ZINFOcrucible-agent (worker): ok!
662024-07-05T23:27:15.255ZINFOcrucible-agent (worker): SMF ok!
672024-07-05T23:27:15.399ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43077 req_id = f9834e9d-1aa8-4979-a81f-2c8f9983ced4 response_code = 200 uri = /crucible/0/regions