Max level shown:
12024-08-09T21:18:53.904ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:49819
22024-08-09T21:18:53.904ZINFOcrucible-agent (datafile): region 0c724195-0021-411e-ac74-0f39711731d4 state: Requested
32024-08-09T21:18:53.905ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-08-09T21:18:53.905ZINFOcrucible-agent (dropshot): request completed latency_us = 1079 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49819 req_id = e396d12d-4b0b-40f7-95ec-668ba06eaee4 response_code = 200 uri = /crucible/0/regions
52024-08-09T21:18:53.914ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_18bb3aa5-a9ba-4c6b-b634-01e9cffdde56/crucible/regions/0c724195-0021-411e-ac74-0f39711731d4
62024-08-09T21:18:53.914ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_18bb3aa5-a9ba-4c6b-b634-01e9cffdde56/crucible/regions/0c724195-0021-411e-ac74-0f39711731d4
72024-08-09T21:18:53.989ZINFOcrucible-agent (worker): creating region Region { id: RegionId("0c724195-0021-411e-ac74-0f39711731d4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/0c724195-0021-411e-ac74-0f39711731d4" region = 0c724195-0021-411e-ac74-0f39711731d4
82024-08-09T21:18:53.989ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "0c724195-0021-411e-ac74-0f39711731d4" "--data" "/data/regions/0c724195-0021-411e-ac74-0f39711731d4" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 0c724195-0021-411e-ac74-0f39711731d4
92024-08-09T21:18:54.093ZINFOcrucible-agent (worker): region files created ok region = 0c724195-0021-411e-ac74-0f39711731d4
102024-08-09T21:18:54.093ZINFOcrucible-agent (datafile): region 0c724195-0021-411e-ac74-0f39711731d4 state: Requested -> Created
112024-08-09T21:18:54.094ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-08-09T21:18:54.095ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-0c724195-0021-411e-ac74-0f39711731d4
132024-08-09T21:18:54.107ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-0c724195-0021-411e-ac74-0f39711731d4
142024-08-09T21:18:54.125ZINFOcrucible-agent (worker): creating config property group
152024-08-09T21:18:54.131ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-0c724195-0021-411e-ac74-0f39711731d4
162024-08-09T21:18:54.131ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0c724195-0021-411e-ac74-0f39711731d4
172024-08-09T21:18:54.131ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-08-09T21:18:54.131ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
192024-08-09T21:18:54.132ZINFOcrucible-agent (worker): commit
202024-08-09T21:18:54.136ZINFOcrucible-agent (worker): ok!
212024-08-09T21:18:54.147ZINFOcrucible-agent (worker): SMF ok!
222024-08-09T21:18:54.177ZINFOcrucible-agent (dropshot): request completed latency_us = 650 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49819 req_id = 0a20a283-caa4-4ea3-9cc5-5c7f5ed7246e response_code = 200 uri = /crucible/0/regions
232024-08-09T21:18:55.048ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49819 req_id = 3c842d6b-67dc-42b7-a3a9-219386bf373e response_code = 200 uri = /crucible/0/regions/594211bd-3de4-4582-8c02-399344de69d3
242024-08-09T21:18:55.055ZINFOcrucible-agent (datafile): path is "/data/regions/594211bd-3de4-4582-8c02-399344de69d3"
252024-08-09T21:18:55.067ZINFOcrucible-agent (datafile): dataset is oxp_18bb3aa5-a9ba-4c6b-b634-01e9cffdde56/crucible/regions/594211bd-3de4-4582-8c02-399344de69d3
262024-08-09T21:18:55.078ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_18bb3aa5-a9ba-4c6b-b634-01e9cffdde56/crucible/regions/594211bd-3de4-4582-8c02-399344de69d3@1f5b562c-6f27-4b6c-b741-f40becb84c6b
272024-08-09T21:18:55.078ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_18bb3aa5-a9ba-4c6b-b634-01e9cffdde56/crucible/regions/594211bd-3de4-4582-8c02-399344de69d3", "1f5b562c-6f27-4b6c-b741-f40becb84c6b"]
282024-08-09T21:18:55.091ZINFOcrucible-agent (dropshot): request completed latency_us = 39441 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49819 req_id = eded3ae8-93b8-4d05-a77b-2787dc2dc056 response_code = 200 uri = /crucible/0/regions/594211bd-3de4-4582-8c02-399344de69d3/snapshots/1f5b562c-6f27-4b6c-b741-f40becb84c6b
292024-08-09T21:18:55.094ZINFOcrucible-agent (datafile): path is "/data/regions/594211bd-3de4-4582-8c02-399344de69d3"
302024-08-09T21:18:55.106ZINFOcrucible-agent (datafile): dataset is oxp_18bb3aa5-a9ba-4c6b-b634-01e9cffdde56/crucible/regions/594211bd-3de4-4582-8c02-399344de69d3
312024-08-09T21:18:55.119ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_18bb3aa5-a9ba-4c6b-b634-01e9cffdde56/crucible/regions/594211bd-3de4-4582-8c02-399344de69d3@1f5b562c-6f27-4b6c-b741-f40becb84c6b
322024-08-09T21:18:55.119ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_18bb3aa5-a9ba-4c6b-b634-01e9cffdde56/crucible/regions/594211bd-3de4-4582-8c02-399344de69d3", "1f5b562c-6f27-4b6c-b741-f40becb84c6b"]
332024-08-09T21:18:55.132ZINFOcrucible-agent (datafile): requesting running snapshot 594211bd-3de4-4582-8c02-399344de69d3-1f5b562c-6f27-4b6c-b741-f40becb84c6b state: Requested
342024-08-09T21:18:55.132ZINFOcrucible-agent (worker): applying SMF actions for region 594211bd-3de4-4582-8c02-399344de69d3 running snapshot 1f5b562c-6f27-4b6c-b741-f40becb84c6b (state Requested)...
352024-08-09T21:18:55.132ZINFOcrucible-agent (dropshot): request completed latency_us = 37921 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49819 req_id = 21e7cde0-46b8-4d82-bfa7-a796e6bc6974 response_code = 200 uri = /crucible/0/regions/594211bd-3de4-4582-8c02-399344de69d3/snapshots/1f5b562c-6f27-4b6c-b741-f40becb84c6b/run
362024-08-09T21:18:55.136ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-594211bd-3de4-4582-8c02-399344de69d3-1f5b562c-6f27-4b6c-b741-f40becb84c6b
372024-08-09T21:18:55.144ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-594211bd-3de4-4582-8c02-399344de69d3-1f5b562c-6f27-4b6c-b741-f40becb84c6b
382024-08-09T21:18:55.163ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-594211bd-3de4-4582-8c02-399344de69d3-1f5b562c-6f27-4b6c-b741-f40becb84c6b
392024-08-09T21:18:55.163ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/594211bd-3de4-4582-8c02-399344de69d3/.zfs/snapshot/1f5b562c-6f27-4b6c-b741-f40becb84c6b
402024-08-09T21:18:55.163ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412024-08-09T21:18:55.163ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422024-08-09T21:18:55.163ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
432024-08-09T21:18:55.163ZINFOcrucible-agent (worker): commit
442024-08-09T21:18:55.170ZINFOcrucible-agent (worker): ok!
452024-08-09T21:18:55.179ZINFOcrucible-agent (worker): SMF ok!
462024-08-09T21:18:55.179ZINFOcrucible-agent (datafile): region 594211bd-3de4-4582-8c02-399344de69d3 running snapshot 1f5b562c-6f27-4b6c-b741-f40becb84c6b state: Requested -> Created
472024-08-09T21:18:55.292ZINFOcrucible-agent (datafile): path is "/data/regions/594211bd-3de4-4582-8c02-399344de69d3"
482024-08-09T21:18:55.301ZINFOcrucible-agent (datafile): dataset is oxp_18bb3aa5-a9ba-4c6b-b634-01e9cffdde56/crucible/regions/594211bd-3de4-4582-8c02-399344de69d3
492024-08-09T21:18:55.309ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_18bb3aa5-a9ba-4c6b-b634-01e9cffdde56/crucible/regions/594211bd-3de4-4582-8c02-399344de69d3@1f5b562c-6f27-4b6c-b741-f40becb84c6b
502024-08-09T21:18:55.309ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_18bb3aa5-a9ba-4c6b-b634-01e9cffdde56/crucible/regions/594211bd-3de4-4582-8c02-399344de69d3", "1f5b562c-6f27-4b6c-b741-f40becb84c6b"]
512024-08-09T21:18:55.317ZINFOcrucible-agent (dropshot): request completed latency_us = 24689 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49819 req_id = 0597d1e0-3d53-4c31-945e-faa39f3f9650 response_code = 200 uri = /crucible/0/regions/594211bd-3de4-4582-8c02-399344de69d3/snapshots/1f5b562c-6f27-4b6c-b741-f40becb84c6b/run