Max level shown:
12024-12-20T22:15:16.011ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:60887
22024-12-20T22:15:16.011ZINFOcrucible-agent (datafile): region 40f79e49-01b8-4842-96cb-22389ab6b67a state: Requested
32024-12-20T22:15:16.011ZINFOcrucible-agent (dropshot): request completed latency_us = 240 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60887 req_id = a0671973-3e94-49ca-8ae8-fa9d788504a7 response_code = 200 uri = /crucible/0/regions
42024-12-20T22:15:16.011ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52024-12-20T22:15:16.021ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_96b506a8-bd99-4463-82e2-f893b588d103/crucible/regions/40f79e49-01b8-4842-96cb-22389ab6b67a
62024-12-20T22:15:16.021ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_96b506a8-bd99-4463-82e2-f893b588d103/crucible/regions/40f79e49-01b8-4842-96cb-22389ab6b67a
72024-12-20T22:15:16.070ZINFOcrucible-agent (worker): creating region Region { id: RegionId("40f79e49-01b8-4842-96cb-22389ab6b67a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/40f79e49-01b8-4842-96cb-22389ab6b67a" region = 40f79e49-01b8-4842-96cb-22389ab6b67a
82024-12-20T22:15:16.072ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "40f79e49-01b8-4842-96cb-22389ab6b67a" "--data" "/data/regions/40f79e49-01b8-4842-96cb-22389ab6b67a" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 40f79e49-01b8-4842-96cb-22389ab6b67a
92024-12-20T22:15:16.139ZINFOcrucible-agent (worker): region files created ok region = 40f79e49-01b8-4842-96cb-22389ab6b67a
102024-12-20T22:15:16.139ZINFOcrucible-agent (datafile): region 40f79e49-01b8-4842-96cb-22389ab6b67a state: Requested -> Created
112024-12-20T22:15:16.139ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-12-20T22:15:16.141ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-40f79e49-01b8-4842-96cb-22389ab6b67a
132024-12-20T22:15:16.144ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-40f79e49-01b8-4842-96cb-22389ab6b67a
142024-12-20T22:15:16.151ZINFOcrucible-agent (worker): creating config property group
152024-12-20T22:15:16.155ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-40f79e49-01b8-4842-96cb-22389ab6b67a
162024-12-20T22:15:16.155ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/40f79e49-01b8-4842-96cb-22389ab6b67a
172024-12-20T22:15:16.155ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182024-12-20T22:15:16.155ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
192024-12-20T22:15:16.155ZINFOcrucible-agent (worker): commit
202024-12-20T22:15:16.160ZINFOcrucible-agent (worker): ok!
212024-12-20T22:15:16.165ZINFOcrucible-agent (worker): SMF ok!
222024-12-20T22:15:16.174ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60887 req_id = 0a48c370-d181-4286-8e03-e35e440ba545 response_code = 200 uri = /crucible/0/regions
232024-12-20T22:25:17.838ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:48628
242024-12-20T22:25:17.838ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48628 req_id = 21fe1610-5230-458f-b0e4-b4ded3839b00 response_code = 200 uri = /crucible/0/regions/40f79e49-01b8-4842-96cb-22389ab6b67a
252024-12-20T22:25:17.841ZINFOcrucible-agent (datafile): path is "/data/regions/40f79e49-01b8-4842-96cb-22389ab6b67a"
262024-12-20T22:25:17.850ZINFOcrucible-agent (datafile): dataset is oxp_96b506a8-bd99-4463-82e2-f893b588d103/crucible/regions/40f79e49-01b8-4842-96cb-22389ab6b67a
272024-12-20T22:25:17.858ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_96b506a8-bd99-4463-82e2-f893b588d103/crucible/regions/40f79e49-01b8-4842-96cb-22389ab6b67a@18029d99-44f7-4d86-bcfb-4a934507d727
282024-12-20T22:25:17.858ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_96b506a8-bd99-4463-82e2-f893b588d103/crucible/regions/40f79e49-01b8-4842-96cb-22389ab6b67a", "18029d99-44f7-4d86-bcfb-4a934507d727"]
292024-12-20T22:25:17.869ZINFOcrucible-agent (dropshot): request completed latency_us = 28053 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48628 req_id = d3ebd880-b6c6-4e30-b9aa-9e4c6c9421e8 response_code = 200 uri = /crucible/0/regions/40f79e49-01b8-4842-96cb-22389ab6b67a/snapshots/18029d99-44f7-4d86-bcfb-4a934507d727
302024-12-20T22:25:17.872ZINFOcrucible-agent (datafile): path is "/data/regions/40f79e49-01b8-4842-96cb-22389ab6b67a"
312024-12-20T22:25:17.880ZINFOcrucible-agent (datafile): dataset is oxp_96b506a8-bd99-4463-82e2-f893b588d103/crucible/regions/40f79e49-01b8-4842-96cb-22389ab6b67a
322024-12-20T22:25:17.887ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_96b506a8-bd99-4463-82e2-f893b588d103/crucible/regions/40f79e49-01b8-4842-96cb-22389ab6b67a@18029d99-44f7-4d86-bcfb-4a934507d727
332024-12-20T22:25:17.887ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_96b506a8-bd99-4463-82e2-f893b588d103/crucible/regions/40f79e49-01b8-4842-96cb-22389ab6b67a", "18029d99-44f7-4d86-bcfb-4a934507d727"]
342024-12-20T22:25:17.896ZINFOcrucible-agent (datafile): requesting running snapshot 40f79e49-01b8-4842-96cb-22389ab6b67a-18029d99-44f7-4d86-bcfb-4a934507d727 state: Requested
352024-12-20T22:25:17.897ZINFOcrucible-agent (worker): applying SMF actions for region 40f79e49-01b8-4842-96cb-22389ab6b67a running snapshot 18029d99-44f7-4d86-bcfb-4a934507d727 (state Requested)...
362024-12-20T22:25:17.897ZINFOcrucible-agent (dropshot): request completed latency_us = 24908 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48628 req_id = e71050b9-279e-44ee-9dfe-3662f28eb294 response_code = 200 uri = /crucible/0/regions/40f79e49-01b8-4842-96cb-22389ab6b67a/snapshots/18029d99-44f7-4d86-bcfb-4a934507d727/run
372024-12-20T22:25:17.906ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-40f79e49-01b8-4842-96cb-22389ab6b67a-18029d99-44f7-4d86-bcfb-4a934507d727
382024-12-20T22:25:17.919ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-40f79e49-01b8-4842-96cb-22389ab6b67a-18029d99-44f7-4d86-bcfb-4a934507d727
392024-12-20T22:25:17.935ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-40f79e49-01b8-4842-96cb-22389ab6b67a-18029d99-44f7-4d86-bcfb-4a934507d727
402024-12-20T22:25:17.935ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/40f79e49-01b8-4842-96cb-22389ab6b67a/.zfs/snapshot/18029d99-44f7-4d86-bcfb-4a934507d727
412024-12-20T22:25:17.936ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
422024-12-20T22:25:17.936ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432024-12-20T22:25:17.936ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
442024-12-20T22:25:17.936ZINFOcrucible-agent (worker): commit
452024-12-20T22:25:17.942ZINFOcrucible-agent (worker): ok!
462024-12-20T22:25:17.947ZINFOcrucible-agent (worker): SMF ok!
472024-12-20T22:25:17.947ZINFOcrucible-agent (datafile): region 40f79e49-01b8-4842-96cb-22389ab6b67a running snapshot 18029d99-44f7-4d86-bcfb-4a934507d727 state: Requested -> Created
482024-12-20T22:25:18.195ZINFOcrucible-agent (datafile): path is "/data/regions/40f79e49-01b8-4842-96cb-22389ab6b67a"
492024-12-20T22:25:18.204ZINFOcrucible-agent (datafile): dataset is oxp_96b506a8-bd99-4463-82e2-f893b588d103/crucible/regions/40f79e49-01b8-4842-96cb-22389ab6b67a
502024-12-20T22:25:18.213ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_96b506a8-bd99-4463-82e2-f893b588d103/crucible/regions/40f79e49-01b8-4842-96cb-22389ab6b67a@18029d99-44f7-4d86-bcfb-4a934507d727
512024-12-20T22:25:18.213ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_96b506a8-bd99-4463-82e2-f893b588d103/crucible/regions/40f79e49-01b8-4842-96cb-22389ab6b67a", "18029d99-44f7-4d86-bcfb-4a934507d727"]
522024-12-20T22:25:18.221ZINFOcrucible-agent (dropshot): request completed latency_us = 25789 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48628 req_id = 3cca13be-0334-4b3f-822f-4130d4b56bbd response_code = 200 uri = /crucible/0/regions/40f79e49-01b8-4842-96cb-22389ab6b67a/snapshots/18029d99-44f7-4d86-bcfb-4a934507d727/run