Max level shown:
12024-12-20T22:15:16.010ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:62237
22024-12-20T22:15:16.011ZINFOcrucible-agent (datafile): region 0a607c87-167e-469a-92a0-0e956013b1e5 state: Requested
32024-12-20T22:15:16.011ZINFOcrucible-agent (dropshot): request completed latency_us = 211 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62237 req_id = b4eb932d-98f6-4459-8c0c-6217c8a8f756 response_code = 200 uri = /crucible/0/regions
42024-12-20T22:15:16.011ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52024-12-20T22:15:16.021ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_508e093c-68f5-46ee-82c8-b37133bb2d8a/crucible/regions/0a607c87-167e-469a-92a0-0e956013b1e5
62024-12-20T22:15:16.021ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_508e093c-68f5-46ee-82c8-b37133bb2d8a/crucible/regions/0a607c87-167e-469a-92a0-0e956013b1e5
72024-12-20T22:15:16.079ZINFOcrucible-agent (worker): creating region Region { id: RegionId("0a607c87-167e-469a-92a0-0e956013b1e5"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/0a607c87-167e-469a-92a0-0e956013b1e5" region = 0a607c87-167e-469a-92a0-0e956013b1e5
82024-12-20T22:15:16.081ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "0a607c87-167e-469a-92a0-0e956013b1e5" "--data" "/data/regions/0a607c87-167e-469a-92a0-0e956013b1e5" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 0a607c87-167e-469a-92a0-0e956013b1e5
92024-12-20T22:15:16.144ZINFOcrucible-agent (worker): region files created ok region = 0a607c87-167e-469a-92a0-0e956013b1e5
102024-12-20T22:15:16.144ZINFOcrucible-agent (datafile): region 0a607c87-167e-469a-92a0-0e956013b1e5 state: Requested -> Created
112024-12-20T22:15:16.144ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-12-20T22:15:16.146ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-0a607c87-167e-469a-92a0-0e956013b1e5
132024-12-20T22:15:16.149ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-0a607c87-167e-469a-92a0-0e956013b1e5
142024-12-20T22:15:16.157ZINFOcrucible-agent (worker): creating config property group
152024-12-20T22:15:16.160ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-0a607c87-167e-469a-92a0-0e956013b1e5
162024-12-20T22:15:16.160ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0a607c87-167e-469a-92a0-0e956013b1e5
172024-12-20T22:15:16.160ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182024-12-20T22:15:16.160ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192024-12-20T22:15:16.160ZINFOcrucible-agent (worker): commit
202024-12-20T22:15:16.164ZINFOcrucible-agent (worker): ok!
212024-12-20T22:15:16.169ZINFOcrucible-agent (worker): SMF ok!
222024-12-20T22:15:16.238ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62237 req_id = 3529d255-e5ac-47d7-85ee-7baf241781d3 response_code = 200 uri = /crucible/0/regions
232024-12-20T22:25:18.233ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:41398
242024-12-20T22:25:18.233ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41398 req_id = 5e8d97bd-c281-4025-bc71-846590c77675 response_code = 200 uri = /crucible/0/regions/0a607c87-167e-469a-92a0-0e956013b1e5
252024-12-20T22:25:18.236ZINFOcrucible-agent (datafile): path is "/data/regions/0a607c87-167e-469a-92a0-0e956013b1e5"
262024-12-20T22:25:18.245ZINFOcrucible-agent (datafile): dataset is oxp_508e093c-68f5-46ee-82c8-b37133bb2d8a/crucible/regions/0a607c87-167e-469a-92a0-0e956013b1e5
272024-12-20T22:25:18.254ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_508e093c-68f5-46ee-82c8-b37133bb2d8a/crucible/regions/0a607c87-167e-469a-92a0-0e956013b1e5@18029d99-44f7-4d86-bcfb-4a934507d727
282024-12-20T22:25:18.254ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_508e093c-68f5-46ee-82c8-b37133bb2d8a/crucible/regions/0a607c87-167e-469a-92a0-0e956013b1e5", "18029d99-44f7-4d86-bcfb-4a934507d727"]
292024-12-20T22:25:18.267ZINFOcrucible-agent (dropshot): request completed latency_us = 30796 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41398 req_id = c7136124-5bad-440d-a438-173cc0821cf9 response_code = 200 uri = /crucible/0/regions/0a607c87-167e-469a-92a0-0e956013b1e5/snapshots/18029d99-44f7-4d86-bcfb-4a934507d727
302024-12-20T22:25:18.271ZINFOcrucible-agent (datafile): path is "/data/regions/0a607c87-167e-469a-92a0-0e956013b1e5"
312024-12-20T22:25:18.279ZINFOcrucible-agent (datafile): dataset is oxp_508e093c-68f5-46ee-82c8-b37133bb2d8a/crucible/regions/0a607c87-167e-469a-92a0-0e956013b1e5
322024-12-20T22:25:18.288ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_508e093c-68f5-46ee-82c8-b37133bb2d8a/crucible/regions/0a607c87-167e-469a-92a0-0e956013b1e5@18029d99-44f7-4d86-bcfb-4a934507d727
332024-12-20T22:25:18.288ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_508e093c-68f5-46ee-82c8-b37133bb2d8a/crucible/regions/0a607c87-167e-469a-92a0-0e956013b1e5", "18029d99-44f7-4d86-bcfb-4a934507d727"]
342024-12-20T22:25:18.300ZINFOcrucible-agent (datafile): requesting running snapshot 0a607c87-167e-469a-92a0-0e956013b1e5-18029d99-44f7-4d86-bcfb-4a934507d727 state: Requested
352024-12-20T22:25:18.301ZINFOcrucible-agent (worker): applying SMF actions for region 0a607c87-167e-469a-92a0-0e956013b1e5 running snapshot 18029d99-44f7-4d86-bcfb-4a934507d727 (state Requested)...
362024-12-20T22:25:18.301ZINFOcrucible-agent (dropshot): request completed latency_us = 29996 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41398 req_id = 444fcf43-69cc-4060-a087-3baf2445e510 response_code = 200 uri = /crucible/0/regions/0a607c87-167e-469a-92a0-0e956013b1e5/snapshots/18029d99-44f7-4d86-bcfb-4a934507d727/run
372024-12-20T22:25:18.309ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-0a607c87-167e-469a-92a0-0e956013b1e5-18029d99-44f7-4d86-bcfb-4a934507d727
382024-12-20T22:25:18.323ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-0a607c87-167e-469a-92a0-0e956013b1e5-18029d99-44f7-4d86-bcfb-4a934507d727
392024-12-20T22:25:18.344ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-0a607c87-167e-469a-92a0-0e956013b1e5-18029d99-44f7-4d86-bcfb-4a934507d727
402024-12-20T22:25:18.345ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0a607c87-167e-469a-92a0-0e956013b1e5/.zfs/snapshot/18029d99-44f7-4d86-bcfb-4a934507d727
412024-12-20T22:25:18.345ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
422024-12-20T22:25:18.345ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432024-12-20T22:25:18.345ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
442024-12-20T22:25:18.345ZINFOcrucible-agent (worker): commit
452024-12-20T22:25:18.352ZINFOcrucible-agent (worker): ok!
462024-12-20T22:25:18.362ZINFOcrucible-agent (worker): SMF ok!
472024-12-20T22:25:18.362ZINFOcrucible-agent (datafile): region 0a607c87-167e-469a-92a0-0e956013b1e5 running snapshot 18029d99-44f7-4d86-bcfb-4a934507d727 state: Requested -> Created
482024-12-20T22:25:18.624ZINFOcrucible-agent (datafile): path is "/data/regions/0a607c87-167e-469a-92a0-0e956013b1e5"
492024-12-20T22:25:18.633ZINFOcrucible-agent (datafile): dataset is oxp_508e093c-68f5-46ee-82c8-b37133bb2d8a/crucible/regions/0a607c87-167e-469a-92a0-0e956013b1e5
502024-12-20T22:25:18.641ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_508e093c-68f5-46ee-82c8-b37133bb2d8a/crucible/regions/0a607c87-167e-469a-92a0-0e956013b1e5@18029d99-44f7-4d86-bcfb-4a934507d727
512024-12-20T22:25:18.641ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_508e093c-68f5-46ee-82c8-b37133bb2d8a/crucible/regions/0a607c87-167e-469a-92a0-0e956013b1e5", "18029d99-44f7-4d86-bcfb-4a934507d727"]
522024-12-20T22:25:18.649ZINFOcrucible-agent (dropshot): request completed latency_us = 25248 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41398 req_id = 106bd906-8acc-4eab-a311-2549e61e6dbb response_code = 200 uri = /crucible/0/regions/0a607c87-167e-469a-92a0-0e956013b1e5/snapshots/18029d99-44f7-4d86-bcfb-4a934507d727/run