Max level shown:
12024-12-20T21:33:42.079ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:50716
22024-12-20T21:33:42.079ZINFOcrucible-agent (datafile): region 6cd6fdc5-6d03-4d2f-8fff-84a14496f253 state: Requested
32024-12-20T21:33:42.080ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-12-20T21:33:42.080ZINFOcrucible-agent (dropshot): request completed latency_us = 684 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50716 req_id = 78fc1d1a-7fba-4ae9-a166-d5f084eb9567 response_code = 200 uri = /crucible/0/regions
52024-12-20T21:33:42.092ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_7d8d774a-5a14-4ea7-9916-6f77f3cc41c0/crucible/regions/6cd6fdc5-6d03-4d2f-8fff-84a14496f253
62024-12-20T21:33:42.092ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_7d8d774a-5a14-4ea7-9916-6f77f3cc41c0/crucible/regions/6cd6fdc5-6d03-4d2f-8fff-84a14496f253
72024-12-20T21:33:42.167ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6cd6fdc5-6d03-4d2f-8fff-84a14496f253"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6cd6fdc5-6d03-4d2f-8fff-84a14496f253" region = 6cd6fdc5-6d03-4d2f-8fff-84a14496f253
82024-12-20T21:33:42.167ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6cd6fdc5-6d03-4d2f-8fff-84a14496f253" "--data" "/data/regions/6cd6fdc5-6d03-4d2f-8fff-84a14496f253" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6cd6fdc5-6d03-4d2f-8fff-84a14496f253
92024-12-20T21:33:42.265ZINFOcrucible-agent (dropshot): request completed latency_us = 744 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50716 req_id = f11acd89-5abf-4970-bbc8-5432241bf30c response_code = 200 uri = /crucible/0/regions
102024-12-20T21:33:42.274ZINFOcrucible-agent (worker): region files created ok region = 6cd6fdc5-6d03-4d2f-8fff-84a14496f253
112024-12-20T21:33:42.274ZINFOcrucible-agent (datafile): region 6cd6fdc5-6d03-4d2f-8fff-84a14496f253 state: Requested -> Created
122024-12-20T21:33:42.274ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-12-20T21:33:42.275ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6cd6fdc5-6d03-4d2f-8fff-84a14496f253
142024-12-20T21:33:42.284ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6cd6fdc5-6d03-4d2f-8fff-84a14496f253
152024-12-20T21:33:42.306ZINFOcrucible-agent (worker): creating config property group
162024-12-20T21:33:42.311ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6cd6fdc5-6d03-4d2f-8fff-84a14496f253
172024-12-20T21:33:42.312ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6cd6fdc5-6d03-4d2f-8fff-84a14496f253
182024-12-20T21:33:42.312ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192024-12-20T21:33:42.312ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202024-12-20T21:33:42.312ZINFOcrucible-agent (worker): commit
212024-12-20T21:33:42.318ZINFOcrucible-agent (worker): ok!
222024-12-20T21:33:42.329ZINFOcrucible-agent (worker): SMF ok!
232024-12-20T21:33:42.957ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50716 req_id = 048dd8f7-8929-4ae1-97b6-1af0bf1089bb response_code = 200 uri = /crucible/0/regions
242024-12-20T21:33:44.259ZINFOcrucible-agent (dropshot): request completed latency_us = 2341 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:50716 req_id = fd4adad8-a75a-41b8-8eb3-c331fa6c40c6 response_code = 200 uri = /crucible/0/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c
252024-12-20T21:33:44.262ZINFOcrucible-agent (datafile): path is "/data/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c"
262024-12-20T21:33:44.271ZINFOcrucible-agent (datafile): dataset is oxp_7d8d774a-5a14-4ea7-9916-6f77f3cc41c0/crucible/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c
272024-12-20T21:33:44.279ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7d8d774a-5a14-4ea7-9916-6f77f3cc41c0/crucible/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c@86187af8-bcd6-4306-8505-80d2f62d6b72
282024-12-20T21:33:44.279ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7d8d774a-5a14-4ea7-9916-6f77f3cc41c0/crucible/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c", "86187af8-bcd6-4306-8505-80d2f62d6b72"]
292024-12-20T21:33:44.290ZINFOcrucible-agent (dropshot): request completed latency_us = 27631 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:50716 req_id = 9e21f241-50eb-42b8-b668-e29ef5328740 response_code = 200 uri = /crucible/0/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c/snapshots/86187af8-bcd6-4306-8505-80d2f62d6b72
302024-12-20T21:33:44.294ZINFOcrucible-agent (datafile): path is "/data/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c"
312024-12-20T21:33:44.302ZINFOcrucible-agent (datafile): dataset is oxp_7d8d774a-5a14-4ea7-9916-6f77f3cc41c0/crucible/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c
322024-12-20T21:33:44.310ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7d8d774a-5a14-4ea7-9916-6f77f3cc41c0/crucible/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c@86187af8-bcd6-4306-8505-80d2f62d6b72
332024-12-20T21:33:44.310ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7d8d774a-5a14-4ea7-9916-6f77f3cc41c0/crucible/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c", "86187af8-bcd6-4306-8505-80d2f62d6b72"]
342024-12-20T21:33:44.319ZINFOcrucible-agent (datafile): requesting running snapshot dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c-86187af8-bcd6-4306-8505-80d2f62d6b72 state: Requested
352024-12-20T21:33:44.319ZINFOcrucible-agent (worker): applying SMF actions for region dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c running snapshot 86187af8-bcd6-4306-8505-80d2f62d6b72 (state Requested)...
362024-12-20T21:33:44.319ZINFOcrucible-agent (dropshot): request completed latency_us = 25652 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50716 req_id = 27c566d7-cfef-4736-88fd-af2c335c6ae5 response_code = 200 uri = /crucible/0/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c/snapshots/86187af8-bcd6-4306-8505-80d2f62d6b72/run
372024-12-20T21:33:44.322ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c-86187af8-bcd6-4306-8505-80d2f62d6b72
382024-12-20T21:33:44.333ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c-86187af8-bcd6-4306-8505-80d2f62d6b72
392024-12-20T21:33:44.351ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c-86187af8-bcd6-4306-8505-80d2f62d6b72
402024-12-20T21:33:44.351ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c/.zfs/snapshot/86187af8-bcd6-4306-8505-80d2f62d6b72
412024-12-20T21:33:44.351ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422024-12-20T21:33:44.351ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432024-12-20T21:33:44.351ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
442024-12-20T21:33:44.351ZINFOcrucible-agent (worker): commit
452024-12-20T21:33:44.356ZINFOcrucible-agent (worker): ok!
462024-12-20T21:33:44.364ZINFOcrucible-agent (worker): SMF ok!
472024-12-20T21:33:44.364ZINFOcrucible-agent (datafile): region dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c running snapshot 86187af8-bcd6-4306-8505-80d2f62d6b72 state: Requested -> Created
482024-12-20T21:33:44.474ZINFOcrucible-agent (datafile): path is "/data/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c"
492024-12-20T21:33:44.484ZINFOcrucible-agent (datafile): dataset is oxp_7d8d774a-5a14-4ea7-9916-6f77f3cc41c0/crucible/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c
502024-12-20T21:33:44.492ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7d8d774a-5a14-4ea7-9916-6f77f3cc41c0/crucible/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c@86187af8-bcd6-4306-8505-80d2f62d6b72
512024-12-20T21:33:44.492ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7d8d774a-5a14-4ea7-9916-6f77f3cc41c0/crucible/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c", "86187af8-bcd6-4306-8505-80d2f62d6b72"]
522024-12-20T21:33:44.501ZINFOcrucible-agent (dropshot): request completed latency_us = 27160 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50716 req_id = 7046b309-f1ef-4d27-9dd0-251344a6f17f response_code = 200 uri = /crucible/0/regions/dbdcaaa3-e8a3-44aa-82de-f0a16bf31f7c/snapshots/86187af8-bcd6-4306-8505-80d2f62d6b72/run