Max level shown:
12024-05-20T20:49:38.205ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:49873
22024-05-20T20:49:38.205ZINFOcrucible-agent (datafile): region b8cdfae7-fdae-4d4b-8799-7e61d1a9f29a state: Requested
32024-05-20T20:49:38.206ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-05-20T20:49:38.206ZINFOcrucible-agent (dropshot): request completed latency_us = 1108 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49873 req_id = 5b32de67-d294-4d62-acab-57fb06521a2b response_code = 200 uri = /crucible/0/regions
52024-05-20T20:49:38.217ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_63a0c9f9-e34d-401c-a2ae-4888bfc580e3/crucible/regions/b8cdfae7-fdae-4d4b-8799-7e61d1a9f29a
62024-05-20T20:49:38.217ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_63a0c9f9-e34d-401c-a2ae-4888bfc580e3/crucible/regions/b8cdfae7-fdae-4d4b-8799-7e61d1a9f29a
72024-05-20T20:49:38.275ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b8cdfae7-fdae-4d4b-8799-7e61d1a9f29a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b8cdfae7-fdae-4d4b-8799-7e61d1a9f29a" region = b8cdfae7-fdae-4d4b-8799-7e61d1a9f29a
82024-05-20T20:49:38.275ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b8cdfae7-fdae-4d4b-8799-7e61d1a9f29a" "--data" "/data/regions/b8cdfae7-fdae-4d4b-8799-7e61d1a9f29a" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b8cdfae7-fdae-4d4b-8799-7e61d1a9f29a
92024-05-20T20:49:38.334ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49873 req_id = 42bc73f8-08e9-4459-bb6f-27a10c2fb4ea response_code = 200 uri = /crucible/0/regions
102024-05-20T20:49:38.382ZINFOcrucible-agent (worker): region files created ok region = b8cdfae7-fdae-4d4b-8799-7e61d1a9f29a
112024-05-20T20:49:38.382ZINFOcrucible-agent (datafile): region b8cdfae7-fdae-4d4b-8799-7e61d1a9f29a state: Requested -> Created
122024-05-20T20:49:38.382ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-05-20T20:49:38.382ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b8cdfae7-fdae-4d4b-8799-7e61d1a9f29a
142024-05-20T20:49:38.390ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b8cdfae7-fdae-4d4b-8799-7e61d1a9f29a
152024-05-20T20:49:38.415ZINFOcrucible-agent (worker): creating config property group
162024-05-20T20:49:38.418ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b8cdfae7-fdae-4d4b-8799-7e61d1a9f29a
172024-05-20T20:49:38.418ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b8cdfae7-fdae-4d4b-8799-7e61d1a9f29a
182024-05-20T20:49:38.418ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192024-05-20T20:49:38.418ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202024-05-20T20:49:38.418ZINFOcrucible-agent (worker): commit
212024-05-20T20:49:38.426ZINFOcrucible-agent (worker): ok!
222024-05-20T20:49:38.435ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb
232024-05-20T20:49:38.436ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
242024-05-20T20:49:38.436ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::17
252024-05-20T20:49:38.436ZINFOcrucible-agent (worker): reconfig required
262024-05-20T20:49:38.436ZINFOcrucible-agent (worker): using existing config property group
272024-05-20T20:49:38.436ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c06e6554-1342-4f0b-8a1a-c43dee9489cb
282024-05-20T20:49:38.436ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb
292024-05-20T20:49:38.436ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302024-05-20T20:49:38.436ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
312024-05-20T20:49:38.436ZINFOcrucible-agent (worker): commit
322024-05-20T20:49:38.455ZINFOcrucible-agent (worker): ok!
332024-05-20T20:49:38.455ZINFOcrucible-agent (worker): SMF ok!
342024-05-20T20:49:38.887ZINFOcrucible-agent (dropshot): request completed latency_us = 895 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49873 req_id = 2d46d550-4dd8-4d85-acff-52699960b746 response_code = 200 uri = /crucible/0/regions
352024-05-20T20:49:39.295ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:48141
362024-05-20T20:49:39.299ZINFOcrucible-agent (dropshot): request completed latency_us = 3103 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48141 req_id = 42e3bb6c-59ed-4f44-9658-a31236f28f92 response_code = 200 uri = /crucible/0/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb
372024-05-20T20:49:39.299ZINFOcrucible-agent (datafile): path is "/data/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb"
382024-05-20T20:49:39.308ZINFOcrucible-agent (datafile): dataset is oxp_63a0c9f9-e34d-401c-a2ae-4888bfc580e3/crucible/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb
392024-05-20T20:49:39.317ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_63a0c9f9-e34d-401c-a2ae-4888bfc580e3/crucible/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb@d410121f-bcfb-49e7-8009-f5046fce91de
402024-05-20T20:49:39.317ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_63a0c9f9-e34d-401c-a2ae-4888bfc580e3/crucible/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb", "d410121f-bcfb-49e7-8009-f5046fce91de"]
412024-05-20T20:49:39.330ZINFOcrucible-agent (dropshot): request completed latency_us = 31364 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48141 req_id = a6959081-493c-4bda-8da8-c868c48da449 response_code = 200 uri = /crucible/0/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb/snapshots/d410121f-bcfb-49e7-8009-f5046fce91de
422024-05-20T20:49:39.330ZINFOcrucible-agent (datafile): path is "/data/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb"
432024-05-20T20:49:39.338ZINFOcrucible-agent (datafile): dataset is oxp_63a0c9f9-e34d-401c-a2ae-4888bfc580e3/crucible/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb
442024-05-20T20:49:39.346ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_63a0c9f9-e34d-401c-a2ae-4888bfc580e3/crucible/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb@d410121f-bcfb-49e7-8009-f5046fce91de
452024-05-20T20:49:39.346ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_63a0c9f9-e34d-401c-a2ae-4888bfc580e3/crucible/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb", "d410121f-bcfb-49e7-8009-f5046fce91de"]
462024-05-20T20:49:39.354ZINFOcrucible-agent (datafile): requesting running snapshot c06e6554-1342-4f0b-8a1a-c43dee9489cb-d410121f-bcfb-49e7-8009-f5046fce91de state: Requested
472024-05-20T20:49:39.354ZINFOcrucible-agent (worker): applying SMF actions for region c06e6554-1342-4f0b-8a1a-c43dee9489cb running snapshot d410121f-bcfb-49e7-8009-f5046fce91de (state Requested)...
482024-05-20T20:49:39.354ZINFOcrucible-agent (dropshot): request completed latency_us = 23908 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48141 req_id = a46045b4-0dd6-4db7-93c9-5f73cb1a18ff response_code = 200 uri = /crucible/0/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb/snapshots/d410121f-bcfb-49e7-8009-f5046fce91de/run
492024-05-20T20:49:39.356ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb
502024-05-20T20:49:39.356ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
512024-05-20T20:49:39.356ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::17
522024-05-20T20:49:39.356ZINFOcrucible-agent (worker): reconfig required
532024-05-20T20:49:39.356ZINFOcrucible-agent (worker): using existing config property group
542024-05-20T20:49:39.356ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c06e6554-1342-4f0b-8a1a-c43dee9489cb
552024-05-20T20:49:39.356ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb
562024-05-20T20:49:39.356ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
572024-05-20T20:49:39.357ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
582024-05-20T20:49:39.357ZINFOcrucible-agent (worker): commit
592024-05-20T20:49:39.366ZINFOcrucible-agent (worker): ok!
602024-05-20T20:49:39.366ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-c06e6554-1342-4f0b-8a1a-c43dee9489cb-d410121f-bcfb-49e7-8009-f5046fce91de
612024-05-20T20:49:39.374ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-c06e6554-1342-4f0b-8a1a-c43dee9489cb-d410121f-bcfb-49e7-8009-f5046fce91de
622024-05-20T20:49:39.395ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-c06e6554-1342-4f0b-8a1a-c43dee9489cb-d410121f-bcfb-49e7-8009-f5046fce91de
632024-05-20T20:49:39.395ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c06e6554-1342-4f0b-8a1a-c43dee9489cb/.zfs/snapshot/d410121f-bcfb-49e7-8009-f5046fce91de
642024-05-20T20:49:39.395ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
652024-05-20T20:49:39.395ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
662024-05-20T20:49:39.395ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
672024-05-20T20:49:39.395ZINFOcrucible-agent (worker): commit
682024-05-20T20:49:39.400ZINFOcrucible-agent (worker): ok!
692024-05-20T20:49:39.406ZINFOcrucible-agent (worker): SMF ok!
702024-05-20T20:49:39.406ZINFOcrucible-agent (datafile): region c06e6554-1342-4f0b-8a1a-c43dee9489cb running snapshot d410121f-bcfb-49e7-8009-f5046fce91de state: Requested -> Created