Max level shown:
12024-12-03T23:24:22.339ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:33156
22024-12-03T23:24:22.340ZINFOcrucible-agent (datafile): region e354d70e-7351-41d5-8d28-560f3bd0a357 state: Requested
32024-12-03T23:24:22.341ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-12-03T23:24:22.341ZINFOcrucible-agent (dropshot): request completed latency_us = 1570 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33156 req_id = aee5c904-d093-434e-921e-dc02a5577552 response_code = 200 uri = /crucible/0/regions
52024-12-03T23:24:22.352ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crucible/regions/e354d70e-7351-41d5-8d28-560f3bd0a357
62024-12-03T23:24:22.352ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crucible/regions/e354d70e-7351-41d5-8d28-560f3bd0a357
72024-12-03T23:24:22.429ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e354d70e-7351-41d5-8d28-560f3bd0a357"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e354d70e-7351-41d5-8d28-560f3bd0a357" region = e354d70e-7351-41d5-8d28-560f3bd0a357
82024-12-03T23:24:22.429ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e354d70e-7351-41d5-8d28-560f3bd0a357" "--data" "/data/regions/e354d70e-7351-41d5-8d28-560f3bd0a357" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e354d70e-7351-41d5-8d28-560f3bd0a357
92024-12-03T23:24:22.567ZINFOcrucible-agent (dropshot): request completed latency_us = 92 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33156 req_id = 3ebea269-fb5d-45f3-989b-356ba8f25a05 response_code = 200 uri = /crucible/0/regions
102024-12-03T23:24:22.579ZINFOcrucible-agent (worker): region files created ok region = e354d70e-7351-41d5-8d28-560f3bd0a357
112024-12-03T23:24:22.579ZINFOcrucible-agent (datafile): region e354d70e-7351-41d5-8d28-560f3bd0a357 state: Requested -> Created
122024-12-03T23:24:22.579ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-12-03T23:24:22.580ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e354d70e-7351-41d5-8d28-560f3bd0a357
142024-12-03T23:24:22.590ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e354d70e-7351-41d5-8d28-560f3bd0a357
152024-12-03T23:24:22.610ZINFOcrucible-agent (worker): creating config property group
162024-12-03T23:24:22.615ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e354d70e-7351-41d5-8d28-560f3bd0a357
172024-12-03T23:24:22.616ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e354d70e-7351-41d5-8d28-560f3bd0a357
182024-12-03T23:24:22.616ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192024-12-03T23:24:22.616ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
202024-12-03T23:24:22.616ZINFOcrucible-agent (worker): commit
212024-12-03T23:24:22.623ZINFOcrucible-agent (worker): ok!
222024-12-03T23:24:22.632ZINFOcrucible-agent (worker): SMF ok!
232024-12-03T23:24:23.253ZINFOcrucible-agent (dropshot): request completed latency_us = 585 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33156 req_id = 9a7881a6-4399-477e-9f82-2be80d45f72b response_code = 200 uri = /crucible/0/regions
242024-12-03T23:24:24.711ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33156 req_id = 148f8c30-aa8a-4ebb-afa3-6f4a26b28e7b response_code = 200 uri = /crucible/0/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369
252024-12-03T23:24:24.714ZINFOcrucible-agent (datafile): path is "/data/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369"
262024-12-03T23:24:24.724ZINFOcrucible-agent (datafile): dataset is oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crucible/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369
272024-12-03T23:24:24.733ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crucible/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369@2da0147d-9916-4d13-b009-98e10bff43de
282024-12-03T23:24:24.733ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crucible/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369", "2da0147d-9916-4d13-b009-98e10bff43de"]
292024-12-03T23:24:24.745ZINFOcrucible-agent (dropshot): request completed latency_us = 30225 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33156 req_id = d37381dd-0508-43da-a70d-de38eeebdb5a response_code = 200 uri = /crucible/0/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369/snapshots/2da0147d-9916-4d13-b009-98e10bff43de
302024-12-03T23:24:24.748ZINFOcrucible-agent (datafile): path is "/data/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369"
312024-12-03T23:24:24.757ZINFOcrucible-agent (datafile): dataset is oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crucible/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369
322024-12-03T23:24:24.765ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crucible/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369@2da0147d-9916-4d13-b009-98e10bff43de
332024-12-03T23:24:24.765ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crucible/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369", "2da0147d-9916-4d13-b009-98e10bff43de"]
342024-12-03T23:24:24.773ZINFOcrucible-agent (datafile): requesting running snapshot fd66ddb0-e9ee-4316-8fa4-4030bce7f369-2da0147d-9916-4d13-b009-98e10bff43de state: Requested
352024-12-03T23:24:24.774ZINFOcrucible-agent (worker): applying SMF actions for region fd66ddb0-e9ee-4316-8fa4-4030bce7f369 running snapshot 2da0147d-9916-4d13-b009-98e10bff43de (state Requested)...
362024-12-03T23:24:24.774ZINFOcrucible-agent (dropshot): request completed latency_us = 25511 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33156 req_id = 058de054-6694-40a8-9f66-2b215d5b14e6 response_code = 200 uri = /crucible/0/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369/snapshots/2da0147d-9916-4d13-b009-98e10bff43de/run
372024-12-03T23:24:24.776ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-fd66ddb0-e9ee-4316-8fa4-4030bce7f369-2da0147d-9916-4d13-b009-98e10bff43de
382024-12-03T23:24:24.781ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-fd66ddb0-e9ee-4316-8fa4-4030bce7f369-2da0147d-9916-4d13-b009-98e10bff43de
392024-12-03T23:24:24.793ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-fd66ddb0-e9ee-4316-8fa4-4030bce7f369-2da0147d-9916-4d13-b009-98e10bff43de
402024-12-03T23:24:24.794ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369/.zfs/snapshot/2da0147d-9916-4d13-b009-98e10bff43de
412024-12-03T23:24:24.794ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422024-12-03T23:24:24.794ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432024-12-03T23:24:24.794ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
442024-12-03T23:24:24.794ZINFOcrucible-agent (worker): commit
452024-12-03T23:24:24.798ZINFOcrucible-agent (worker): ok!
462024-12-03T23:24:24.811ZINFOcrucible-agent (worker): SMF ok!
472024-12-03T23:24:24.811ZINFOcrucible-agent (datafile): region fd66ddb0-e9ee-4316-8fa4-4030bce7f369 running snapshot 2da0147d-9916-4d13-b009-98e10bff43de state: Requested -> Created
482024-12-03T23:24:25.037ZINFOcrucible-agent (datafile): path is "/data/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369"
492024-12-03T23:24:25.049ZINFOcrucible-agent (datafile): dataset is oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crucible/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369
502024-12-03T23:24:25.062ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crucible/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369@2da0147d-9916-4d13-b009-98e10bff43de
512024-12-03T23:24:25.062ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crucible/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369", "2da0147d-9916-4d13-b009-98e10bff43de"]
522024-12-03T23:24:25.074ZINFOcrucible-agent (dropshot): request completed latency_us = 37690 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33156 req_id = 2abd24d5-2cd0-4e6d-8462-aea2406fb6a1 response_code = 200 uri = /crucible/0/regions/fd66ddb0-e9ee-4316-8fa4-4030bce7f369/snapshots/2da0147d-9916-4d13-b009-98e10bff43de/run