Max level shown:
12024-12-20T21:23:44.472ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:34996
22024-12-20T21:23:44.473ZINFOcrucible-agent (datafile): region 4a6e059e-f702-474c-a549-03161f3704c9 state: Requested
32024-12-20T21:23:44.473ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-12-20T21:23:44.473ZINFOcrucible-agent (dropshot): request completed latency_us = 670 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34996 req_id = d3611563-cb61-42f8-8e27-f34ac61b837b response_code = 200 uri = /crucible/0/regions
52024-12-20T21:23:44.484ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_70bee423-c23a-4941-9c18-69f4feca1839/crucible/regions/4a6e059e-f702-474c-a549-03161f3704c9
62024-12-20T21:23:44.484ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_70bee423-c23a-4941-9c18-69f4feca1839/crucible/regions/4a6e059e-f702-474c-a549-03161f3704c9
72024-12-20T21:23:44.544ZINFOcrucible-agent (worker): creating region Region { id: RegionId("4a6e059e-f702-474c-a549-03161f3704c9"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/4a6e059e-f702-474c-a549-03161f3704c9" region = 4a6e059e-f702-474c-a549-03161f3704c9
82024-12-20T21:23:44.544ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "4a6e059e-f702-474c-a549-03161f3704c9" "--data" "/data/regions/4a6e059e-f702-474c-a549-03161f3704c9" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 4a6e059e-f702-474c-a549-03161f3704c9
92024-12-20T21:23:44.619ZINFOcrucible-agent (worker): region files created ok region = 4a6e059e-f702-474c-a549-03161f3704c9
102024-12-20T21:23:44.619ZINFOcrucible-agent (datafile): region 4a6e059e-f702-474c-a549-03161f3704c9 state: Requested -> Created
112024-12-20T21:23:44.619ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-12-20T21:23:44.629ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-4a6e059e-f702-474c-a549-03161f3704c9
132024-12-20T21:23:44.633ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-4a6e059e-f702-474c-a549-03161f3704c9
142024-12-20T21:23:44.643ZINFOcrucible-agent (worker): creating config property group
152024-12-20T21:23:44.646ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-4a6e059e-f702-474c-a549-03161f3704c9
162024-12-20T21:23:44.646ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4a6e059e-f702-474c-a549-03161f3704c9
172024-12-20T21:23:44.647ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-12-20T21:23:44.647ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
192024-12-20T21:23:44.647ZINFOcrucible-agent (worker): commit
202024-12-20T21:23:44.650ZINFOcrucible-agent (worker): ok!
212024-12-20T21:23:44.655ZINFOcrucible-agent (worker): SMF ok!
222024-12-20T21:23:44.823ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34996 req_id = e0a1bf37-36dd-4618-8ac5-7ea34dc724ca response_code = 200 uri = /crucible/0/regions
232024-12-20T21:23:45.857ZINFOcrucible-agent (dropshot): request completed latency_us = 2270 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34996 req_id = b02496a6-ab02-4103-aa94-74f7b2b83bf0 response_code = 200 uri = /crucible/0/regions/1784575f-a29b-4ece-81d6-7560a1283e58
242024-12-20T21:23:45.862ZINFOcrucible-agent (datafile): path is "/data/regions/1784575f-a29b-4ece-81d6-7560a1283e58"
252024-12-20T21:23:45.871ZINFOcrucible-agent (datafile): dataset is oxp_70bee423-c23a-4941-9c18-69f4feca1839/crucible/regions/1784575f-a29b-4ece-81d6-7560a1283e58
262024-12-20T21:23:45.880ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_70bee423-c23a-4941-9c18-69f4feca1839/crucible/regions/1784575f-a29b-4ece-81d6-7560a1283e58@812aba1a-43d8-4873-9cc9-584d0db4c919
272024-12-20T21:23:45.880ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_70bee423-c23a-4941-9c18-69f4feca1839/crucible/regions/1784575f-a29b-4ece-81d6-7560a1283e58", "812aba1a-43d8-4873-9cc9-584d0db4c919"]
282024-12-20T21:23:45.890ZINFOcrucible-agent (dropshot): request completed latency_us = 28025 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34996 req_id = c790b93e-d42f-4338-a233-09f949be84a5 response_code = 200 uri = /crucible/0/regions/1784575f-a29b-4ece-81d6-7560a1283e58/snapshots/812aba1a-43d8-4873-9cc9-584d0db4c919
292024-12-20T21:23:45.895ZINFOcrucible-agent (datafile): path is "/data/regions/1784575f-a29b-4ece-81d6-7560a1283e58"
302024-12-20T21:23:45.903ZINFOcrucible-agent (datafile): dataset is oxp_70bee423-c23a-4941-9c18-69f4feca1839/crucible/regions/1784575f-a29b-4ece-81d6-7560a1283e58
312024-12-20T21:23:45.911ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_70bee423-c23a-4941-9c18-69f4feca1839/crucible/regions/1784575f-a29b-4ece-81d6-7560a1283e58@812aba1a-43d8-4873-9cc9-584d0db4c919
322024-12-20T21:23:45.911ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_70bee423-c23a-4941-9c18-69f4feca1839/crucible/regions/1784575f-a29b-4ece-81d6-7560a1283e58", "812aba1a-43d8-4873-9cc9-584d0db4c919"]
332024-12-20T21:23:45.919ZINFOcrucible-agent (datafile): requesting running snapshot 1784575f-a29b-4ece-81d6-7560a1283e58-812aba1a-43d8-4873-9cc9-584d0db4c919 state: Requested
342024-12-20T21:23:45.919ZINFOcrucible-agent (worker): applying SMF actions for region 1784575f-a29b-4ece-81d6-7560a1283e58 running snapshot 812aba1a-43d8-4873-9cc9-584d0db4c919 (state Requested)...
352024-12-20T21:23:45.919ZINFOcrucible-agent (dropshot): request completed latency_us = 24219 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34996 req_id = fffdb590-059d-4f33-98b7-20167060512a response_code = 200 uri = /crucible/0/regions/1784575f-a29b-4ece-81d6-7560a1283e58/snapshots/812aba1a-43d8-4873-9cc9-584d0db4c919/run
362024-12-20T21:23:45.922ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-1784575f-a29b-4ece-81d6-7560a1283e58-812aba1a-43d8-4873-9cc9-584d0db4c919
372024-12-20T21:23:45.930ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-1784575f-a29b-4ece-81d6-7560a1283e58-812aba1a-43d8-4873-9cc9-584d0db4c919
382024-12-20T21:23:45.941ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-1784575f-a29b-4ece-81d6-7560a1283e58-812aba1a-43d8-4873-9cc9-584d0db4c919
392024-12-20T21:23:45.941ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1784575f-a29b-4ece-81d6-7560a1283e58/.zfs/snapshot/812aba1a-43d8-4873-9cc9-584d0db4c919
402024-12-20T21:23:45.941ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412024-12-20T21:23:45.942ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422024-12-20T21:23:45.942ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
432024-12-20T21:23:45.942ZINFOcrucible-agent (worker): commit
442024-12-20T21:23:45.946ZINFOcrucible-agent (worker): ok!
452024-12-20T21:23:45.951ZINFOcrucible-agent (worker): SMF ok!
462024-12-20T21:23:45.951ZINFOcrucible-agent (datafile): region 1784575f-a29b-4ece-81d6-7560a1283e58 running snapshot 812aba1a-43d8-4873-9cc9-584d0db4c919 state: Requested -> Created
472024-12-20T21:23:46.095ZINFOcrucible-agent (datafile): path is "/data/regions/1784575f-a29b-4ece-81d6-7560a1283e58"
482024-12-20T21:23:46.103ZINFOcrucible-agent (datafile): dataset is oxp_70bee423-c23a-4941-9c18-69f4feca1839/crucible/regions/1784575f-a29b-4ece-81d6-7560a1283e58
492024-12-20T21:23:46.111ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_70bee423-c23a-4941-9c18-69f4feca1839/crucible/regions/1784575f-a29b-4ece-81d6-7560a1283e58@812aba1a-43d8-4873-9cc9-584d0db4c919
502024-12-20T21:23:46.111ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_70bee423-c23a-4941-9c18-69f4feca1839/crucible/regions/1784575f-a29b-4ece-81d6-7560a1283e58", "812aba1a-43d8-4873-9cc9-584d0db4c919"]
512024-12-20T21:23:46.119ZINFOcrucible-agent (dropshot): request completed latency_us = 23824 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34996 req_id = 4527e1d5-61d5-421c-b6e0-64d33aca2010 response_code = 200 uri = /crucible/0/regions/1784575f-a29b-4ece-81d6-7560a1283e58/snapshots/812aba1a-43d8-4873-9cc9-584d0db4c919/run