Max level shown:
12024-11-06T00:31:07.319ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:45964
22024-11-06T00:31:07.319ZINFOcrucible-agent (datafile): region a054371a-9ece-4449-b24f-e8e3258d93ec state: Requested
32024-11-06T00:31:07.320ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-11-06T00:31:07.320ZINFOcrucible-agent (dropshot): request completed latency_us = 651 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45964 req_id = e2dd4cf9-2391-4c9f-bffb-887220c51b76 response_code = 200 uri = /crucible/0/regions
52024-11-06T00:31:07.330ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_0ff26524-4a22-4458-bf83-380365ee3e3b/crucible/regions/a054371a-9ece-4449-b24f-e8e3258d93ec
62024-11-06T00:31:07.330ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_0ff26524-4a22-4458-bf83-380365ee3e3b/crucible/regions/a054371a-9ece-4449-b24f-e8e3258d93ec
72024-11-06T00:31:07.381ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a054371a-9ece-4449-b24f-e8e3258d93ec"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a054371a-9ece-4449-b24f-e8e3258d93ec" region = a054371a-9ece-4449-b24f-e8e3258d93ec
82024-11-06T00:31:07.381ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a054371a-9ece-4449-b24f-e8e3258d93ec" "--data" "/data/regions/a054371a-9ece-4449-b24f-e8e3258d93ec" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = a054371a-9ece-4449-b24f-e8e3258d93ec
92024-11-06T00:31:07.467ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45964 req_id = ace80762-b268-4239-a28c-d5dedbec24a8 response_code = 200 uri = /crucible/0/regions
102024-11-06T00:31:07.492ZINFOcrucible-agent (worker): region files created ok region = a054371a-9ece-4449-b24f-e8e3258d93ec
112024-11-06T00:31:07.492ZINFOcrucible-agent (datafile): region a054371a-9ece-4449-b24f-e8e3258d93ec state: Requested -> Created
122024-11-06T00:31:07.492ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-11-06T00:31:07.503ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a054371a-9ece-4449-b24f-e8e3258d93ec
142024-11-06T00:31:07.508ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a054371a-9ece-4449-b24f-e8e3258d93ec
152024-11-06T00:31:07.517ZINFOcrucible-agent (worker): creating config property group
162024-11-06T00:31:07.522ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a054371a-9ece-4449-b24f-e8e3258d93ec
172024-11-06T00:31:07.522ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a054371a-9ece-4449-b24f-e8e3258d93ec
182024-11-06T00:31:07.522ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192024-11-06T00:31:07.522ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
202024-11-06T00:31:07.522ZINFOcrucible-agent (worker): commit
212024-11-06T00:31:07.526ZINFOcrucible-agent (worker): ok!
222024-11-06T00:31:07.532ZINFOcrucible-agent (worker): SMF ok!
232024-11-06T00:31:08.097ZINFOcrucible-agent (dropshot): request completed latency_us = 104 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45964 req_id = 507383be-1191-4e26-bff7-96895e864557 response_code = 200 uri = /crucible/0/regions
242024-11-06T00:31:08.743ZINFOcrucible-agent (dropshot): request completed latency_us = 4854 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45964 req_id = b43d3d11-e2eb-4b51-811b-fa4729e1276e response_code = 200 uri = /crucible/0/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74
252024-11-06T00:31:08.746ZINFOcrucible-agent (datafile): path is "/data/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74"
262024-11-06T00:31:08.756ZINFOcrucible-agent (datafile): dataset is oxp_0ff26524-4a22-4458-bf83-380365ee3e3b/crucible/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74
272024-11-06T00:31:08.764ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_0ff26524-4a22-4458-bf83-380365ee3e3b/crucible/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74@8b2876c8-bc26-40c3-8c6e-b7deeb4993fa
282024-11-06T00:31:08.764ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_0ff26524-4a22-4458-bf83-380365ee3e3b/crucible/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74", "8b2876c8-bc26-40c3-8c6e-b7deeb4993fa"]
292024-11-06T00:31:08.775ZINFOcrucible-agent (dropshot): request completed latency_us = 28932 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45964 req_id = 213848b2-621f-4d6b-8098-743ebf07e1fb response_code = 200 uri = /crucible/0/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74/snapshots/8b2876c8-bc26-40c3-8c6e-b7deeb4993fa
302024-11-06T00:31:08.781ZINFOcrucible-agent (datafile): path is "/data/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74"
312024-11-06T00:31:08.789ZINFOcrucible-agent (datafile): dataset is oxp_0ff26524-4a22-4458-bf83-380365ee3e3b/crucible/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74
322024-11-06T00:31:08.797ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_0ff26524-4a22-4458-bf83-380365ee3e3b/crucible/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74@8b2876c8-bc26-40c3-8c6e-b7deeb4993fa
332024-11-06T00:31:08.797ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_0ff26524-4a22-4458-bf83-380365ee3e3b/crucible/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74", "8b2876c8-bc26-40c3-8c6e-b7deeb4993fa"]
342024-11-06T00:31:08.806ZINFOcrucible-agent (datafile): requesting running snapshot 855f914f-a2a5-4a8b-9fe9-33a9f28b0a74-8b2876c8-bc26-40c3-8c6e-b7deeb4993fa state: Requested
352024-11-06T00:31:08.806ZINFOcrucible-agent (worker): applying SMF actions for region 855f914f-a2a5-4a8b-9fe9-33a9f28b0a74 running snapshot 8b2876c8-bc26-40c3-8c6e-b7deeb4993fa (state Requested)...
362024-11-06T00:31:08.806ZINFOcrucible-agent (dropshot): request completed latency_us = 25350 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45964 req_id = c5a9fb94-ecc6-4819-9ad1-901fa2a5f7c0 response_code = 200 uri = /crucible/0/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74/snapshots/8b2876c8-bc26-40c3-8c6e-b7deeb4993fa/run
372024-11-06T00:31:08.808ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-855f914f-a2a5-4a8b-9fe9-33a9f28b0a74-8b2876c8-bc26-40c3-8c6e-b7deeb4993fa
382024-11-06T00:31:08.813ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-855f914f-a2a5-4a8b-9fe9-33a9f28b0a74-8b2876c8-bc26-40c3-8c6e-b7deeb4993fa
392024-11-06T00:31:08.824ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-855f914f-a2a5-4a8b-9fe9-33a9f28b0a74-8b2876c8-bc26-40c3-8c6e-b7deeb4993fa
402024-11-06T00:31:08.824ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74/.zfs/snapshot/8b2876c8-bc26-40c3-8c6e-b7deeb4993fa
412024-11-06T00:31:08.824ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422024-11-06T00:31:08.824ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432024-11-06T00:31:08.824ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
442024-11-06T00:31:08.825ZINFOcrucible-agent (worker): commit
452024-11-06T00:31:08.829ZINFOcrucible-agent (worker): ok!
462024-11-06T00:31:08.834ZINFOcrucible-agent (worker): SMF ok!
472024-11-06T00:31:08.834ZINFOcrucible-agent (datafile): region 855f914f-a2a5-4a8b-9fe9-33a9f28b0a74 running snapshot 8b2876c8-bc26-40c3-8c6e-b7deeb4993fa state: Requested -> Created
482024-11-06T00:31:08.989ZINFOcrucible-agent (datafile): path is "/data/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74"
492024-11-06T00:31:08.998ZINFOcrucible-agent (datafile): dataset is oxp_0ff26524-4a22-4458-bf83-380365ee3e3b/crucible/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74
502024-11-06T00:31:09.006ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_0ff26524-4a22-4458-bf83-380365ee3e3b/crucible/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74@8b2876c8-bc26-40c3-8c6e-b7deeb4993fa
512024-11-06T00:31:09.006ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_0ff26524-4a22-4458-bf83-380365ee3e3b/crucible/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74", "8b2876c8-bc26-40c3-8c6e-b7deeb4993fa"]
522024-11-06T00:31:09.014ZINFOcrucible-agent (dropshot): request completed latency_us = 24861 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45964 req_id = ff559ad7-3724-4a99-82b8-7132a5739742 response_code = 200 uri = /crucible/0/regions/855f914f-a2a5-4a8b-9fe9-33a9f28b0a74/snapshots/8b2876c8-bc26-40c3-8c6e-b7deeb4993fa/run