Max level shown:
12024-12-21T06:15:04.059ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:55572
22024-12-21T06:15:04.086ZINFOcrucible-agent (datafile): region 1270365f-74f3-4785-a951-29b8aed8f3c8 state: Requested
32024-12-21T06:15:04.094ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-12-21T06:15:04.098ZINFOcrucible-agent (dropshot): request completed latency_us = 14080 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55572 req_id = 887a4409-d3b3-4c38-b885-7cc563760e74 response_code = 200 uri = /crucible/0/regions
52024-12-21T06:15:04.105ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crucible/regions/1270365f-74f3-4785-a951-29b8aed8f3c8
62024-12-21T06:15:04.105ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crucible/regions/1270365f-74f3-4785-a951-29b8aed8f3c8
72024-12-21T06:15:04.157ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1270365f-74f3-4785-a951-29b8aed8f3c8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1270365f-74f3-4785-a951-29b8aed8f3c8" region = 1270365f-74f3-4785-a951-29b8aed8f3c8
82024-12-21T06:15:04.158ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1270365f-74f3-4785-a951-29b8aed8f3c8" "--data" "/data/regions/1270365f-74f3-4785-a951-29b8aed8f3c8" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 1270365f-74f3-4785-a951-29b8aed8f3c8
92024-12-21T06:15:04.245ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55572 req_id = ce1d7800-7e73-4406-a25e-4a1b2f1eb609 response_code = 200 uri = /crucible/0/regions
102024-12-21T06:15:04.365ZINFOcrucible-agent (worker): region files created ok region = 1270365f-74f3-4785-a951-29b8aed8f3c8
112024-12-21T06:15:04.365ZINFOcrucible-agent (datafile): region 1270365f-74f3-4785-a951-29b8aed8f3c8 state: Requested -> Created
122024-12-21T06:15:04.365ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-12-21T06:15:04.365ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1270365f-74f3-4785-a951-29b8aed8f3c8
142024-12-21T06:15:04.370ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1270365f-74f3-4785-a951-29b8aed8f3c8
152024-12-21T06:15:04.382ZINFOcrucible-agent (worker): creating config property group
162024-12-21T06:15:04.385ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1270365f-74f3-4785-a951-29b8aed8f3c8
172024-12-21T06:15:04.386ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1270365f-74f3-4785-a951-29b8aed8f3c8
182024-12-21T06:15:04.386ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-12-21T06:15:04.386ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202024-12-21T06:15:04.386ZINFOcrucible-agent (worker): commit
212024-12-21T06:15:04.390ZINFOcrucible-agent (worker): ok!
222024-12-21T06:15:04.394ZINFOcrucible-agent (worker): SMF ok!
232024-12-21T06:15:04.574ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55572 req_id = f3df7f01-71e2-47ae-aef4-7b1870b6daf2 response_code = 200 uri = /crucible/0/regions
242024-12-21T06:25:11.188ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:39159
252024-12-21T06:25:11.191ZINFOcrucible-agent (dropshot): request completed latency_us = 3367 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:39159 req_id = b93786dd-ea04-4cbd-b017-96c159987224 response_code = 200 uri = /crucible/0/regions/1270365f-74f3-4785-a951-29b8aed8f3c8
262024-12-21T06:25:11.194ZINFOcrucible-agent (datafile): path is "/data/regions/1270365f-74f3-4785-a951-29b8aed8f3c8"
272024-12-21T06:25:11.203ZINFOcrucible-agent (datafile): dataset is oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crucible/regions/1270365f-74f3-4785-a951-29b8aed8f3c8
282024-12-21T06:25:11.213ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crucible/regions/1270365f-74f3-4785-a951-29b8aed8f3c8@ab9dd159-4da4-4a6c-abef-b83a31235fd9
292024-12-21T06:25:11.213ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crucible/regions/1270365f-74f3-4785-a951-29b8aed8f3c8", "ab9dd159-4da4-4a6c-abef-b83a31235fd9"]
302024-12-21T06:25:11.224ZINFOcrucible-agent (dropshot): request completed latency_us = 29628 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:39159 req_id = 49f9eb6e-b379-4b89-aa26-00bcc1222376 response_code = 200 uri = /crucible/0/regions/1270365f-74f3-4785-a951-29b8aed8f3c8/snapshots/ab9dd159-4da4-4a6c-abef-b83a31235fd9
312024-12-21T06:25:11.231ZINFOcrucible-agent (datafile): path is "/data/regions/1270365f-74f3-4785-a951-29b8aed8f3c8"
322024-12-21T06:25:11.240ZINFOcrucible-agent (datafile): dataset is oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crucible/regions/1270365f-74f3-4785-a951-29b8aed8f3c8
332024-12-21T06:25:11.247ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crucible/regions/1270365f-74f3-4785-a951-29b8aed8f3c8@ab9dd159-4da4-4a6c-abef-b83a31235fd9
342024-12-21T06:25:11.247ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crucible/regions/1270365f-74f3-4785-a951-29b8aed8f3c8", "ab9dd159-4da4-4a6c-abef-b83a31235fd9"]
352024-12-21T06:25:11.255ZINFOcrucible-agent (datafile): requesting running snapshot 1270365f-74f3-4785-a951-29b8aed8f3c8-ab9dd159-4da4-4a6c-abef-b83a31235fd9 state: Requested
362024-12-21T06:25:11.257ZINFOcrucible-agent (worker): applying SMF actions for region 1270365f-74f3-4785-a951-29b8aed8f3c8 running snapshot ab9dd159-4da4-4a6c-abef-b83a31235fd9 (state Requested)...
372024-12-21T06:25:11.257ZINFOcrucible-agent (dropshot): request completed latency_us = 25288 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39159 req_id = 4b0df339-a42a-4bbd-aac0-e07499029f1b response_code = 200 uri = /crucible/0/regions/1270365f-74f3-4785-a951-29b8aed8f3c8/snapshots/ab9dd159-4da4-4a6c-abef-b83a31235fd9/run
382024-12-21T06:25:11.266ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-1270365f-74f3-4785-a951-29b8aed8f3c8-ab9dd159-4da4-4a6c-abef-b83a31235fd9
392024-12-21T06:25:11.270ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-1270365f-74f3-4785-a951-29b8aed8f3c8-ab9dd159-4da4-4a6c-abef-b83a31235fd9
402024-12-21T06:25:11.283ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-1270365f-74f3-4785-a951-29b8aed8f3c8-ab9dd159-4da4-4a6c-abef-b83a31235fd9
412024-12-21T06:25:11.283ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1270365f-74f3-4785-a951-29b8aed8f3c8/.zfs/snapshot/ab9dd159-4da4-4a6c-abef-b83a31235fd9
422024-12-21T06:25:11.283ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
432024-12-21T06:25:11.283ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442024-12-21T06:25:11.283ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
452024-12-21T06:25:11.283ZINFOcrucible-agent (worker): commit
462024-12-21T06:25:11.288ZINFOcrucible-agent (worker): ok!
472024-12-21T06:25:11.293ZINFOcrucible-agent (worker): SMF ok!
482024-12-21T06:25:11.293ZINFOcrucible-agent (datafile): region 1270365f-74f3-4785-a951-29b8aed8f3c8 running snapshot ab9dd159-4da4-4a6c-abef-b83a31235fd9 state: Requested -> Created
492024-12-21T06:25:11.630ZINFOcrucible-agent (datafile): path is "/data/regions/1270365f-74f3-4785-a951-29b8aed8f3c8"
502024-12-21T06:25:11.639ZINFOcrucible-agent (datafile): dataset is oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crucible/regions/1270365f-74f3-4785-a951-29b8aed8f3c8
512024-12-21T06:25:11.647ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crucible/regions/1270365f-74f3-4785-a951-29b8aed8f3c8@ab9dd159-4da4-4a6c-abef-b83a31235fd9
522024-12-21T06:25:11.647ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crucible/regions/1270365f-74f3-4785-a951-29b8aed8f3c8", "ab9dd159-4da4-4a6c-abef-b83a31235fd9"]
532024-12-21T06:25:11.655ZINFOcrucible-agent (dropshot): request completed latency_us = 25287 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39159 req_id = 537f1d61-2a3f-41b8-978f-ccbf3f29586d response_code = 200 uri = /crucible/0/regions/1270365f-74f3-4785-a951-29b8aed8f3c8/snapshots/ab9dd159-4da4-4a6c-abef-b83a31235fd9/run