Max level shown:
12024-11-01T22:37:18.907ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:45275
22024-11-01T22:37:18.907ZINFOcrucible-agent (datafile): region c8132cde-4a6b-473a-a048-2b4be5bb520c state: Requested
32024-11-01T22:37:18.907ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-11-01T22:37:18.907ZINFOcrucible-agent (dropshot): request completed latency_us = 323 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45275 req_id = 10bb4316-df7b-44b3-96b0-70d908233bb5 response_code = 200 uri = /crucible/0/regions
52024-11-01T22:37:18.917ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_768cd5c9-c954-41f2-a65d-7a379e2ab256/crucible/regions/c8132cde-4a6b-473a-a048-2b4be5bb520c
62024-11-01T22:37:18.917ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_768cd5c9-c954-41f2-a65d-7a379e2ab256/crucible/regions/c8132cde-4a6b-473a-a048-2b4be5bb520c
72024-11-01T22:37:18.973ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c8132cde-4a6b-473a-a048-2b4be5bb520c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c8132cde-4a6b-473a-a048-2b4be5bb520c" region = c8132cde-4a6b-473a-a048-2b4be5bb520c
82024-11-01T22:37:18.973ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c8132cde-4a6b-473a-a048-2b4be5bb520c" "--data" "/data/regions/c8132cde-4a6b-473a-a048-2b4be5bb520c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c8132cde-4a6b-473a-a048-2b4be5bb520c
92024-11-01T22:37:19.056ZINFOcrucible-agent (worker): region files created ok region = c8132cde-4a6b-473a-a048-2b4be5bb520c
102024-11-01T22:37:19.056ZINFOcrucible-agent (datafile): region c8132cde-4a6b-473a-a048-2b4be5bb520c state: Requested -> Created
112024-11-01T22:37:19.056ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-11-01T22:37:19.064ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c8132cde-4a6b-473a-a048-2b4be5bb520c
132024-11-01T22:37:19.075ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c8132cde-4a6b-473a-a048-2b4be5bb520c
142024-11-01T22:37:19.084ZINFOcrucible-agent (worker): creating config property group
152024-11-01T22:37:19.087ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c8132cde-4a6b-473a-a048-2b4be5bb520c
162024-11-01T22:37:19.087ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c8132cde-4a6b-473a-a048-2b4be5bb520c
172024-11-01T22:37:19.087ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-11-01T22:37:19.088ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
192024-11-01T22:37:19.088ZINFOcrucible-agent (worker): commit
202024-11-01T22:37:19.091ZINFOcrucible-agent (worker): ok!
212024-11-01T22:37:19.095ZINFOcrucible-agent (worker): SMF ok!
222024-11-01T22:37:19.121ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45275 req_id = 961115c8-eb1b-4337-87b0-26f2e46200c4 response_code = 200 uri = /crucible/0/regions
232024-11-01T22:37:21.193ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45275 req_id = dd70b94a-2b5d-4116-9564-28da39f1f26f response_code = 200 uri = /crucible/0/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0
242024-11-01T22:37:21.196ZINFOcrucible-agent (datafile): path is "/data/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0"
252024-11-01T22:37:21.205ZINFOcrucible-agent (datafile): dataset is oxp_768cd5c9-c954-41f2-a65d-7a379e2ab256/crucible/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0
262024-11-01T22:37:21.214ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_768cd5c9-c954-41f2-a65d-7a379e2ab256/crucible/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0@70812322-e2bc-4def-b38e-2fbd2a88c8be
272024-11-01T22:37:21.214ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_768cd5c9-c954-41f2-a65d-7a379e2ab256/crucible/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0", "70812322-e2bc-4def-b38e-2fbd2a88c8be"]
282024-11-01T22:37:21.226ZINFOcrucible-agent (dropshot): request completed latency_us = 29427 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45275 req_id = 5dafaf17-7f06-45cf-b12c-344edce1f747 response_code = 200 uri = /crucible/0/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0/snapshots/70812322-e2bc-4def-b38e-2fbd2a88c8be
292024-11-01T22:37:21.229ZINFOcrucible-agent (datafile): path is "/data/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0"
302024-11-01T22:37:21.237ZINFOcrucible-agent (datafile): dataset is oxp_768cd5c9-c954-41f2-a65d-7a379e2ab256/crucible/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0
312024-11-01T22:37:21.244ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_768cd5c9-c954-41f2-a65d-7a379e2ab256/crucible/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0@70812322-e2bc-4def-b38e-2fbd2a88c8be
322024-11-01T22:37:21.244ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_768cd5c9-c954-41f2-a65d-7a379e2ab256/crucible/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0", "70812322-e2bc-4def-b38e-2fbd2a88c8be"]
332024-11-01T22:37:21.253ZINFOcrucible-agent (datafile): requesting running snapshot 266eaba1-867e-4321-b2bd-4ba8b5a7ffa0-70812322-e2bc-4def-b38e-2fbd2a88c8be state: Requested
342024-11-01T22:37:21.253ZINFOcrucible-agent (worker): applying SMF actions for region 266eaba1-867e-4321-b2bd-4ba8b5a7ffa0 running snapshot 70812322-e2bc-4def-b38e-2fbd2a88c8be (state Requested)...
352024-11-01T22:37:21.253ZINFOcrucible-agent (dropshot): request completed latency_us = 23739 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45275 req_id = 57601c0d-df37-4b68-8c77-cd1d2b6bced1 response_code = 200 uri = /crucible/0/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0/snapshots/70812322-e2bc-4def-b38e-2fbd2a88c8be/run
362024-11-01T22:37:21.256ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-266eaba1-867e-4321-b2bd-4ba8b5a7ffa0-70812322-e2bc-4def-b38e-2fbd2a88c8be
372024-11-01T22:37:21.258ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-266eaba1-867e-4321-b2bd-4ba8b5a7ffa0-70812322-e2bc-4def-b38e-2fbd2a88c8be
382024-11-01T22:37:21.267ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-266eaba1-867e-4321-b2bd-4ba8b5a7ffa0-70812322-e2bc-4def-b38e-2fbd2a88c8be
392024-11-01T22:37:21.267ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0/.zfs/snapshot/70812322-e2bc-4def-b38e-2fbd2a88c8be
402024-11-01T22:37:21.267ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412024-11-01T22:37:21.267ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422024-11-01T22:37:21.267ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
432024-11-01T22:37:21.267ZINFOcrucible-agent (worker): commit
442024-11-01T22:37:21.270ZINFOcrucible-agent (worker): ok!
452024-11-01T22:37:21.274ZINFOcrucible-agent (worker): SMF ok!
462024-11-01T22:37:21.274ZINFOcrucible-agent (datafile): region 266eaba1-867e-4321-b2bd-4ba8b5a7ffa0 running snapshot 70812322-e2bc-4def-b38e-2fbd2a88c8be state: Requested -> Created
472024-11-01T22:37:21.512ZINFOcrucible-agent (datafile): path is "/data/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0"
482024-11-01T22:37:21.521ZINFOcrucible-agent (datafile): dataset is oxp_768cd5c9-c954-41f2-a65d-7a379e2ab256/crucible/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0
492024-11-01T22:37:21.529ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_768cd5c9-c954-41f2-a65d-7a379e2ab256/crucible/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0@70812322-e2bc-4def-b38e-2fbd2a88c8be
502024-11-01T22:37:21.529ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_768cd5c9-c954-41f2-a65d-7a379e2ab256/crucible/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0", "70812322-e2bc-4def-b38e-2fbd2a88c8be"]
512024-11-01T22:37:21.537ZINFOcrucible-agent (dropshot): request completed latency_us = 24612 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45275 req_id = 8eb9c815-148e-48b5-88f6-b0dfd058866b response_code = 200 uri = /crucible/0/regions/266eaba1-867e-4321-b2bd-4ba8b5a7ffa0/snapshots/70812322-e2bc-4def-b38e-2fbd2a88c8be/run