1 | 2024-06-25T07:16:59.477Z | INFO | crucible-agent (dropshot): accepted connection
local_addr = [fd00:1122:3344:101::17]:32345
remote_addr = [fd00:1122:3344:101::a]:52944
|
2 | 2024-06-25T07:16:59.477Z | INFO | crucible-agent (dropshot): request completed
latency_us = 52
local_addr = [fd00:1122:3344:101::17]:32345
method = GET
remote_addr = [fd00:1122:3344:101::a]:52944
req_id = c393d535-953d-4414-ba19-0c34843d6539
response_code = 200
uri = /crucible/0/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36
|
3 | 2024-06-25T07:16:59.481Z | INFO | crucible-agent (datafile): path is "/data/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36"
|
4 | 2024-06-25T07:16:59.491Z | INFO | crucible-agent (datafile): dataset is oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36
|
5 | 2024-06-25T07:16:59.500Z | INFO | crucible-agent (ZfsSnapshotInterface): snapshot is oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36@568d1eaa-f10d-42de-8a04-4eeefc3e9c42
|
6 | 2024-06-25T07:16:59.500Z | INFO | crucible-agent (ZfsSnapshotInterface): parts is ["oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36", "568d1eaa-f10d-42de-8a04-4eeefc3e9c42"]
|
7 | 2024-06-25T07:16:59.514Z | INFO | crucible-agent (dropshot): request completed
latency_us = 36669
local_addr = [fd00:1122:3344:101::17]:32345
method = GET
remote_addr = [fd00:1122:3344:101::a]:52944
req_id = 81fa60fe-20f0-496a-9653-4dc54dd126d6
response_code = 200
uri = /crucible/0/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36/snapshots/568d1eaa-f10d-42de-8a04-4eeefc3e9c42
|
8 | 2024-06-25T07:16:59.514Z | INFO | crucible-agent (datafile): path is "/data/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36"
|
9 | 2024-06-25T07:16:59.523Z | INFO | crucible-agent (datafile): dataset is oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36
|
10 | 2024-06-25T07:16:59.531Z | INFO | crucible-agent (ZfsSnapshotInterface): snapshot is oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36@568d1eaa-f10d-42de-8a04-4eeefc3e9c42
|
11 | 2024-06-25T07:16:59.531Z | INFO | crucible-agent (ZfsSnapshotInterface): parts is ["oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36", "568d1eaa-f10d-42de-8a04-4eeefc3e9c42"]
|
12 | 2024-06-25T07:16:59.540Z | INFO | crucible-agent (datafile): requesting running snapshot b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36-568d1eaa-f10d-42de-8a04-4eeefc3e9c42 state: Requested
|
13 | 2024-06-25T07:16:59.540Z | INFO | crucible-agent (worker): applying SMF actions for region b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36 running snapshot 568d1eaa-f10d-42de-8a04-4eeefc3e9c42 (state Requested)...
|
14 | 2024-06-25T07:16:59.540Z | INFO | crucible-agent (dropshot): request completed
latency_us = 25804
local_addr = [fd00:1122:3344:101::17]:32345
method = POST
remote_addr = [fd00:1122:3344:101::a]:52944
req_id = fe11664c-9a78-45af-9d92-6657d1a5ac65
response_code = 200
uri = /crucible/0/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36/snapshots/568d1eaa-f10d-42de-8a04-4eeefc3e9c42/run
|
15 | 2024-06-25T07:16:59.545Z | INFO | crucible-agent (worker): creating missing snapshot instance snapshot-b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36-568d1eaa-f10d-42de-8a04-4eeefc3e9c42
|
16 | 2024-06-25T07:16:59.552Z | INFO | crucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36-568d1eaa-f10d-42de-8a04-4eeefc3e9c42
|
17 | 2024-06-25T07:16:59.564Z | INFO | crucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36-568d1eaa-f10d-42de-8a04-4eeefc3e9c42
|
18 | 2024-06-25T07:16:59.564Z | INFO | crucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36/.zfs/snapshot/568d1eaa-f10d-42de-8a04-4eeefc3e9c42
|
19 | 2024-06-25T07:16:59.564Z | INFO | crucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
|
20 | 2024-06-25T07:16:59.564Z | INFO | crucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
|
21 | 2024-06-25T07:16:59.565Z | INFO | crucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
|
22 | 2024-06-25T07:16:59.565Z | INFO | crucible-agent (worker): commit
|
23 | 2024-06-25T07:16:59.569Z | INFO | crucible-agent (worker): ok!
|
24 | 2024-06-25T07:16:59.573Z | INFO | crucible-agent (worker): SMF ok!
|
25 | 2024-06-25T07:16:59.573Z | INFO | crucible-agent (datafile): region b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36 running snapshot 568d1eaa-f10d-42de-8a04-4eeefc3e9c42 state: Requested -> Created
|
26 | 2024-06-25T07:17:02.625Z | INFO | crucible-agent (dropshot): accepted connection
local_addr = [fd00:1122:3344:101::17]:32345
remote_addr = [fd00:1122:3344:101::a]:59683
|
27 | 2024-06-25T07:17:02.625Z | INFO | crucible-agent (datafile): region 26fc5bfd-7828-40bd-946b-4978f48581f8 state: Requested
|
28 | 2024-06-25T07:17:02.625Z | INFO | crucible-agent (dropshot): request completed
latency_us = 211
local_addr = [fd00:1122:3344:101::17]:32345
method = POST
remote_addr = [fd00:1122:3344:101::a]:59683
req_id = 017922e8-e666-4f4e-ad9f-711bb721202e
response_code = 200
uri = /crucible/0/regions
|
29 | 2024-06-25T07:17:02.625Z | INFO | crucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
|
30 | 2024-06-25T07:17:02.634Z | INFO | crucible-agent (worker): zfs set reservation of 2684354560 for oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/26fc5bfd-7828-40bd-946b-4978f48581f8
|
31 | 2024-06-25T07:17:02.634Z | INFO | crucible-agent (worker): zfs set quota of 6442450944 for oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/26fc5bfd-7828-40bd-946b-4978f48581f8
|
32 | 2024-06-25T07:17:02.691Z | INFO | crucible-agent (worker): creating region Region { id: RegionId("26fc5bfd-7828-40bd-946b-4978f48581f8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/26fc5bfd-7828-40bd-946b-4978f48581f8"
region = 26fc5bfd-7828-40bd-946b-4978f48581f8
|
33 | 2024-06-25T07:17:02.691Z | INFO | crucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "26fc5bfd-7828-40bd-946b-4978f48581f8" "--data" "/data/regions/26fc5bfd-7828-40bd-946b-4978f48581f8" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted"
region = 26fc5bfd-7828-40bd-946b-4978f48581f8
|
34 | 2024-06-25T07:17:02.759Z | INFO | crucible-agent (dropshot): request completed
latency_us = 601
local_addr = [fd00:1122:3344:101::17]:32345
method = POST
remote_addr = [fd00:1122:3344:101::a]:59683
req_id = 976700b4-e02f-4252-8ed9-190db9e1a311
response_code = 200
uri = /crucible/0/regions
|
35 | 2024-06-25T07:17:02.783Z | INFO | crucible-agent (worker): region files created ok
region = 26fc5bfd-7828-40bd-946b-4978f48581f8
|
36 | 2024-06-25T07:17:02.783Z | INFO | crucible-agent (datafile): region 26fc5bfd-7828-40bd-946b-4978f48581f8 state: Requested -> Created
|
37 | 2024-06-25T07:17:02.783Z | INFO | crucible-agent (worker): applying SMF actions post create...
|
38 | 2024-06-25T07:17:02.784Z | INFO | crucible-agent (worker): creating missing downstairs instance downstairs-26fc5bfd-7828-40bd-946b-4978f48581f8
|
39 | 2024-06-25T07:17:02.787Z | INFO | crucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-26fc5bfd-7828-40bd-946b-4978f48581f8
|
40 | 2024-06-25T07:17:02.795Z | INFO | crucible-agent (worker): creating config property group
|
41 | 2024-06-25T07:17:02.799Z | INFO | crucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-26fc5bfd-7828-40bd-946b-4978f48581f8
|
42 | 2024-06-25T07:17:02.799Z | INFO | crucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/26fc5bfd-7828-40bd-946b-4978f48581f8
|
43 | 2024-06-25T07:17:02.799Z | INFO | crucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
|
44 | 2024-06-25T07:17:02.799Z | INFO | crucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
|
45 | 2024-06-25T07:17:02.799Z | INFO | crucible-agent (worker): commit
|
46 | 2024-06-25T07:17:02.803Z | INFO | crucible-agent (worker): ok!
|
47 | 2024-06-25T07:17:02.813Z | INFO | crucible-agent (worker): SMF ok!
|
48 | 2024-06-25T07:17:03.022Z | INFO | crucible-agent (dropshot): request completed
latency_us = 82
local_addr = [fd00:1122:3344:101::17]:32345
method = POST
remote_addr = [fd00:1122:3344:101::a]:59683
req_id = ad616993-4d35-446c-8502-47478b19d4e3
response_code = 200
uri = /crucible/0/regions
|
49 | 2024-06-25T07:17:26.266Z | INFO | crucible-agent (dropshot): request completed
latency_us = 52
local_addr = [fd00:1122:3344:101::17]:32345
method = GET
remote_addr = [fd00:1122:3344:101::a]:59683
req_id = edb551e4-7d96-4c16-84d6-53b93a2afa2b
response_code = 200
uri = /crucible/0/regions/26fc5bfd-7828-40bd-946b-4978f48581f8
|
50 | 2024-06-25T07:17:26.268Z | INFO | crucible-agent (datafile): path is "/data/regions/26fc5bfd-7828-40bd-946b-4978f48581f8"
|
51 | 2024-06-25T07:17:26.278Z | INFO | crucible-agent (datafile): dataset is oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/26fc5bfd-7828-40bd-946b-4978f48581f8
|
52 | 2024-06-25T07:17:26.287Z | INFO | crucible-agent (datafile): region 26fc5bfd-7828-40bd-946b-4978f48581f8 state: Created -> Tombstoned
|
53 | 2024-06-25T07:17:26.287Z | INFO | crucible-agent (worker): applying SMF actions before removal...
|
54 | 2024-06-25T07:17:26.287Z | INFO | crucible-agent (dropshot): request completed
latency_us = 18592
local_addr = [fd00:1122:3344:101::17]:32345
method = DELETE
remote_addr = [fd00:1122:3344:101::a]:59683
req_id = a80f181c-6d9a-4451-b045-0b9b249c61f3
response_code = 204
uri = /crucible/0/regions/26fc5bfd-7828-40bd-946b-4978f48581f8
|
55 | 2024-06-25T07:17:26.289Z | INFO | crucible-agent (worker): disabling downstairs instance: downstairs-26fc5bfd-7828-40bd-946b-4978f48581f8 (instance states: (Some(Online), None))
|
56 | 2024-06-25T07:17:26.293Z | INFO | crucible-agent (dropshot): request completed
latency_us = 654
local_addr = [fd00:1122:3344:101::17]:32345
method = GET
remote_addr = [fd00:1122:3344:101::a]:59683
req_id = 01ffaec9-f7ee-480c-8f3c-be60d64f6cb0
response_code = 200
uri = /crucible/0/regions/26fc5bfd-7828-40bd-946b-4978f48581f8
|
57 | 2024-06-25T07:17:26.295Z | INFO | crucible-agent (worker): SMF ok!
|
58 | 2024-06-25T07:17:26.305Z | INFO | crucible-agent (worker): deleting zfs dataset "oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/26fc5bfd-7828-40bd-946b-4978f48581f8"
region = 26fc5bfd-7828-40bd-946b-4978f48581f8
|
59 | 2024-06-25T07:17:26.351Z | INFO | crucible-agent (datafile): region 26fc5bfd-7828-40bd-946b-4978f48581f8 state: Tombstoned -> Destroyed
|
60 | 2024-06-25T07:17:26.424Z | INFO | crucible-agent (dropshot): request completed
latency_us = 50
local_addr = [fd00:1122:3344:101::17]:32345
method = GET
remote_addr = [fd00:1122:3344:101::a]:59683
req_id = fbffa6b6-da60-4989-96e4-59ef0648c541
response_code = 200
uri = /crucible/0/regions/26fc5bfd-7828-40bd-946b-4978f48581f8
|