Max level shown:
12024-12-14T04:47:04.714ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:63228
22024-12-14T04:47:04.714ZINFOcrucible-agent (datafile): region 9f66a819-daa2-4e22-acb5-8456bb6b7cf4 state: Requested
32024-12-14T04:47:04.715ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-12-14T04:47:04.715ZINFOcrucible-agent (dropshot): request completed latency_us = 607 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63228 req_id = 7f1e9b3f-377f-408f-9d82-03c09137fc6f response_code = 200 uri = /crucible/0/regions
52024-12-14T04:47:04.725ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_5eca841c-c0a8-4e8a-ac1b-f1e5c8473754/crucible/regions/9f66a819-daa2-4e22-acb5-8456bb6b7cf4
62024-12-14T04:47:04.725ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_5eca841c-c0a8-4e8a-ac1b-f1e5c8473754/crucible/regions/9f66a819-daa2-4e22-acb5-8456bb6b7cf4
72024-12-14T04:47:04.784ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9f66a819-daa2-4e22-acb5-8456bb6b7cf4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9f66a819-daa2-4e22-acb5-8456bb6b7cf4" region = 9f66a819-daa2-4e22-acb5-8456bb6b7cf4
82024-12-14T04:47:04.786ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9f66a819-daa2-4e22-acb5-8456bb6b7cf4" "--data" "/data/regions/9f66a819-daa2-4e22-acb5-8456bb6b7cf4" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 9f66a819-daa2-4e22-acb5-8456bb6b7cf4
92024-12-14T04:47:04.886ZINFOcrucible-agent (worker): region files created ok region = 9f66a819-daa2-4e22-acb5-8456bb6b7cf4
102024-12-14T04:47:04.886ZINFOcrucible-agent (datafile): region 9f66a819-daa2-4e22-acb5-8456bb6b7cf4 state: Requested -> Created
112024-12-14T04:47:04.886ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-12-14T04:47:04.887ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9f66a819-daa2-4e22-acb5-8456bb6b7cf4
132024-12-14T04:47:04.897ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9f66a819-daa2-4e22-acb5-8456bb6b7cf4
142024-12-14T04:47:04.911ZINFOcrucible-agent (worker): creating config property group
152024-12-14T04:47:04.913ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9f66a819-daa2-4e22-acb5-8456bb6b7cf4
162024-12-14T04:47:04.914ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9f66a819-daa2-4e22-acb5-8456bb6b7cf4
172024-12-14T04:47:04.914ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-12-14T04:47:04.914ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
192024-12-14T04:47:04.914ZINFOcrucible-agent (worker): commit
202024-12-14T04:47:04.917ZINFOcrucible-agent (dropshot): request completed latency_us = 674 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63228 req_id = 1272271e-0d22-4483-9870-d050abb99371 response_code = 200 uri = /crucible/0/regions
212024-12-14T04:47:04.917ZINFOcrucible-agent (worker): ok!
222024-12-14T04:47:04.923ZINFOcrucible-agent (worker): SMF ok!
232024-12-14T04:47:05.902ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63228 req_id = 3dc94c1e-2bf1-4606-bf5d-296e40c9ff5f response_code = 200 uri = /crucible/0/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e
242024-12-14T04:47:05.905ZINFOcrucible-agent (datafile): path is "/data/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e"
252024-12-14T04:47:05.914ZINFOcrucible-agent (datafile): dataset is oxp_5eca841c-c0a8-4e8a-ac1b-f1e5c8473754/crucible/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e
262024-12-14T04:47:05.921ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_5eca841c-c0a8-4e8a-ac1b-f1e5c8473754/crucible/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e@94518873-6c56-466d-b86f-cdbe6bb105d6
272024-12-14T04:47:05.921ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_5eca841c-c0a8-4e8a-ac1b-f1e5c8473754/crucible/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e", "94518873-6c56-466d-b86f-cdbe6bb105d6"]
282024-12-14T04:47:05.933ZINFOcrucible-agent (dropshot): request completed latency_us = 28125 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63228 req_id = 20c9843e-efea-4ff4-9ddf-134f85efb71f response_code = 200 uri = /crucible/0/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e/snapshots/94518873-6c56-466d-b86f-cdbe6bb105d6
292024-12-14T04:47:05.936ZINFOcrucible-agent (datafile): path is "/data/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e"
302024-12-14T04:47:05.945ZINFOcrucible-agent (datafile): dataset is oxp_5eca841c-c0a8-4e8a-ac1b-f1e5c8473754/crucible/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e
312024-12-14T04:47:05.954ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_5eca841c-c0a8-4e8a-ac1b-f1e5c8473754/crucible/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e@94518873-6c56-466d-b86f-cdbe6bb105d6
322024-12-14T04:47:05.954ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_5eca841c-c0a8-4e8a-ac1b-f1e5c8473754/crucible/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e", "94518873-6c56-466d-b86f-cdbe6bb105d6"]
332024-12-14T04:47:05.962ZINFOcrucible-agent (datafile): requesting running snapshot f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e-94518873-6c56-466d-b86f-cdbe6bb105d6 state: Requested
342024-12-14T04:47:05.962ZINFOcrucible-agent (worker): applying SMF actions for region f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e running snapshot 94518873-6c56-466d-b86f-cdbe6bb105d6 (state Requested)...
352024-12-14T04:47:05.962ZINFOcrucible-agent (dropshot): request completed latency_us = 25352 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63228 req_id = 243f43a0-e7e8-4822-a594-bc7df69f0ed7 response_code = 200 uri = /crucible/0/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e/snapshots/94518873-6c56-466d-b86f-cdbe6bb105d6/run
362024-12-14T04:47:05.965ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e-94518873-6c56-466d-b86f-cdbe6bb105d6
372024-12-14T04:47:05.968ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e-94518873-6c56-466d-b86f-cdbe6bb105d6
382024-12-14T04:47:05.978ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e-94518873-6c56-466d-b86f-cdbe6bb105d6
392024-12-14T04:47:05.978ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e/.zfs/snapshot/94518873-6c56-466d-b86f-cdbe6bb105d6
402024-12-14T04:47:05.978ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412024-12-14T04:47:05.978ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422024-12-14T04:47:05.978ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
432024-12-14T04:47:05.978ZINFOcrucible-agent (worker): commit
442024-12-14T04:47:05.982ZINFOcrucible-agent (worker): ok!
452024-12-14T04:47:05.986ZINFOcrucible-agent (worker): SMF ok!
462024-12-14T04:47:05.986ZINFOcrucible-agent (datafile): region f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e running snapshot 94518873-6c56-466d-b86f-cdbe6bb105d6 state: Requested -> Created
472024-12-14T04:47:06.114ZINFOcrucible-agent (datafile): path is "/data/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e"
482024-12-14T04:47:06.128ZINFOcrucible-agent (datafile): dataset is oxp_5eca841c-c0a8-4e8a-ac1b-f1e5c8473754/crucible/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e
492024-12-14T04:47:06.140ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_5eca841c-c0a8-4e8a-ac1b-f1e5c8473754/crucible/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e@94518873-6c56-466d-b86f-cdbe6bb105d6
502024-12-14T04:47:06.140ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_5eca841c-c0a8-4e8a-ac1b-f1e5c8473754/crucible/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e", "94518873-6c56-466d-b86f-cdbe6bb105d6"]
512024-12-14T04:47:06.155ZINFOcrucible-agent (dropshot): request completed latency_us = 41051 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63228 req_id = 3a3ed257-9ad3-444a-b47d-42536ae41fa8 response_code = 200 uri = /crucible/0/regions/f3ac18f0-7b7b-45c0-9fb3-12ef9b4e748e/snapshots/94518873-6c56-466d-b86f-cdbe6bb105d6/run