Max level shown:
12026-11-03T06:11:18.446ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:33365
22026-11-03T06:11:18.491ZINFOcrucible-agent (datafile): region 80ef9a47-f17e-4fc8-be0c-d62dfe3069df state: Requested
32026-11-03T06:11:18.498ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-11-03T06:11:18.503ZINFOcrucible-agent (dropshot): request completed latency_us = 22871 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33365 req_id = 88e6fd2f-a192-42e5-896f-2fa217a28c1d response_code = 200 uri = /crucible/0/regions
52026-11-03T06:11:18.507ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_3dddcb54-f21e-404e-b7e4-80a3c263ed34/crucible/regions/80ef9a47-f17e-4fc8-be0c-d62dfe3069df
62026-11-03T06:11:18.507ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_3dddcb54-f21e-404e-b7e4-80a3c263ed34/crucible/regions/80ef9a47-f17e-4fc8-be0c-d62dfe3069df
72026-11-03T06:11:18.561ZINFOcrucible-agent (worker): creating region Region { id: RegionId("80ef9a47-f17e-4fc8-be0c-d62dfe3069df"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/80ef9a47-f17e-4fc8-be0c-d62dfe3069df" region = 80ef9a47-f17e-4fc8-be0c-d62dfe3069df
82026-11-03T06:11:18.561ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "80ef9a47-f17e-4fc8-be0c-d62dfe3069df" "--data" "/data/regions/80ef9a47-f17e-4fc8-be0c-d62dfe3069df" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 80ef9a47-f17e-4fc8-be0c-d62dfe3069df
92026-11-03T06:11:18.705ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33365 req_id = 1f29cdb4-c270-4b56-b776-5c3d0e49b227 response_code = 200 uri = /crucible/0/regions
102026-11-03T06:11:18.930ZINFOcrucible-agent (worker): region files created ok region = 80ef9a47-f17e-4fc8-be0c-d62dfe3069df
112026-11-03T06:11:18.932ZINFOcrucible-agent (datafile): region 80ef9a47-f17e-4fc8-be0c-d62dfe3069df state: Requested -> Created
122026-11-03T06:11:18.932ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-11-03T06:11:18.932ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-80ef9a47-f17e-4fc8-be0c-d62dfe3069df
142026-11-03T06:11:18.947ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-80ef9a47-f17e-4fc8-be0c-d62dfe3069df
152026-11-03T06:11:18.965ZINFOcrucible-agent (worker): creating config property group
162026-11-03T06:11:18.968ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-80ef9a47-f17e-4fc8-be0c-d62dfe3069df
172026-11-03T06:11:18.969ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/80ef9a47-f17e-4fc8-be0c-d62dfe3069df
182026-11-03T06:11:18.969ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-11-03T06:11:18.969ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
202026-11-03T06:11:18.969ZINFOcrucible-agent (worker): commit
212026-11-03T06:11:18.973ZINFOcrucible-agent (worker): ok!
222026-11-03T06:11:18.976ZINFOcrucible-agent (worker): SMF ok!
232026-11-03T06:11:19.373ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33365 req_id = 44e4c2ff-c492-49fe-8aff-6f5afc3e5563 response_code = 200 uri = /crucible/0/regions
242026-11-03T06:11:26.140ZINFOcrucible-agent (datafile): region 611b7ffc-e412-45be-a55b-a3c994aed954 state: Requested
252026-11-03T06:11:26.140ZINFOcrucible-agent (dropshot): request completed latency_us = 240 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33365 req_id = c5b844ee-d298-48ff-91d3-71749a00f9cb response_code = 200 uri = /crucible/0/regions
262026-11-03T06:11:26.140ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-11-03T06:11:26.147ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_3dddcb54-f21e-404e-b7e4-80a3c263ed34/crucible/regions/611b7ffc-e412-45be-a55b-a3c994aed954
282026-11-03T06:11:26.147ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_3dddcb54-f21e-404e-b7e4-80a3c263ed34/crucible/regions/611b7ffc-e412-45be-a55b-a3c994aed954
292026-11-03T06:11:26.202ZINFOcrucible-agent (worker): creating region Region { id: RegionId("611b7ffc-e412-45be-a55b-a3c994aed954"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/611b7ffc-e412-45be-a55b-a3c994aed954" region = 611b7ffc-e412-45be-a55b-a3c994aed954
302026-11-03T06:11:26.202ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "611b7ffc-e412-45be-a55b-a3c994aed954" "--data" "/data/regions/611b7ffc-e412-45be-a55b-a3c994aed954" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 611b7ffc-e412-45be-a55b-a3c994aed954
312026-11-03T06:11:26.269ZINFOcrucible-agent (worker): region files created ok region = 611b7ffc-e412-45be-a55b-a3c994aed954
322026-11-03T06:11:26.269ZINFOcrucible-agent (datafile): region 611b7ffc-e412-45be-a55b-a3c994aed954 state: Requested -> Created
332026-11-03T06:11:26.269ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-11-03T06:11:26.270ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-611b7ffc-e412-45be-a55b-a3c994aed954
352026-11-03T06:11:26.273ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-611b7ffc-e412-45be-a55b-a3c994aed954
362026-11-03T06:11:26.283ZINFOcrucible-agent (worker): creating config property group
372026-11-03T06:11:26.286ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-611b7ffc-e412-45be-a55b-a3c994aed954
382026-11-03T06:11:26.286ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/611b7ffc-e412-45be-a55b-a3c994aed954
392026-11-03T06:11:26.286ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-11-03T06:11:26.287ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
412026-11-03T06:11:26.287ZINFOcrucible-agent (worker): commit
422026-11-03T06:11:26.290ZINFOcrucible-agent (worker): ok!
432026-11-03T06:11:26.296ZINFOcrucible-agent (worker): SMF ok!
442026-11-03T06:11:26.339ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33365 req_id = dabe9736-a6b2-401c-960b-4d93a3b8afc2 response_code = 200 uri = /crucible/0/regions
452026-11-03T06:11:52.001ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33365 req_id = 68748029-cd05-439c-a072-70372d359be8 response_code = 200 uri = /crucible/0/regions/611b7ffc-e412-45be-a55b-a3c994aed954
462026-11-03T06:11:52.005ZINFOcrucible-agent (datafile): path is "/data/regions/611b7ffc-e412-45be-a55b-a3c994aed954"
472026-11-03T06:11:52.023ZINFOcrucible-agent (datafile): dataset is oxp_3dddcb54-f21e-404e-b7e4-80a3c263ed34/crucible/regions/611b7ffc-e412-45be-a55b-a3c994aed954
482026-11-03T06:11:52.029ZINFOcrucible-agent (datafile): region 611b7ffc-e412-45be-a55b-a3c994aed954 state: Created -> Tombstoned
492026-11-03T06:11:52.029ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-11-03T06:11:52.029ZINFOcrucible-agent (dropshot): request completed latency_us = 23949 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:33365 req_id = 086c110d-00d0-40ba-a2c7-bade5a5f47fc response_code = 204 uri = /crucible/0/regions/611b7ffc-e412-45be-a55b-a3c994aed954
512026-11-03T06:11:52.030ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-611b7ffc-e412-45be-a55b-a3c994aed954 (instance states: (Some(Online), None))
522026-11-03T06:11:52.032ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33365 req_id = 0e3d03ea-71aa-418d-8b19-cb89151f9a7c response_code = 200 uri = /crucible/0/regions/611b7ffc-e412-45be-a55b-a3c994aed954
532026-11-03T06:11:52.058ZINFOcrucible-agent (worker): SMF ok!
542026-11-03T06:11:52.065ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_3dddcb54-f21e-404e-b7e4-80a3c263ed34/crucible/regions/611b7ffc-e412-45be-a55b-a3c994aed954" region = 611b7ffc-e412-45be-a55b-a3c994aed954
552026-11-03T06:11:52.163ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33365 req_id = c6510b20-3a90-4b50-99c1-a54d47a08670 response_code = 200 uri = /crucible/0/regions/611b7ffc-e412-45be-a55b-a3c994aed954
562026-11-03T06:11:52.234ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33365 req_id = 198147a1-6d14-4708-b809-b9e929acad88 response_code = 200 uri = /crucible/0/regions/611b7ffc-e412-45be-a55b-a3c994aed954
572026-11-03T06:11:52.276ZINFOcrucible-agent (datafile): region 611b7ffc-e412-45be-a55b-a3c994aed954 state: Tombstoned -> Destroyed
582026-11-03T06:11:52.384ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33365 req_id = 44c67df8-c2fc-4ebf-9a14-b846cd33f67f response_code = 200 uri = /crucible/0/regions/611b7ffc-e412-45be-a55b-a3c994aed954