Max level shown:
12025-01-28T23:16:54.522ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::c]:43377
22025-01-28T23:16:54.523ZINFOcrucible-agent (datafile): region c858e604-712d-485f-baea-cff7918b4592 state: Requested
32025-01-28T23:16:54.526ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-01-28T23:16:54.526ZINFOcrucible-agent (dropshot): request completed latency_us = 3906 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43377 req_id = 0559c27d-fe1a-4672-8d8c-1b28f39ca942 response_code = 200 uri = /crucible/0/regions
52025-01-28T23:16:54.538ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crucible/regions/c858e604-712d-485f-baea-cff7918b4592
62025-01-28T23:16:54.538ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crucible/regions/c858e604-712d-485f-baea-cff7918b4592
72025-01-28T23:16:54.633ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c858e604-712d-485f-baea-cff7918b4592"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c858e604-712d-485f-baea-cff7918b4592" region = c858e604-712d-485f-baea-cff7918b4592
82025-01-28T23:16:54.633ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c858e604-712d-485f-baea-cff7918b4592" "--data" "/data/regions/c858e604-712d-485f-baea-cff7918b4592" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c858e604-712d-485f-baea-cff7918b4592
92025-01-28T23:16:54.804ZINFOcrucible-agent (dropshot): request completed latency_us = 98 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43377 req_id = 1c03e27a-4bfa-477a-bc26-7949bd175ace response_code = 200 uri = /crucible/0/regions
102025-01-28T23:16:55.049ZINFOcrucible-agent (worker): region files created ok region = c858e604-712d-485f-baea-cff7918b4592
112025-01-28T23:16:55.049ZINFOcrucible-agent (datafile): region c858e604-712d-485f-baea-cff7918b4592 state: Requested -> Created
122025-01-28T23:16:55.049ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-01-28T23:16:55.051ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c858e604-712d-485f-baea-cff7918b4592
142025-01-28T23:16:55.066ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c858e604-712d-485f-baea-cff7918b4592
152025-01-28T23:16:55.097ZINFOcrucible-agent (worker): creating config property group
162025-01-28T23:16:55.109ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c858e604-712d-485f-baea-cff7918b4592
172025-01-28T23:16:55.110ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c858e604-712d-485f-baea-cff7918b4592
182025-01-28T23:16:55.110ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-01-28T23:16:55.110ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
202025-01-28T23:16:55.110ZINFOcrucible-agent (worker): commit
212025-01-28T23:16:55.128ZINFOcrucible-agent (worker): ok!
222025-01-28T23:16:55.139ZINFOcrucible-agent (worker): SMF ok!
232025-01-28T23:16:55.487ZINFOcrucible-agent (dropshot): request completed latency_us = 569 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43377 req_id = 6ac6c9f9-8e4b-4cbe-8cfb-93acbc5ec604 response_code = 200 uri = /crucible/0/regions
242025-01-28T23:17:02.181ZINFOcrucible-agent (datafile): region f344670c-4923-4272-a87d-484a1214beba state: Requested
252025-01-28T23:17:02.182ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262025-01-28T23:17:02.182ZINFOcrucible-agent (dropshot): request completed latency_us = 249 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43377 req_id = 64f3858e-d5cf-4f52-9812-ec2da5ab563b response_code = 200 uri = /crucible/0/regions
272025-01-28T23:17:02.191ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crucible/regions/f344670c-4923-4272-a87d-484a1214beba
282025-01-28T23:17:02.191ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crucible/regions/f344670c-4923-4272-a87d-484a1214beba
292025-01-28T23:17:02.363ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f344670c-4923-4272-a87d-484a1214beba"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/f344670c-4923-4272-a87d-484a1214beba" region = f344670c-4923-4272-a87d-484a1214beba
302025-01-28T23:17:02.363ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "f344670c-4923-4272-a87d-484a1214beba" "--data" "/data/regions/f344670c-4923-4272-a87d-484a1214beba" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = f344670c-4923-4272-a87d-484a1214beba
312025-01-28T23:17:02.439ZINFOcrucible-agent (dropshot): request completed latency_us = 101 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43377 req_id = 1111edd2-791d-4d53-b05f-7fe6443e91aa response_code = 200 uri = /crucible/0/regions
322025-01-28T23:17:02.727ZINFOcrucible-agent (worker): region files created ok region = f344670c-4923-4272-a87d-484a1214beba
332025-01-28T23:17:02.727ZINFOcrucible-agent (datafile): region f344670c-4923-4272-a87d-484a1214beba state: Requested -> Created
342025-01-28T23:17:02.727ZINFOcrucible-agent (worker): applying SMF actions post create...
352025-01-28T23:17:02.729ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f344670c-4923-4272-a87d-484a1214beba
362025-01-28T23:17:02.760ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f344670c-4923-4272-a87d-484a1214beba
372025-01-28T23:17:02.813ZINFOcrucible-agent (worker): creating config property group
382025-01-28T23:17:02.830ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f344670c-4923-4272-a87d-484a1214beba
392025-01-28T23:17:02.830ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f344670c-4923-4272-a87d-484a1214beba
402025-01-28T23:17:02.830ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412025-01-28T23:17:02.830ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
422025-01-28T23:17:02.830ZINFOcrucible-agent (worker): commit
432025-01-28T23:17:02.867ZINFOcrucible-agent (worker): ok!
442025-01-28T23:17:02.916ZINFOcrucible-agent (worker): SMF ok!
452025-01-28T23:17:02.975ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43377 req_id = 25a0dbc7-786f-469a-b029-36fa11e47afb response_code = 200 uri = /crucible/0/regions
462025-01-28T23:17:38.170ZINFOcrucible-agent (dropshot): request completed latency_us = 125 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:43377 req_id = 54132a28-8765-4174-bc3d-2035255f30fc response_code = 200 uri = /crucible/0/regions/f344670c-4923-4272-a87d-484a1214beba
472025-01-28T23:17:38.174ZINFOcrucible-agent (datafile): path is "/data/regions/f344670c-4923-4272-a87d-484a1214beba"
482025-01-28T23:17:38.186ZINFOcrucible-agent (datafile): dataset is oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crucible/regions/f344670c-4923-4272-a87d-484a1214beba
492025-01-28T23:17:38.196ZINFOcrucible-agent (datafile): region f344670c-4923-4272-a87d-484a1214beba state: Created -> Tombstoned
502025-01-28T23:17:38.196ZINFOcrucible-agent (worker): applying SMF actions before removal...
512025-01-28T23:17:38.196ZINFOcrucible-agent (dropshot): request completed latency_us = 22802 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:43377 req_id = eeb7c46b-0270-487c-a2d8-731291d29208 response_code = 204 uri = /crucible/0/regions/f344670c-4923-4272-a87d-484a1214beba
522025-01-28T23:17:38.198ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-f344670c-4923-4272-a87d-484a1214beba (instance states: (Some(Online), None))
532025-01-28T23:17:38.200ZINFOcrucible-agent (dropshot): request completed latency_us = 26 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:43377 req_id = 2f06a4eb-ceef-49ec-949b-8cc196d727a0 response_code = 200 uri = /crucible/0/regions/f344670c-4923-4272-a87d-484a1214beba
542025-01-28T23:17:38.208ZINFOcrucible-agent (worker): SMF ok!
552025-01-28T23:17:38.219ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crucible/regions/f344670c-4923-4272-a87d-484a1214beba" region = f344670c-4923-4272-a87d-484a1214beba
562025-01-28T23:17:38.285ZINFOcrucible-agent (datafile): region f344670c-4923-4272-a87d-484a1214beba state: Tombstoned -> Destroyed
572025-01-28T23:17:38.344ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:43377 req_id = 271d1c6a-a5bb-4239-ae17-88f944335ee0 response_code = 200 uri = /crucible/0/regions/f344670c-4923-4272-a87d-484a1214beba