Max level shown:
12024-04-03T10:16:06.233ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:34597
22024-04-03T10:16:06.256ZINFOcrucible-agent (datafile): region 1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53 state: Requested
32024-04-03T10:16:06.262ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-04-03T10:16:06.262ZINFOcrucible-agent (dropshot): request completed latency_us = 12405 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34597 req_id = adf97331-f329-4679-9660-e8dc81f407eb response_code = 200 uri = /crucible/0/regions
52024-04-03T10:16:06.277ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_36614205-9374-49cf-8904-cb3f4aa78846/crucible/regions/1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53
62024-04-03T10:16:06.277ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_36614205-9374-49cf-8904-cb3f4aa78846/crucible/regions/1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53
72024-04-03T10:16:06.335ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53" region = 1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53
82024-04-03T10:16:06.498ZINFOcrucible-agent (dropshot): request completed latency_us = 127 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34597 req_id = c054884d-bb58-4f6b-8fe9-c517a10cd58b response_code = 200 uri = /crucible/0/regions
92024-04-03T10:16:06.574ZINFOcrucible-agent (worker): region files created ok region = 1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53
102024-04-03T10:16:06.574ZINFOcrucible-agent (datafile): region 1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53 state: Requested -> Created
112024-04-03T10:16:06.574ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-04-03T10:16:06.575ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53
132024-04-03T10:16:06.581ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53
142024-04-03T10:16:06.601ZINFOcrucible-agent (worker): creating config property group
152024-04-03T10:16:06.606ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53
162024-04-03T10:16:06.607ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53
172024-04-03T10:16:06.610ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182024-04-03T10:16:06.610ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
192024-04-03T10:16:06.610ZINFOcrucible-agent (worker): commit
202024-04-03T10:16:06.623ZINFOcrucible-agent (worker): ok!
212024-04-03T10:16:06.632ZINFOcrucible-agent (worker): SMF ok!
222024-04-03T10:16:06.894ZINFOcrucible-agent (dropshot): request completed latency_us = 737 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34597 req_id = cb6c0be3-afb5-44e8-ac3e-83ff5dbbe5f5 response_code = 200 uri = /crucible/0/regions
232024-04-03T10:16:10.452ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:44578
242024-04-03T10:16:10.512ZINFOcrucible-agent (datafile): region f59bb156-316d-4a97-8a92-c121ac2870dc state: Requested
252024-04-03T10:16:10.512ZINFOcrucible-agent (dropshot): request completed latency_us = 203 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:44578 req_id = 45ee746a-3e0c-4b05-9597-c029e04d9346 response_code = 200 uri = /crucible/0/regions
262024-04-03T10:16:10.512ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272024-04-03T10:16:10.522ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_36614205-9374-49cf-8904-cb3f4aa78846/crucible/regions/f59bb156-316d-4a97-8a92-c121ac2870dc
282024-04-03T10:16:10.522ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_36614205-9374-49cf-8904-cb3f4aa78846/crucible/regions/f59bb156-316d-4a97-8a92-c121ac2870dc
292024-04-03T10:16:10.595ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f59bb156-316d-4a97-8a92-c121ac2870dc"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/f59bb156-316d-4a97-8a92-c121ac2870dc" region = f59bb156-316d-4a97-8a92-c121ac2870dc
302024-04-03T10:16:10.664ZINFOcrucible-agent (worker): region files created ok region = f59bb156-316d-4a97-8a92-c121ac2870dc
312024-04-03T10:16:10.664ZINFOcrucible-agent (datafile): region f59bb156-316d-4a97-8a92-c121ac2870dc state: Requested -> Created
322024-04-03T10:16:10.665ZINFOcrucible-agent (worker): applying SMF actions post create...
332024-04-03T10:16:10.666ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53
342024-04-03T10:16:10.666ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
352024-04-03T10:16:10.666ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
362024-04-03T10:16:10.666ZINFOcrucible-agent (worker): reconfig required
372024-04-03T10:16:10.666ZINFOcrucible-agent (worker): using existing config property group
382024-04-03T10:16:10.666ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53
392024-04-03T10:16:10.666ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53
402024-04-03T10:16:10.666ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
412024-04-03T10:16:10.666ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
422024-04-03T10:16:10.666ZINFOcrucible-agent (worker): commit
432024-04-03T10:16:10.671ZINFOcrucible-agent (worker): ok!
442024-04-03T10:16:10.671ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f59bb156-316d-4a97-8a92-c121ac2870dc
452024-04-03T10:16:10.674ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f59bb156-316d-4a97-8a92-c121ac2870dc
462024-04-03T10:16:10.681ZINFOcrucible-agent (worker): creating config property group
472024-04-03T10:16:10.685ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f59bb156-316d-4a97-8a92-c121ac2870dc
482024-04-03T10:16:10.685ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f59bb156-316d-4a97-8a92-c121ac2870dc
492024-04-03T10:16:10.685ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
502024-04-03T10:16:10.685ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
512024-04-03T10:16:10.685ZINFOcrucible-agent (worker): commit
522024-04-03T10:16:10.688ZINFOcrucible-agent (worker): ok!
532024-04-03T10:16:10.693ZINFOcrucible-agent (worker): SMF ok!
542024-04-03T10:16:10.836ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:44578 req_id = b1ee1098-b2a3-4ded-a5b7-96b94639dbd1 response_code = 200 uri = /crucible/0/regions
552024-04-03T10:16:34.233ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:51898
562024-04-03T10:16:34.233ZINFOcrucible-agent (dropshot): request completed latency_us = 98 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51898 req_id = 23d00e76-3c21-4f27-a705-fc180b4334cd response_code = 200 uri = /crucible/0/regions/f59bb156-316d-4a97-8a92-c121ac2870dc
572024-04-03T10:16:34.233ZINFOcrucible-agent (datafile): path is "/data/regions/f59bb156-316d-4a97-8a92-c121ac2870dc"
582024-04-03T10:16:34.244ZINFOcrucible-agent (datafile): dataset is oxp_36614205-9374-49cf-8904-cb3f4aa78846/crucible/regions/f59bb156-316d-4a97-8a92-c121ac2870dc
592024-04-03T10:16:34.253ZINFOcrucible-agent (datafile): region f59bb156-316d-4a97-8a92-c121ac2870dc state: Created -> Tombstoned
602024-04-03T10:16:34.254ZINFOcrucible-agent (worker): applying SMF actions before removal...
612024-04-03T10:16:34.254ZINFOcrucible-agent (dropshot): request completed latency_us = 20505 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:51898 req_id = 0a489a07-a452-4cfe-9b2c-7c005b9c2d59 response_code = 204 uri = /crucible/0/regions/f59bb156-316d-4a97-8a92-c121ac2870dc
622024-04-03T10:16:34.255ZINFOcrucible-agent (dropshot): request completed latency_us = 725 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51898 req_id = 6e7d39b5-b1d0-417c-bfe1-3ea23d1b6d1f response_code = 200 uri = /crucible/0/regions/f59bb156-316d-4a97-8a92-c121ac2870dc
632024-04-03T10:16:34.255ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-f59bb156-316d-4a97-8a92-c121ac2870dc (instance states: (Some(Online), None))
642024-04-03T10:16:34.259ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53
652024-04-03T10:16:34.259ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
662024-04-03T10:16:34.259ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
672024-04-03T10:16:34.259ZINFOcrucible-agent (worker): reconfig required
682024-04-03T10:16:34.259ZINFOcrucible-agent (worker): using existing config property group
692024-04-03T10:16:34.259ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53
702024-04-03T10:16:34.260ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53
712024-04-03T10:16:34.260ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
722024-04-03T10:16:34.260ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
732024-04-03T10:16:34.260ZINFOcrucible-agent (worker): commit
742024-04-03T10:16:34.264ZINFOcrucible-agent (worker): ok!
752024-04-03T10:16:34.264ZINFOcrucible-agent (worker): SMF ok!
762024-04-03T10:16:34.274ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_36614205-9374-49cf-8904-cb3f4aa78846/crucible/regions/f59bb156-316d-4a97-8a92-c121ac2870dc" region = f59bb156-316d-4a97-8a92-c121ac2870dc
772024-04-03T10:16:34.322ZINFOcrucible-agent (datafile): region f59bb156-316d-4a97-8a92-c121ac2870dc state: Tombstoned -> Destroyed
782024-04-03T10:16:34.341ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51898 req_id = acdebc50-eb61-42f5-846d-e01a4878d4e6 response_code = 200 uri = /crucible/0/regions/f59bb156-316d-4a97-8a92-c121ac2870dc