Max level shown:
12025-04-16T04:05:11.924ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:58671
22025-04-16T04:05:11.924ZINFOcrucible-agent (datafile): region aee85bf0-ddba-400f-b526-34a8c864461a state: Requested
32025-04-16T04:05:11.925ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-04-16T04:05:11.925ZINFOcrucible-agent (dropshot): request completed latency_us = 1088 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58671 req_id = 07338b21-228d-41b7-a9c2-8b9bd93bdc07 response_code = 200 uri = /crucible/0/regions
52025-04-16T04:05:11.937ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_87a6a5c5-746a-41c4-9556-4fc10dae477a/crucible/regions/aee85bf0-ddba-400f-b526-34a8c864461a
62025-04-16T04:05:11.937ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_87a6a5c5-746a-41c4-9556-4fc10dae477a/crucible/regions/aee85bf0-ddba-400f-b526-34a8c864461a
72025-04-16T04:05:11.993ZINFOcrucible-agent (worker): creating region Region { id: RegionId("aee85bf0-ddba-400f-b526-34a8c864461a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/aee85bf0-ddba-400f-b526-34a8c864461a" region = aee85bf0-ddba-400f-b526-34a8c864461a
82025-04-16T04:05:11.995ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "aee85bf0-ddba-400f-b526-34a8c864461a" "--data" "/data/regions/aee85bf0-ddba-400f-b526-34a8c864461a" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = aee85bf0-ddba-400f-b526-34a8c864461a
92025-04-16T04:05:12.070ZINFOcrucible-agent (worker): region files created ok region = aee85bf0-ddba-400f-b526-34a8c864461a
102025-04-16T04:05:12.070ZINFOcrucible-agent (datafile): region aee85bf0-ddba-400f-b526-34a8c864461a state: Requested -> Created
112025-04-16T04:05:12.070ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-04-16T04:05:12.072ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-aee85bf0-ddba-400f-b526-34a8c864461a
132025-04-16T04:05:12.081ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-aee85bf0-ddba-400f-b526-34a8c864461a
142025-04-16T04:05:12.100ZINFOcrucible-agent (worker): creating config property group
152025-04-16T04:05:12.104ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-aee85bf0-ddba-400f-b526-34a8c864461a
162025-04-16T04:05:12.104ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/aee85bf0-ddba-400f-b526-34a8c864461a
172025-04-16T04:05:12.104ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182025-04-16T04:05:12.104ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
192025-04-16T04:05:12.104ZINFOcrucible-agent (worker): commit
202025-04-16T04:05:12.107ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58671 req_id = f345b4e3-993c-46e2-9eee-205da2690542 response_code = 200 uri = /crucible/0/regions
212025-04-16T04:05:12.108ZINFOcrucible-agent (worker): ok!
222025-04-16T04:05:12.114ZINFOcrucible-agent (worker): SMF ok!
232025-04-16T04:05:18.838ZINFOcrucible-agent (datafile): region eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd state: Requested
242025-04-16T04:05:18.839ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
252025-04-16T04:05:18.839ZINFOcrucible-agent (dropshot): request completed latency_us = 241 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58671 req_id = 20625403-914c-4f39-b969-2bfea4798556 response_code = 200 uri = /crucible/0/regions
262025-04-16T04:05:18.848ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_87a6a5c5-746a-41c4-9556-4fc10dae477a/crucible/regions/eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd
272025-04-16T04:05:18.848ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_87a6a5c5-746a-41c4-9556-4fc10dae477a/crucible/regions/eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd
282025-04-16T04:05:18.907ZINFOcrucible-agent (worker): creating region Region { id: RegionId("eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd" region = eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd
292025-04-16T04:05:18.908ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd" "--data" "/data/regions/eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd
302025-04-16T04:05:18.994ZINFOcrucible-agent (worker): region files created ok region = eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd
312025-04-16T04:05:18.994ZINFOcrucible-agent (datafile): region eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd state: Requested -> Created
322025-04-16T04:05:18.994ZINFOcrucible-agent (worker): applying SMF actions post create...
332025-04-16T04:05:18.996ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd
342025-04-16T04:05:19.005ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd
352025-04-16T04:05:19.018ZINFOcrucible-agent (worker): creating config property group
362025-04-16T04:05:19.023ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd
372025-04-16T04:05:19.024ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd
382025-04-16T04:05:19.024ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392025-04-16T04:05:19.024ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
402025-04-16T04:05:19.024ZINFOcrucible-agent (worker): commit
412025-04-16T04:05:19.028ZINFOcrucible-agent (worker): ok!
422025-04-16T04:05:19.032ZINFOcrucible-agent (worker): SMF ok!
432025-04-16T04:05:19.165ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58671 req_id = 71d798f0-f682-4bd8-8192-83df9e6ff178 response_code = 200 uri = /crucible/0/regions
442025-04-16T04:05:45.709ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58671 req_id = 8e1d81ae-1189-4ec9-8101-ef404ba8b207 response_code = 200 uri = /crucible/0/regions/eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd
452025-04-16T04:05:45.713ZINFOcrucible-agent (datafile): path is "/data/regions/eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd"
462025-04-16T04:05:45.728ZINFOcrucible-agent (datafile): dataset is oxp_87a6a5c5-746a-41c4-9556-4fc10dae477a/crucible/regions/eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd
472025-04-16T04:05:45.738ZINFOcrucible-agent (datafile): region eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd state: Created -> Tombstoned
482025-04-16T04:05:45.738ZINFOcrucible-agent (worker): applying SMF actions before removal...
492025-04-16T04:05:45.738ZINFOcrucible-agent (dropshot): request completed latency_us = 25752 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:58671 req_id = 66629d39-777b-4606-9495-187705ee3a14 response_code = 204 uri = /crucible/0/regions/eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd
502025-04-16T04:05:45.740ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd (instance states: (Some(Online), None))
512025-04-16T04:05:45.742ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58671 req_id = 759a6c7a-fb03-4b35-be9a-3c6e5b547b76 response_code = 200 uri = /crucible/0/regions/eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd
522025-04-16T04:05:45.749ZINFOcrucible-agent (worker): SMF ok!
532025-04-16T04:05:45.759ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_87a6a5c5-746a-41c4-9556-4fc10dae477a/crucible/regions/eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd" region = eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd
542025-04-16T04:05:45.826ZINFOcrucible-agent (datafile): region eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd state: Tombstoned -> Destroyed
552025-04-16T04:05:45.879ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58671 req_id = d9c54601-0245-409e-b3ce-fbc16e01dfd5 response_code = 200 uri = /crucible/0/regions/eb6ab54f-717f-4fd7-9487-9f91fe7a6bdd