Max level shown:
12025-01-10T05:16:16.863ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::b]:61571
22025-01-10T05:16:16.913ZINFOcrucible-agent (datafile): region 84b39057-e9f1-40b5-8145-ee284ddd51ad state: Requested
32025-01-10T05:16:16.918ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-01-10T05:16:16.923ZINFOcrucible-agent (dropshot): request completed latency_us = 17488 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61571 req_id = 17f2340f-71b7-4117-a91a-ef1e82ca295b response_code = 200 uri = /crucible/0/regions
52025-01-10T05:16:16.931ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crucible/regions/84b39057-e9f1-40b5-8145-ee284ddd51ad
62025-01-10T05:16:16.931ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crucible/regions/84b39057-e9f1-40b5-8145-ee284ddd51ad
72025-01-10T05:16:16.996ZINFOcrucible-agent (worker): creating region Region { id: RegionId("84b39057-e9f1-40b5-8145-ee284ddd51ad"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/84b39057-e9f1-40b5-8145-ee284ddd51ad" region = 84b39057-e9f1-40b5-8145-ee284ddd51ad
82025-01-10T05:16:16.999ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "84b39057-e9f1-40b5-8145-ee284ddd51ad" "--data" "/data/regions/84b39057-e9f1-40b5-8145-ee284ddd51ad" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 84b39057-e9f1-40b5-8145-ee284ddd51ad
92025-01-10T05:16:17.258ZINFOcrucible-agent (dropshot): request completed latency_us = 89 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61571 req_id = c09f6820-c466-4587-accf-776ff00e7ae1 response_code = 200 uri = /crucible/0/regions
102025-01-10T05:16:17.313ZINFOcrucible-agent (worker): region files created ok region = 84b39057-e9f1-40b5-8145-ee284ddd51ad
112025-01-10T05:16:17.313ZINFOcrucible-agent (datafile): region 84b39057-e9f1-40b5-8145-ee284ddd51ad state: Requested -> Created
122025-01-10T05:16:17.313ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-01-10T05:16:17.314ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-84b39057-e9f1-40b5-8145-ee284ddd51ad
142025-01-10T05:16:17.327ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-84b39057-e9f1-40b5-8145-ee284ddd51ad
152025-01-10T05:16:17.346ZINFOcrucible-agent (worker): creating config property group
162025-01-10T05:16:17.349ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-84b39057-e9f1-40b5-8145-ee284ddd51ad
172025-01-10T05:16:17.350ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/84b39057-e9f1-40b5-8145-ee284ddd51ad
182025-01-10T05:16:17.350ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-01-10T05:16:17.350ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
202025-01-10T05:16:17.350ZINFOcrucible-agent (worker): commit
212025-01-10T05:16:17.355ZINFOcrucible-agent (worker): ok!
222025-01-10T05:16:17.362ZINFOcrucible-agent (worker): SMF ok!
232025-01-10T05:16:17.609ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61571 req_id = 99496499-2813-47e2-89f5-67725464a81e response_code = 200 uri = /crucible/0/regions
242025-01-10T05:16:23.764ZINFOcrucible-agent (datafile): region 723c4798-6276-4380-a686-c42017ab2839 state: Requested
252025-01-10T05:16:23.764ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262025-01-10T05:16:23.764ZINFOcrucible-agent (dropshot): request completed latency_us = 218 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61571 req_id = 8699b8a0-a134-446e-aa35-d19ecdb215b4 response_code = 200 uri = /crucible/0/regions
272025-01-10T05:16:23.775ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crucible/regions/723c4798-6276-4380-a686-c42017ab2839
282025-01-10T05:16:23.775ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crucible/regions/723c4798-6276-4380-a686-c42017ab2839
292025-01-10T05:16:23.845ZINFOcrucible-agent (worker): creating region Region { id: RegionId("723c4798-6276-4380-a686-c42017ab2839"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/723c4798-6276-4380-a686-c42017ab2839" region = 723c4798-6276-4380-a686-c42017ab2839
302025-01-10T05:16:23.845ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "723c4798-6276-4380-a686-c42017ab2839" "--data" "/data/regions/723c4798-6276-4380-a686-c42017ab2839" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 723c4798-6276-4380-a686-c42017ab2839
312025-01-10T05:16:23.915ZINFOcrucible-agent (worker): region files created ok region = 723c4798-6276-4380-a686-c42017ab2839
322025-01-10T05:16:23.915ZINFOcrucible-agent (datafile): region 723c4798-6276-4380-a686-c42017ab2839 state: Requested -> Created
332025-01-10T05:16:23.915ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-01-10T05:16:23.916ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-723c4798-6276-4380-a686-c42017ab2839
352025-01-10T05:16:23.919ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-723c4798-6276-4380-a686-c42017ab2839
362025-01-10T05:16:23.926ZINFOcrucible-agent (worker): creating config property group
372025-01-10T05:16:23.930ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-723c4798-6276-4380-a686-c42017ab2839
382025-01-10T05:16:23.930ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/723c4798-6276-4380-a686-c42017ab2839
392025-01-10T05:16:23.930ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-01-10T05:16:23.930ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
412025-01-10T05:16:23.930ZINFOcrucible-agent (worker): commit
422025-01-10T05:16:23.933ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61571 req_id = ec3ff11c-2f9a-40ef-856c-d9a923ea7b07 response_code = 200 uri = /crucible/0/regions
432025-01-10T05:16:23.934ZINFOcrucible-agent (worker): ok!
442025-01-10T05:16:23.944ZINFOcrucible-agent (worker): SMF ok!
452025-01-10T05:16:55.674ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61571 req_id = 8e797f25-d994-4684-baf0-db283144ef12 response_code = 200 uri = /crucible/0/regions/723c4798-6276-4380-a686-c42017ab2839
462025-01-10T05:16:55.677ZINFOcrucible-agent (datafile): path is "/data/regions/723c4798-6276-4380-a686-c42017ab2839"
472025-01-10T05:16:55.690ZINFOcrucible-agent (datafile): dataset is oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crucible/regions/723c4798-6276-4380-a686-c42017ab2839
482025-01-10T05:16:55.700ZINFOcrucible-agent (datafile): region 723c4798-6276-4380-a686-c42017ab2839 state: Created -> Tombstoned
492025-01-10T05:16:55.700ZINFOcrucible-agent (worker): applying SMF actions before removal...
502025-01-10T05:16:55.700ZINFOcrucible-agent (dropshot): request completed latency_us = 22481 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:61571 req_id = e368d320-08a3-40a8-966d-26d65ca5173a response_code = 204 uri = /crucible/0/regions/723c4798-6276-4380-a686-c42017ab2839
512025-01-10T05:16:55.701ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-723c4798-6276-4380-a686-c42017ab2839 (instance states: (Some(Online), None))
522025-01-10T05:16:55.704ZINFOcrucible-agent (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61571 req_id = 823e19ff-b884-4f5f-b8b4-3567d28374ab response_code = 200 uri = /crucible/0/regions/723c4798-6276-4380-a686-c42017ab2839
532025-01-10T05:16:55.707ZINFOcrucible-agent (worker): SMF ok!
542025-01-10T05:16:55.716ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crucible/regions/723c4798-6276-4380-a686-c42017ab2839" region = 723c4798-6276-4380-a686-c42017ab2839
552025-01-10T05:16:55.771ZINFOcrucible-agent (datafile): region 723c4798-6276-4380-a686-c42017ab2839 state: Tombstoned -> Destroyed
562025-01-10T05:16:55.831ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61571 req_id = b6892ef7-2d06-4654-9476-dedb29b5253d response_code = 200 uri = /crucible/0/regions/723c4798-6276-4380-a686-c42017ab2839