Max level shown:
12025-03-08T00:50:45.072ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:58746
22025-03-08T00:50:45.072ZINFOcrucible-agent (datafile): region 04e04951-646a-4ae4-8b8d-7f4d8c0b7a33 state: Requested
32025-03-08T00:50:45.073ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-03-08T00:50:45.073ZINFOcrucible-agent (dropshot): request completed latency_us = 680 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58746 req_id = be7934b9-2769-42e3-b9cb-ba1a9408ece7 response_code = 200 uri = /crucible/0/regions
52025-03-08T00:50:45.085ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crucible/regions/04e04951-646a-4ae4-8b8d-7f4d8c0b7a33
62025-03-08T00:50:45.085ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crucible/regions/04e04951-646a-4ae4-8b8d-7f4d8c0b7a33
72025-03-08T00:50:45.141ZINFOcrucible-agent (worker): creating region Region { id: RegionId("04e04951-646a-4ae4-8b8d-7f4d8c0b7a33"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/04e04951-646a-4ae4-8b8d-7f4d8c0b7a33" region = 04e04951-646a-4ae4-8b8d-7f4d8c0b7a33
82025-03-08T00:50:45.142ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "04e04951-646a-4ae4-8b8d-7f4d8c0b7a33" "--data" "/data/regions/04e04951-646a-4ae4-8b8d-7f4d8c0b7a33" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 04e04951-646a-4ae4-8b8d-7f4d8c0b7a33
92025-03-08T00:50:45.226ZINFOcrucible-agent (worker): region files created ok region = 04e04951-646a-4ae4-8b8d-7f4d8c0b7a33
102025-03-08T00:50:45.226ZINFOcrucible-agent (datafile): region 04e04951-646a-4ae4-8b8d-7f4d8c0b7a33 state: Requested -> Created
112025-03-08T00:50:45.226ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-03-08T00:50:45.227ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-04e04951-646a-4ae4-8b8d-7f4d8c0b7a33
132025-03-08T00:50:45.232ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-04e04951-646a-4ae4-8b8d-7f4d8c0b7a33
142025-03-08T00:50:45.246ZINFOcrucible-agent (worker): creating config property group
152025-03-08T00:50:45.250ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-04e04951-646a-4ae4-8b8d-7f4d8c0b7a33
162025-03-08T00:50:45.250ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/04e04951-646a-4ae4-8b8d-7f4d8c0b7a33
172025-03-08T00:50:45.250ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182025-03-08T00:50:45.250ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
192025-03-08T00:50:45.250ZINFOcrucible-agent (worker): commit
202025-03-08T00:50:45.254ZINFOcrucible-agent (worker): ok!
212025-03-08T00:50:45.259ZINFOcrucible-agent (worker): SMF ok!
222025-03-08T00:50:45.289ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58746 req_id = f8a7a0ce-6358-4448-a583-8fa66414f176 response_code = 200 uri = /crucible/0/regions
232025-03-08T00:50:50.870ZINFOcrucible-agent (datafile): region eb9cb9ed-92a8-4242-9bdb-8045191d677b state: Requested
242025-03-08T00:50:50.871ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
252025-03-08T00:50:50.871ZINFOcrucible-agent (dropshot): request completed latency_us = 283 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58746 req_id = 2f736b9d-2628-40d7-81e7-447c5a49ee7d response_code = 200 uri = /crucible/0/regions
262025-03-08T00:50:50.880ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crucible/regions/eb9cb9ed-92a8-4242-9bdb-8045191d677b
272025-03-08T00:50:50.880ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crucible/regions/eb9cb9ed-92a8-4242-9bdb-8045191d677b
282025-03-08T00:50:50.940ZINFOcrucible-agent (worker): creating region Region { id: RegionId("eb9cb9ed-92a8-4242-9bdb-8045191d677b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/eb9cb9ed-92a8-4242-9bdb-8045191d677b" region = eb9cb9ed-92a8-4242-9bdb-8045191d677b
292025-03-08T00:50:50.943ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "eb9cb9ed-92a8-4242-9bdb-8045191d677b" "--data" "/data/regions/eb9cb9ed-92a8-4242-9bdb-8045191d677b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = eb9cb9ed-92a8-4242-9bdb-8045191d677b
302025-03-08T00:50:51.023ZINFOcrucible-agent (worker): region files created ok region = eb9cb9ed-92a8-4242-9bdb-8045191d677b
312025-03-08T00:50:51.023ZINFOcrucible-agent (datafile): region eb9cb9ed-92a8-4242-9bdb-8045191d677b state: Requested -> Created
322025-03-08T00:50:51.023ZINFOcrucible-agent (worker): applying SMF actions post create...
332025-03-08T00:50:51.026ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-eb9cb9ed-92a8-4242-9bdb-8045191d677b
342025-03-08T00:50:51.035ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-eb9cb9ed-92a8-4242-9bdb-8045191d677b
352025-03-08T00:50:51.043ZINFOcrucible-agent (worker): creating config property group
362025-03-08T00:50:51.046ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-eb9cb9ed-92a8-4242-9bdb-8045191d677b
372025-03-08T00:50:51.046ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/eb9cb9ed-92a8-4242-9bdb-8045191d677b
382025-03-08T00:50:51.047ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392025-03-08T00:50:51.047ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
402025-03-08T00:50:51.047ZINFOcrucible-agent (worker): commit
412025-03-08T00:50:51.051ZINFOcrucible-agent (worker): ok!
422025-03-08T00:50:51.056ZINFOcrucible-agent (worker): SMF ok!
432025-03-08T00:50:51.132ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58746 req_id = 474f7a29-8d3c-4867-bbe8-510f27ea4368 response_code = 200 uri = /crucible/0/regions
442025-03-08T00:51:17.025ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:58746 req_id = 7960a765-89c0-4c10-b8b0-ec63d9267df1 response_code = 200 uri = /crucible/0/regions/eb9cb9ed-92a8-4242-9bdb-8045191d677b
452025-03-08T00:51:17.029ZINFOcrucible-agent (datafile): path is "/data/regions/eb9cb9ed-92a8-4242-9bdb-8045191d677b"
462025-03-08T00:51:17.041ZINFOcrucible-agent (datafile): dataset is oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crucible/regions/eb9cb9ed-92a8-4242-9bdb-8045191d677b
472025-03-08T00:51:17.052ZINFOcrucible-agent (datafile): region eb9cb9ed-92a8-4242-9bdb-8045191d677b state: Created -> Tombstoned
482025-03-08T00:51:17.052ZINFOcrucible-agent (worker): applying SMF actions before removal...
492025-03-08T00:51:17.052ZINFOcrucible-agent (dropshot): request completed latency_us = 23659 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:58746 req_id = b2efc882-406b-432a-89c2-ff2371aa7993 response_code = 204 uri = /crucible/0/regions/eb9cb9ed-92a8-4242-9bdb-8045191d677b
502025-03-08T00:51:17.054ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-eb9cb9ed-92a8-4242-9bdb-8045191d677b (instance states: (Some(Online), None))
512025-03-08T00:51:17.056ZINFOcrucible-agent (dropshot): request completed latency_us = 673 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:58746 req_id = 3d28513d-45c0-4a48-9de5-f17bc91d2f41 response_code = 200 uri = /crucible/0/regions/eb9cb9ed-92a8-4242-9bdb-8045191d677b
522025-03-08T00:51:17.061ZINFOcrucible-agent (worker): SMF ok!
532025-03-08T00:51:17.072ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crucible/regions/eb9cb9ed-92a8-4242-9bdb-8045191d677b" region = eb9cb9ed-92a8-4242-9bdb-8045191d677b
542025-03-08T00:51:17.128ZINFOcrucible-agent (datafile): region eb9cb9ed-92a8-4242-9bdb-8045191d677b state: Tombstoned -> Destroyed
552025-03-08T00:51:17.144ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:58746 req_id = ffdbd370-3955-41f6-b7f9-00cab45c2d3c response_code = 200 uri = /crucible/0/regions/eb9cb9ed-92a8-4242-9bdb-8045191d677b