Max level shown:
12026-09-04T23:15:39.149ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:62282
22026-09-04T23:15:39.181ZINFOcrucible-agent (datafile): region 22d6a066-5317-46db-95b4-e3da95d71e62 state: Requested
32026-09-04T23:15:39.186ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
42026-09-04T23:15:39.190ZINFOcrucible-agent (dropshot): request completed latency_us = 15191 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:62282 req_id = 35084290-1360-4153-9dbb-0587108bcacd response_code = 200 uri = /crucible/0/regions
52026-09-04T23:15:39.194ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_40315275-e4ed-4f5a-bb5d-58fc0f710b19/crucible/regions/22d6a066-5317-46db-95b4-e3da95d71e62
62026-09-04T23:15:39.194ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_40315275-e4ed-4f5a-bb5d-58fc0f710b19/crucible/regions/22d6a066-5317-46db-95b4-e3da95d71e62
72026-09-04T23:15:39.232ZINFOcrucible-agent (worker): creating region Region { id: RegionId("22d6a066-5317-46db-95b4-e3da95d71e62"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/22d6a066-5317-46db-95b4-e3da95d71e62" region = 22d6a066-5317-46db-95b4-e3da95d71e62
82026-09-04T23:15:39.234ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "22d6a066-5317-46db-95b4-e3da95d71e62" "--data" "/data/regions/22d6a066-5317-46db-95b4-e3da95d71e62" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 22d6a066-5317-46db-95b4-e3da95d71e62
92026-09-04T23:15:39.403ZINFOcrucible-agent (worker): region files created ok region = 22d6a066-5317-46db-95b4-e3da95d71e62
102026-09-04T23:15:39.407ZINFOcrucible-agent (datafile): region 22d6a066-5317-46db-95b4-e3da95d71e62 state: Requested -> Created
112026-09-04T23:15:39.407ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-09-04T23:15:39.410ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-22d6a066-5317-46db-95b4-e3da95d71e62
132026-09-04T23:15:39.416ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-22d6a066-5317-46db-95b4-e3da95d71e62
142026-09-04T23:15:39.425ZINFOcrucible-agent (worker): creating config property group
152026-09-04T23:15:39.426ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-22d6a066-5317-46db-95b4-e3da95d71e62
162026-09-04T23:15:39.427ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/22d6a066-5317-46db-95b4-e3da95d71e62
172026-09-04T23:15:39.427ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-09-04T23:15:39.427ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
192026-09-04T23:15:39.427ZINFOcrucible-agent (worker): commit
202026-09-04T23:15:39.430ZINFOcrucible-agent (worker): ok!
212026-09-04T23:15:39.433ZINFOcrucible-agent (worker): SMF ok!
222026-09-04T23:15:39.466ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:62282 req_id = 9a6774ca-eeac-4a99-aa06-a43e7fd60b46 response_code = 200 uri = /crucible/0/regions
232026-09-04T23:15:39.841ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62282 req_id = d5fd7e6f-8be9-45ed-a320-09e3b17296ab response_code = 200 uri = /crucible/0/regions/22d6a066-5317-46db-95b4-e3da95d71e62
242026-09-04T23:15:39.844ZINFOcrucible-agent (datafile): path is "/data/regions/22d6a066-5317-46db-95b4-e3da95d71e62"
252026-09-04T23:15:39.852ZINFOcrucible-agent (datafile): dataset is oxp_40315275-e4ed-4f5a-bb5d-58fc0f710b19/crucible/regions/22d6a066-5317-46db-95b4-e3da95d71e62
262026-09-04T23:15:39.858ZINFOcrucible-agent (datafile): region 22d6a066-5317-46db-95b4-e3da95d71e62 state: Created -> Tombstoned
272026-09-04T23:15:39.858ZINFOcrucible-agent (dropshot): request completed latency_us = 14324 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:62282 req_id = ee3f0441-33be-462f-b29d-e861bcc2b8d9 response_code = 204 uri = /crucible/0/regions/22d6a066-5317-46db-95b4-e3da95d71e62
282026-09-04T23:15:39.858ZINFOcrucible-agent (worker): applying SMF actions before removal...
292026-09-04T23:15:39.859ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-22d6a066-5317-46db-95b4-e3da95d71e62 (instance states: (Some(Online), None))
302026-09-04T23:15:39.862ZINFOcrucible-agent (worker): SMF ok!
312026-09-04T23:15:39.863ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62282 req_id = 7751c454-8889-4d7e-a2ef-3b4620ff6fb1 response_code = 200 uri = /crucible/0/regions/22d6a066-5317-46db-95b4-e3da95d71e62
322026-09-04T23:15:39.870ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_40315275-e4ed-4f5a-bb5d-58fc0f710b19/crucible/regions/22d6a066-5317-46db-95b4-e3da95d71e62" region = 22d6a066-5317-46db-95b4-e3da95d71e62
332026-09-04T23:15:39.918ZINFOcrucible-agent (datafile): region 22d6a066-5317-46db-95b4-e3da95d71e62 state: Tombstoned -> Destroyed
342026-09-04T23:15:39.931ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62282 req_id = e7752f9d-d45b-49df-91e8-297dc369f63e response_code = 200 uri = /crucible/0/regions/22d6a066-5317-46db-95b4-e3da95d71e62
352026-09-04T23:26:50.537ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:44590
362026-09-04T23:26:50.537ZINFOcrucible-agent (datafile): region 3cd2b4af-009f-4b4f-a874-1a68e7c201fc state: Requested
372026-09-04T23:26:50.539ZINFOcrucible-agent (dropshot): request completed latency_us = 1653 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:44590 req_id = f53ae986-155d-488e-8c81-c1bf3ee1bab5 response_code = 200 uri = /crucible/0/regions
382026-09-04T23:26:50.539ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
392026-09-04T23:26:50.548ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_40315275-e4ed-4f5a-bb5d-58fc0f710b19/crucible/regions/3cd2b4af-009f-4b4f-a874-1a68e7c201fc
402026-09-04T23:26:50.548ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_40315275-e4ed-4f5a-bb5d-58fc0f710b19/crucible/regions/3cd2b4af-009f-4b4f-a874-1a68e7c201fc
412026-09-04T23:26:50.597ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3cd2b4af-009f-4b4f-a874-1a68e7c201fc"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3cd2b4af-009f-4b4f-a874-1a68e7c201fc" region = 3cd2b4af-009f-4b4f-a874-1a68e7c201fc
422026-09-04T23:26:50.597ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3cd2b4af-009f-4b4f-a874-1a68e7c201fc" "--data" "/data/regions/3cd2b4af-009f-4b4f-a874-1a68e7c201fc" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3cd2b4af-009f-4b4f-a874-1a68e7c201fc
432026-09-04T23:26:50.642ZINFOcrucible-agent (worker): region files created ok region = 3cd2b4af-009f-4b4f-a874-1a68e7c201fc
442026-09-04T23:26:50.642ZINFOcrucible-agent (datafile): region 3cd2b4af-009f-4b4f-a874-1a68e7c201fc state: Requested -> Created
452026-09-04T23:26:50.643ZINFOcrucible-agent (worker): applying SMF actions post create...
462026-09-04T23:26:50.643ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3cd2b4af-009f-4b4f-a874-1a68e7c201fc
472026-09-04T23:26:50.647ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3cd2b4af-009f-4b4f-a874-1a68e7c201fc
482026-09-04T23:26:50.659ZINFOcrucible-agent (worker): creating config property group
492026-09-04T23:26:50.660ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3cd2b4af-009f-4b4f-a874-1a68e7c201fc
502026-09-04T23:26:50.660ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3cd2b4af-009f-4b4f-a874-1a68e7c201fc
512026-09-04T23:26:50.660ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
522026-09-04T23:26:50.660ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
532026-09-04T23:26:50.660ZINFOcrucible-agent (worker): commit
542026-09-04T23:26:50.662ZINFOcrucible-agent (worker): ok!
552026-09-04T23:26:50.665ZINFOcrucible-agent (worker): SMF ok!
562026-09-04T23:26:50.717ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:44590 req_id = 18af392d-2ac2-4388-890a-018a68dea9cf response_code = 200 uri = /crucible/0/regions