Max level shown:
12025-12-24T04:54:56.562ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:57053
22025-12-24T04:54:56.612ZINFOcrucible-agent (datafile): region cec725e0-4a27-442c-95b2-e48ad2582849 state: Requested
32025-12-24T04:54:56.615ZINFOcrucible-agent (dropshot): request completed latency_us = 20380 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57053 req_id = d4016d33-22bc-4e26-9ce4-dd38b84e4cad response_code = 200 uri = /crucible/0/regions
42025-12-24T04:54:56.615ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-12-24T04:54:56.626ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e4d000b9-898b-4a52-af6d-9050ee76dbb8/crucible/regions/cec725e0-4a27-442c-95b2-e48ad2582849
62025-12-24T04:54:56.626ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e4d000b9-898b-4a52-af6d-9050ee76dbb8/crucible/regions/cec725e0-4a27-442c-95b2-e48ad2582849
72025-12-24T04:54:56.677ZINFOcrucible-agent (worker): creating region Region { id: RegionId("cec725e0-4a27-442c-95b2-e48ad2582849"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/cec725e0-4a27-442c-95b2-e48ad2582849" region = cec725e0-4a27-442c-95b2-e48ad2582849
82025-12-24T04:54:56.680ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "cec725e0-4a27-442c-95b2-e48ad2582849" "--data" "/data/regions/cec725e0-4a27-442c-95b2-e48ad2582849" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = cec725e0-4a27-442c-95b2-e48ad2582849
92025-12-24T04:54:56.902ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57053 req_id = 0a75bdd0-e09b-402b-9956-757c765cd4b9 response_code = 200 uri = /crucible/0/regions
102025-12-24T04:54:57.034ZINFOcrucible-agent (worker): region files created ok region = cec725e0-4a27-442c-95b2-e48ad2582849
112025-12-24T04:54:57.034ZINFOcrucible-agent (datafile): region cec725e0-4a27-442c-95b2-e48ad2582849 state: Requested -> Created
122025-12-24T04:54:57.034ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-12-24T04:54:57.034ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-cec725e0-4a27-442c-95b2-e48ad2582849
142025-12-24T04:54:57.047ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-cec725e0-4a27-442c-95b2-e48ad2582849
152025-12-24T04:54:57.069ZINFOcrucible-agent (worker): creating config property group
162025-12-24T04:54:57.072ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-cec725e0-4a27-442c-95b2-e48ad2582849
172025-12-24T04:54:57.075ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cec725e0-4a27-442c-95b2-e48ad2582849
182025-12-24T04:54:57.075ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-12-24T04:54:57.075ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202025-12-24T04:54:57.075ZINFOcrucible-agent (worker): commit
212025-12-24T04:54:57.079ZINFOcrucible-agent (worker): ok!
222025-12-24T04:54:57.094ZINFOcrucible-agent (worker): SMF ok!
232025-12-24T04:54:57.516ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57053 req_id = 5e3bab7e-dbb4-4244-8913-f27aca1b4eaa response_code = 200 uri = /crucible/0/regions
242025-12-24T04:55:03.400ZINFOcrucible-agent (datafile): region 22878156-62ed-429b-adbe-2ea065f39a59 state: Requested
252025-12-24T04:55:03.400ZINFOcrucible-agent (dropshot): request completed latency_us = 215 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57053 req_id = 66afa007-e23d-4f98-8dde-b8ebd49fe253 response_code = 200 uri = /crucible/0/regions
262025-12-24T04:55:03.400ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272025-12-24T04:55:03.407ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e4d000b9-898b-4a52-af6d-9050ee76dbb8/crucible/regions/22878156-62ed-429b-adbe-2ea065f39a59
282025-12-24T04:55:03.407ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e4d000b9-898b-4a52-af6d-9050ee76dbb8/crucible/regions/22878156-62ed-429b-adbe-2ea065f39a59
292025-12-24T04:55:03.455ZINFOcrucible-agent (worker): creating region Region { id: RegionId("22878156-62ed-429b-adbe-2ea065f39a59"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/22878156-62ed-429b-adbe-2ea065f39a59" region = 22878156-62ed-429b-adbe-2ea065f39a59
302025-12-24T04:55:03.455ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "22878156-62ed-429b-adbe-2ea065f39a59" "--data" "/data/regions/22878156-62ed-429b-adbe-2ea065f39a59" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 22878156-62ed-429b-adbe-2ea065f39a59
312025-12-24T04:55:03.527ZINFOcrucible-agent (worker): region files created ok region = 22878156-62ed-429b-adbe-2ea065f39a59
322025-12-24T04:55:03.527ZINFOcrucible-agent (datafile): region 22878156-62ed-429b-adbe-2ea065f39a59 state: Requested -> Created
332025-12-24T04:55:03.528ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-12-24T04:55:03.528ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-22878156-62ed-429b-adbe-2ea065f39a59
352025-12-24T04:55:03.531ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-22878156-62ed-429b-adbe-2ea065f39a59
362025-12-24T04:55:03.537ZINFOcrucible-agent (worker): creating config property group
372025-12-24T04:55:03.540ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-22878156-62ed-429b-adbe-2ea065f39a59
382025-12-24T04:55:03.540ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/22878156-62ed-429b-adbe-2ea065f39a59
392025-12-24T04:55:03.540ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-12-24T04:55:03.540ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
412025-12-24T04:55:03.540ZINFOcrucible-agent (worker): commit
422025-12-24T04:55:03.544ZINFOcrucible-agent (worker): ok!
432025-12-24T04:55:03.553ZINFOcrucible-agent (worker): SMF ok!
442025-12-24T04:55:03.655ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57053 req_id = 2262d5cb-559f-45fe-ab92-37fdc95147b2 response_code = 200 uri = /crucible/0/regions
452025-12-24T04:55:29.626ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57053 req_id = f335552a-02e1-414a-8184-f53f9b47717a response_code = 200 uri = /crucible/0/regions/22878156-62ed-429b-adbe-2ea065f39a59
462025-12-24T04:55:29.630ZINFOcrucible-agent (datafile): path is "/data/regions/22878156-62ed-429b-adbe-2ea065f39a59"
472025-12-24T04:55:29.641ZINFOcrucible-agent (datafile): dataset is oxp_e4d000b9-898b-4a52-af6d-9050ee76dbb8/crucible/regions/22878156-62ed-429b-adbe-2ea065f39a59
482025-12-24T04:55:29.648ZINFOcrucible-agent (datafile): region 22878156-62ed-429b-adbe-2ea065f39a59 state: Created -> Tombstoned
492025-12-24T04:55:29.648ZINFOcrucible-agent (dropshot): request completed latency_us = 17851 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:57053 req_id = 67e473e9-3d99-41dc-a532-740ae7c05ca6 response_code = 204 uri = /crucible/0/regions/22878156-62ed-429b-adbe-2ea065f39a59
502025-12-24T04:55:29.648ZINFOcrucible-agent (worker): applying SMF actions before removal...
512025-12-24T04:55:29.649ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-22878156-62ed-429b-adbe-2ea065f39a59 (instance states: (Some(Online), None))
522025-12-24T04:55:29.651ZINFOcrucible-agent (dropshot): request completed latency_us = 31 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57053 req_id = af38425b-32ba-4984-90a3-daa655b86321 response_code = 200 uri = /crucible/0/regions/22878156-62ed-429b-adbe-2ea065f39a59
532025-12-24T04:55:29.657ZINFOcrucible-agent (worker): SMF ok!
542025-12-24T04:55:29.665ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_e4d000b9-898b-4a52-af6d-9050ee76dbb8/crucible/regions/22878156-62ed-429b-adbe-2ea065f39a59" region = 22878156-62ed-429b-adbe-2ea065f39a59
552025-12-24T04:55:29.717ZINFOcrucible-agent (datafile): region 22878156-62ed-429b-adbe-2ea065f39a59 state: Tombstoned -> Destroyed
562025-12-24T04:55:29.800ZINFOcrucible-agent (dropshot): request completed latency_us = 42 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57053 req_id = 916020ec-19ae-44f5-9de3-1cdbdf2316d8 response_code = 200 uri = /crucible/0/regions/22878156-62ed-429b-adbe-2ea065f39a59