Max level shown:
12025-12-16T03:10:33.812ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:33859
22025-12-16T03:10:33.812ZINFOcrucible-agent (datafile): region ed031f93-d6c2-47f5-b3dc-a1027c8c3239 state: Requested
32025-12-16T03:10:33.813ZINFOcrucible-agent (dropshot): request completed latency_us = 606 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33859 req_id = 6949575b-6bd6-48be-b73b-3db36f48052e response_code = 200 uri = /crucible/0/regions
42025-12-16T03:10:33.813ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-12-16T03:10:33.822ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c012bd7a-77cd-4c34-8023-0864433eb619/crucible/regions/ed031f93-d6c2-47f5-b3dc-a1027c8c3239
62025-12-16T03:10:33.822ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c012bd7a-77cd-4c34-8023-0864433eb619/crucible/regions/ed031f93-d6c2-47f5-b3dc-a1027c8c3239
72025-12-16T03:10:33.877ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ed031f93-d6c2-47f5-b3dc-a1027c8c3239"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ed031f93-d6c2-47f5-b3dc-a1027c8c3239" region = ed031f93-d6c2-47f5-b3dc-a1027c8c3239
82025-12-16T03:10:33.877ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ed031f93-d6c2-47f5-b3dc-a1027c8c3239" "--data" "/data/regions/ed031f93-d6c2-47f5-b3dc-a1027c8c3239" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ed031f93-d6c2-47f5-b3dc-a1027c8c3239
92025-12-16T03:10:33.952ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33859 req_id = 4004ae80-cd6c-4622-bd19-8adcb75ba245 response_code = 200 uri = /crucible/0/regions
102025-12-16T03:10:33.982ZINFOcrucible-agent (worker): region files created ok region = ed031f93-d6c2-47f5-b3dc-a1027c8c3239
112025-12-16T03:10:33.982ZINFOcrucible-agent (datafile): region ed031f93-d6c2-47f5-b3dc-a1027c8c3239 state: Requested -> Created
122025-12-16T03:10:33.982ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-12-16T03:10:33.983ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ed031f93-d6c2-47f5-b3dc-a1027c8c3239
142025-12-16T03:10:33.993ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ed031f93-d6c2-47f5-b3dc-a1027c8c3239
152025-12-16T03:10:34.016ZINFOcrucible-agent (worker): creating config property group
162025-12-16T03:10:34.019ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ed031f93-d6c2-47f5-b3dc-a1027c8c3239
172025-12-16T03:10:34.019ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ed031f93-d6c2-47f5-b3dc-a1027c8c3239
182025-12-16T03:10:34.019ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-12-16T03:10:34.019ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202025-12-16T03:10:34.019ZINFOcrucible-agent (worker): commit
212025-12-16T03:10:34.023ZINFOcrucible-agent (worker): ok!
222025-12-16T03:10:34.027ZINFOcrucible-agent (worker): SMF ok!
232025-12-16T03:10:34.533ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33859 req_id = 1757d54b-64f7-4dab-af64-70ae5a4387d0 response_code = 200 uri = /crucible/0/regions
242025-12-16T03:10:40.490ZINFOcrucible-agent (datafile): region be7ce713-581e-49f2-91a2-344d47e771bb state: Requested
252025-12-16T03:10:40.490ZINFOcrucible-agent (dropshot): request completed latency_us = 241 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33859 req_id = 6932f1ec-554e-4a12-a397-c41c10bd8557 response_code = 200 uri = /crucible/0/regions
262025-12-16T03:10:40.490ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272025-12-16T03:10:40.497ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c012bd7a-77cd-4c34-8023-0864433eb619/crucible/regions/be7ce713-581e-49f2-91a2-344d47e771bb
282025-12-16T03:10:40.497ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c012bd7a-77cd-4c34-8023-0864433eb619/crucible/regions/be7ce713-581e-49f2-91a2-344d47e771bb
292025-12-16T03:10:40.550ZINFOcrucible-agent (worker): creating region Region { id: RegionId("be7ce713-581e-49f2-91a2-344d47e771bb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/be7ce713-581e-49f2-91a2-344d47e771bb" region = be7ce713-581e-49f2-91a2-344d47e771bb
302025-12-16T03:10:40.550ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "be7ce713-581e-49f2-91a2-344d47e771bb" "--data" "/data/regions/be7ce713-581e-49f2-91a2-344d47e771bb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = be7ce713-581e-49f2-91a2-344d47e771bb
312025-12-16T03:10:40.633ZINFOcrucible-agent (worker): region files created ok region = be7ce713-581e-49f2-91a2-344d47e771bb
322025-12-16T03:10:40.633ZINFOcrucible-agent (datafile): region be7ce713-581e-49f2-91a2-344d47e771bb state: Requested -> Created
332025-12-16T03:10:40.633ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-12-16T03:10:40.634ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-be7ce713-581e-49f2-91a2-344d47e771bb
352025-12-16T03:10:40.647ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-be7ce713-581e-49f2-91a2-344d47e771bb
362025-12-16T03:10:40.659ZINFOcrucible-agent (worker): creating config property group
372025-12-16T03:10:40.666ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-be7ce713-581e-49f2-91a2-344d47e771bb
382025-12-16T03:10:40.666ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/be7ce713-581e-49f2-91a2-344d47e771bb
392025-12-16T03:10:40.666ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-12-16T03:10:40.666ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
412025-12-16T03:10:40.666ZINFOcrucible-agent (worker): commit
422025-12-16T03:10:40.675ZINFOcrucible-agent (worker): ok!
432025-12-16T03:10:40.687ZINFOcrucible-agent (worker): SMF ok!
442025-12-16T03:10:40.834ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33859 req_id = 17f222c8-fc62-4a2d-a68d-9d6cdd7a2baa response_code = 200 uri = /crucible/0/regions
452025-12-16T03:11:07.702ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33859 req_id = 490ca113-bb17-4dcd-a9db-8fca843b024d response_code = 200 uri = /crucible/0/regions/be7ce713-581e-49f2-91a2-344d47e771bb
462025-12-16T03:11:07.706ZINFOcrucible-agent (datafile): path is "/data/regions/be7ce713-581e-49f2-91a2-344d47e771bb"
472025-12-16T03:11:07.716ZINFOcrucible-agent (datafile): dataset is oxp_c012bd7a-77cd-4c34-8023-0864433eb619/crucible/regions/be7ce713-581e-49f2-91a2-344d47e771bb
482025-12-16T03:11:07.723ZINFOcrucible-agent (datafile): region be7ce713-581e-49f2-91a2-344d47e771bb state: Created -> Tombstoned
492025-12-16T03:11:07.723ZINFOcrucible-agent (dropshot): request completed latency_us = 17424 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:33859 req_id = 985d9861-25d4-47d0-820e-1633a8d40f78 response_code = 204 uri = /crucible/0/regions/be7ce713-581e-49f2-91a2-344d47e771bb
502025-12-16T03:11:07.723ZINFOcrucible-agent (worker): applying SMF actions before removal...
512025-12-16T03:11:07.725ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-be7ce713-581e-49f2-91a2-344d47e771bb (instance states: (Some(Online), None))
522025-12-16T03:11:07.726ZINFOcrucible-agent (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33859 req_id = 0f447047-2a13-4173-9869-a9c939e035fe response_code = 200 uri = /crucible/0/regions/be7ce713-581e-49f2-91a2-344d47e771bb
532025-12-16T03:11:07.738ZINFOcrucible-agent (worker): SMF ok!
542025-12-16T03:11:07.746ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_c012bd7a-77cd-4c34-8023-0864433eb619/crucible/regions/be7ce713-581e-49f2-91a2-344d47e771bb" region = be7ce713-581e-49f2-91a2-344d47e771bb
552025-12-16T03:11:07.792ZINFOcrucible-agent (datafile): region be7ce713-581e-49f2-91a2-344d47e771bb state: Tombstoned -> Destroyed
562025-12-16T03:11:07.838ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33859 req_id = 00b5df65-afdd-4501-9845-ead7636261e1 response_code = 200 uri = /crucible/0/regions/be7ce713-581e-49f2-91a2-344d47e771bb