Max level shown:
12025-12-21T00:07:24.524ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:57235
22025-12-21T00:07:24.571ZINFOcrucible-agent (datafile): region cc32308d-6e9b-4d60-95bb-d834d0776f38 state: Requested
32025-12-21T00:07:24.574ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-12-21T00:07:24.574ZINFOcrucible-agent (dropshot): request completed latency_us = 19115 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57235 req_id = bbe8d63c-071e-499e-a850-07d5514bd794 response_code = 200 uri = /crucible/0/regions
52025-12-21T00:07:24.584ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1a950b48-c304-4c39-bcfd-eea6d35f4e58/crucible/regions/cc32308d-6e9b-4d60-95bb-d834d0776f38
62025-12-21T00:07:24.584ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1a950b48-c304-4c39-bcfd-eea6d35f4e58/crucible/regions/cc32308d-6e9b-4d60-95bb-d834d0776f38
72025-12-21T00:07:24.651ZINFOcrucible-agent (worker): creating region Region { id: RegionId("cc32308d-6e9b-4d60-95bb-d834d0776f38"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/cc32308d-6e9b-4d60-95bb-d834d0776f38" region = cc32308d-6e9b-4d60-95bb-d834d0776f38
82025-12-21T00:07:24.653ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "cc32308d-6e9b-4d60-95bb-d834d0776f38" "--data" "/data/regions/cc32308d-6e9b-4d60-95bb-d834d0776f38" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = cc32308d-6e9b-4d60-95bb-d834d0776f38
92025-12-21T00:07:24.877ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57235 req_id = ce9b6e81-6198-483f-a03b-aacbc1e95be9 response_code = 200 uri = /crucible/0/regions
102025-12-21T00:07:25.072ZINFOcrucible-agent (worker): region files created ok region = cc32308d-6e9b-4d60-95bb-d834d0776f38
112025-12-21T00:07:25.072ZINFOcrucible-agent (datafile): region cc32308d-6e9b-4d60-95bb-d834d0776f38 state: Requested -> Created
122025-12-21T00:07:25.072ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-12-21T00:07:25.073ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-cc32308d-6e9b-4d60-95bb-d834d0776f38
142025-12-21T00:07:25.089ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-cc32308d-6e9b-4d60-95bb-d834d0776f38
152025-12-21T00:07:25.124ZINFOcrucible-agent (worker): creating config property group
162025-12-21T00:07:25.133ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-cc32308d-6e9b-4d60-95bb-d834d0776f38
172025-12-21T00:07:25.134ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cc32308d-6e9b-4d60-95bb-d834d0776f38
182025-12-21T00:07:25.134ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-12-21T00:07:25.134ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
202025-12-21T00:07:25.134ZINFOcrucible-agent (worker): commit
212025-12-21T00:07:25.143ZINFOcrucible-agent (worker): ok!
222025-12-21T00:07:25.149ZINFOcrucible-agent (worker): SMF ok!
232025-12-21T00:07:25.427ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57235 req_id = a9159771-6eb7-41ed-b93a-a3227b1fca09 response_code = 200 uri = /crucible/0/regions
242025-12-21T00:07:32.189ZINFOcrucible-agent (datafile): region f18a2df9-4e22-4d73-96ad-27c0ae3d239d state: Requested
252025-12-21T00:07:32.189ZINFOcrucible-agent (dropshot): request completed latency_us = 243 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57235 req_id = b4acb6f0-2b90-44d3-88ad-3ca11062f9a8 response_code = 200 uri = /crucible/0/regions
262025-12-21T00:07:32.189ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272025-12-21T00:07:32.197ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1a950b48-c304-4c39-bcfd-eea6d35f4e58/crucible/regions/f18a2df9-4e22-4d73-96ad-27c0ae3d239d
282025-12-21T00:07:32.197ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1a950b48-c304-4c39-bcfd-eea6d35f4e58/crucible/regions/f18a2df9-4e22-4d73-96ad-27c0ae3d239d
292025-12-21T00:07:32.333ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f18a2df9-4e22-4d73-96ad-27c0ae3d239d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/f18a2df9-4e22-4d73-96ad-27c0ae3d239d" region = f18a2df9-4e22-4d73-96ad-27c0ae3d239d
302025-12-21T00:07:32.334ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "f18a2df9-4e22-4d73-96ad-27c0ae3d239d" "--data" "/data/regions/f18a2df9-4e22-4d73-96ad-27c0ae3d239d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = f18a2df9-4e22-4d73-96ad-27c0ae3d239d
312025-12-21T00:07:32.346ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57235 req_id = ea46caa1-7f45-43aa-bca5-7a0094066bef response_code = 200 uri = /crucible/0/regions
322025-12-21T00:07:32.518ZINFOcrucible-agent (worker): region files created ok region = f18a2df9-4e22-4d73-96ad-27c0ae3d239d
332025-12-21T00:07:32.518ZINFOcrucible-agent (datafile): region f18a2df9-4e22-4d73-96ad-27c0ae3d239d state: Requested -> Created
342025-12-21T00:07:32.518ZINFOcrucible-agent (worker): applying SMF actions post create...
352025-12-21T00:07:32.522ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f18a2df9-4e22-4d73-96ad-27c0ae3d239d
362025-12-21T00:07:32.539ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f18a2df9-4e22-4d73-96ad-27c0ae3d239d
372025-12-21T00:07:32.563ZINFOcrucible-agent (worker): creating config property group
382025-12-21T00:07:32.579ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f18a2df9-4e22-4d73-96ad-27c0ae3d239d
392025-12-21T00:07:32.580ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f18a2df9-4e22-4d73-96ad-27c0ae3d239d
402025-12-21T00:07:32.580ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412025-12-21T00:07:32.580ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
422025-12-21T00:07:32.580ZINFOcrucible-agent (worker): commit
432025-12-21T00:07:32.590ZINFOcrucible-agent (worker): ok!
442025-12-21T00:07:32.599ZINFOcrucible-agent (worker): SMF ok!
452025-12-21T00:07:32.728ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57235 req_id = 46c7816a-9ebd-46f0-84db-6d52d3ee8ee7 response_code = 200 uri = /crucible/0/regions
462025-12-21T00:07:59.416ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57235 req_id = 725b71c8-926f-4f1f-ba4b-fa30d75171e3 response_code = 200 uri = /crucible/0/regions/f18a2df9-4e22-4d73-96ad-27c0ae3d239d
472025-12-21T00:07:59.419ZINFOcrucible-agent (datafile): path is "/data/regions/f18a2df9-4e22-4d73-96ad-27c0ae3d239d"
482025-12-21T00:07:59.427ZINFOcrucible-agent (datafile): dataset is oxp_1a950b48-c304-4c39-bcfd-eea6d35f4e58/crucible/regions/f18a2df9-4e22-4d73-96ad-27c0ae3d239d
492025-12-21T00:07:59.435ZINFOcrucible-agent (datafile): region f18a2df9-4e22-4d73-96ad-27c0ae3d239d state: Created -> Tombstoned
502025-12-21T00:07:59.435ZINFOcrucible-agent (dropshot): request completed latency_us = 16354 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:57235 req_id = fc172377-d4c9-4756-8486-75c39e45b647 response_code = 204 uri = /crucible/0/regions/f18a2df9-4e22-4d73-96ad-27c0ae3d239d
512025-12-21T00:07:59.435ZINFOcrucible-agent (worker): applying SMF actions before removal...
522025-12-21T00:07:59.436ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-f18a2df9-4e22-4d73-96ad-27c0ae3d239d (instance states: (Some(Online), None))
532025-12-21T00:07:59.438ZINFOcrucible-agent (dropshot): request completed latency_us = 31 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57235 req_id = 35bb28ea-cb88-4697-9838-8b10fd8cb961 response_code = 200 uri = /crucible/0/regions/f18a2df9-4e22-4d73-96ad-27c0ae3d239d
542025-12-21T00:07:59.444ZINFOcrucible-agent (worker): SMF ok!
552025-12-21T00:07:59.451ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_1a950b48-c304-4c39-bcfd-eea6d35f4e58/crucible/regions/f18a2df9-4e22-4d73-96ad-27c0ae3d239d" region = f18a2df9-4e22-4d73-96ad-27c0ae3d239d
562025-12-21T00:07:59.504ZINFOcrucible-agent (datafile): region f18a2df9-4e22-4d73-96ad-27c0ae3d239d state: Tombstoned -> Destroyed
572025-12-21T00:07:59.587ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57235 req_id = ccdda45d-97a8-487d-9b5d-9f103b98bf9e response_code = 200 uri = /crucible/0/regions/f18a2df9-4e22-4d73-96ad-27c0ae3d239d