Max level shown:
12025-05-15T04:23:45.453ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:53661
22025-05-15T04:23:45.453ZINFOcrucible-agent (datafile): region 50042335-3f18-4c12-9c9d-fa4cf57918ac state: Requested
32025-05-15T04:23:45.454ZINFOcrucible-agent (dropshot): request completed latency_us = 1024 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:53661 req_id = a98dde27-3294-420d-a6d6-0e079f5cc156 response_code = 200 uri = /crucible/0/regions
42025-05-15T04:23:45.454ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-05-15T04:23:45.468ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8be487e2-3613-473b-875b-3aad0cb736f2/crucible/regions/50042335-3f18-4c12-9c9d-fa4cf57918ac
62025-05-15T04:23:45.468ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8be487e2-3613-473b-875b-3aad0cb736f2/crucible/regions/50042335-3f18-4c12-9c9d-fa4cf57918ac
72025-05-15T04:23:45.543ZINFOcrucible-agent (worker): creating region Region { id: RegionId("50042335-3f18-4c12-9c9d-fa4cf57918ac"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/50042335-3f18-4c12-9c9d-fa4cf57918ac" region = 50042335-3f18-4c12-9c9d-fa4cf57918ac
82025-05-15T04:23:45.543ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "50042335-3f18-4c12-9c9d-fa4cf57918ac" "--data" "/data/regions/50042335-3f18-4c12-9c9d-fa4cf57918ac" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 50042335-3f18-4c12-9c9d-fa4cf57918ac
92025-05-15T04:23:45.684ZINFOcrucible-agent (worker): region files created ok region = 50042335-3f18-4c12-9c9d-fa4cf57918ac
102025-05-15T04:23:45.684ZINFOcrucible-agent (datafile): region 50042335-3f18-4c12-9c9d-fa4cf57918ac state: Requested -> Created
112025-05-15T04:23:45.685ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-05-15T04:23:45.686ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-50042335-3f18-4c12-9c9d-fa4cf57918ac
132025-05-15T04:23:45.708ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-50042335-3f18-4c12-9c9d-fa4cf57918ac
142025-05-15T04:23:45.760ZINFOcrucible-agent (worker): creating config property group
152025-05-15T04:23:45.766ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-50042335-3f18-4c12-9c9d-fa4cf57918ac
162025-05-15T04:23:45.766ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/50042335-3f18-4c12-9c9d-fa4cf57918ac
172025-05-15T04:23:45.766ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182025-05-15T04:23:45.766ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
192025-05-15T04:23:45.766ZINFOcrucible-agent (worker): commit
202025-05-15T04:23:45.771ZINFOcrucible-agent (worker): ok!
212025-05-15T04:23:45.778ZINFOcrucible-agent (worker): SMF ok!
222025-05-15T04:23:45.790ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:53661 req_id = ab8642ee-5693-4214-88e9-75a0902b6738 response_code = 200 uri = /crucible/0/regions
232025-05-15T04:23:51.918ZINFOcrucible-agent (datafile): region 76aaa6a1-97db-4ae5-9bff-3311e1184df3 state: Requested
242025-05-15T04:23:51.918ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
252025-05-15T04:23:51.918ZINFOcrucible-agent (dropshot): request completed latency_us = 236 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:53661 req_id = 3240b6e5-5606-4124-a552-1f8671e8dc2c response_code = 200 uri = /crucible/0/regions
262025-05-15T04:23:51.929ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8be487e2-3613-473b-875b-3aad0cb736f2/crucible/regions/76aaa6a1-97db-4ae5-9bff-3311e1184df3
272025-05-15T04:23:51.929ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8be487e2-3613-473b-875b-3aad0cb736f2/crucible/regions/76aaa6a1-97db-4ae5-9bff-3311e1184df3
282025-05-15T04:23:52.007ZINFOcrucible-agent (worker): creating region Region { id: RegionId("76aaa6a1-97db-4ae5-9bff-3311e1184df3"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/76aaa6a1-97db-4ae5-9bff-3311e1184df3" region = 76aaa6a1-97db-4ae5-9bff-3311e1184df3
292025-05-15T04:23:52.007ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "76aaa6a1-97db-4ae5-9bff-3311e1184df3" "--data" "/data/regions/76aaa6a1-97db-4ae5-9bff-3311e1184df3" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 76aaa6a1-97db-4ae5-9bff-3311e1184df3
302025-05-15T04:23:52.063ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:53661 req_id = cd7bf710-1af9-448f-875a-2620f9a937e2 response_code = 200 uri = /crucible/0/regions
312025-05-15T04:23:52.123ZINFOcrucible-agent (worker): region files created ok region = 76aaa6a1-97db-4ae5-9bff-3311e1184df3
322025-05-15T04:23:52.123ZINFOcrucible-agent (datafile): region 76aaa6a1-97db-4ae5-9bff-3311e1184df3 state: Requested -> Created
332025-05-15T04:23:52.123ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-05-15T04:23:52.125ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-76aaa6a1-97db-4ae5-9bff-3311e1184df3
352025-05-15T04:23:52.140ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-76aaa6a1-97db-4ae5-9bff-3311e1184df3
362025-05-15T04:23:52.160ZINFOcrucible-agent (worker): creating config property group
372025-05-15T04:23:52.169ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-76aaa6a1-97db-4ae5-9bff-3311e1184df3
382025-05-15T04:23:52.169ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/76aaa6a1-97db-4ae5-9bff-3311e1184df3
392025-05-15T04:23:52.169ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-05-15T04:23:52.169ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
412025-05-15T04:23:52.169ZINFOcrucible-agent (worker): commit
422025-05-15T04:23:52.178ZINFOcrucible-agent (worker): ok!
432025-05-15T04:23:52.185ZINFOcrucible-agent (worker): SMF ok!
442025-05-15T04:23:52.680ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:53661 req_id = a0240543-c0f1-4c95-8d9a-f5c1cff88d1c response_code = 200 uri = /crucible/0/regions
452025-05-15T04:24:17.864ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:53661 req_id = 80983e64-891e-40b7-8c02-d018391bafa9 response_code = 200 uri = /crucible/0/regions/76aaa6a1-97db-4ae5-9bff-3311e1184df3
462025-05-15T04:24:17.868ZINFOcrucible-agent (datafile): path is "/data/regions/76aaa6a1-97db-4ae5-9bff-3311e1184df3"
472025-05-15T04:24:17.880ZINFOcrucible-agent (datafile): dataset is oxp_8be487e2-3613-473b-875b-3aad0cb736f2/crucible/regions/76aaa6a1-97db-4ae5-9bff-3311e1184df3
482025-05-15T04:24:17.890ZINFOcrucible-agent (datafile): region 76aaa6a1-97db-4ae5-9bff-3311e1184df3 state: Created -> Tombstoned
492025-05-15T04:24:17.890ZINFOcrucible-agent (worker): applying SMF actions before removal...
502025-05-15T04:24:17.890ZINFOcrucible-agent (dropshot): request completed latency_us = 22608 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:53661 req_id = d96b2f2d-efc3-4322-85e4-c2357dd2c723 response_code = 204 uri = /crucible/0/regions/76aaa6a1-97db-4ae5-9bff-3311e1184df3
512025-05-15T04:24:17.892ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-76aaa6a1-97db-4ae5-9bff-3311e1184df3 (instance states: (Some(Online), None))
522025-05-15T04:24:17.895ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:53661 req_id = b1fb4580-7bb7-408a-bc6c-4eb3ecd0091d response_code = 200 uri = /crucible/0/regions/76aaa6a1-97db-4ae5-9bff-3311e1184df3
532025-05-15T04:24:17.899ZINFOcrucible-agent (worker): SMF ok!
542025-05-15T04:24:17.909ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_8be487e2-3613-473b-875b-3aad0cb736f2/crucible/regions/76aaa6a1-97db-4ae5-9bff-3311e1184df3" region = 76aaa6a1-97db-4ae5-9bff-3311e1184df3
552025-05-15T04:24:17.961ZINFOcrucible-agent (datafile): region 76aaa6a1-97db-4ae5-9bff-3311e1184df3 state: Tombstoned -> Destroyed
562025-05-15T04:24:18.042ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:53661 req_id = c3d49a92-4092-4a24-9f55-d80068cc1b45 response_code = 200 uri = /crucible/0/regions/76aaa6a1-97db-4ae5-9bff-3311e1184df3