Max level shown:
12025-06-04T18:39:20.395ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:57051
22025-06-04T18:39:20.440ZINFOcrucible-agent (datafile): region ca155172-f90f-41d7-8c9e-1e69278f3d8d state: Requested
32025-06-04T18:39:20.447ZINFOcrucible-agent (dropshot): request completed latency_us = 29260 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57051 req_id = 6f5110c2-c6da-4b38-b0cd-1a17db6c80da response_code = 200 uri = /crucible/0/regions
42025-06-04T18:39:20.448ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-06-04T18:39:20.460ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8fe970e0-3ec4-46a8-8458-816b23b73388/crucible/regions/ca155172-f90f-41d7-8c9e-1e69278f3d8d
62025-06-04T18:39:20.460ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8fe970e0-3ec4-46a8-8458-816b23b73388/crucible/regions/ca155172-f90f-41d7-8c9e-1e69278f3d8d
72025-06-04T18:39:20.517ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ca155172-f90f-41d7-8c9e-1e69278f3d8d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ca155172-f90f-41d7-8c9e-1e69278f3d8d" region = ca155172-f90f-41d7-8c9e-1e69278f3d8d
82025-06-04T18:39:20.517ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ca155172-f90f-41d7-8c9e-1e69278f3d8d" "--data" "/data/regions/ca155172-f90f-41d7-8c9e-1e69278f3d8d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ca155172-f90f-41d7-8c9e-1e69278f3d8d
92025-06-04T18:39:20.591ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57051 req_id = c5800924-3948-487f-bc32-7488b934dce3 response_code = 200 uri = /crucible/0/regions
102025-06-04T18:39:20.882ZINFOcrucible-agent (worker): region files created ok region = ca155172-f90f-41d7-8c9e-1e69278f3d8d
112025-06-04T18:39:20.882ZINFOcrucible-agent (datafile): region ca155172-f90f-41d7-8c9e-1e69278f3d8d state: Requested -> Created
122025-06-04T18:39:20.882ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-06-04T18:39:20.883ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ca155172-f90f-41d7-8c9e-1e69278f3d8d
142025-06-04T18:39:20.896ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ca155172-f90f-41d7-8c9e-1e69278f3d8d
152025-06-04T18:39:20.927ZINFOcrucible-agent (worker): creating config property group
162025-06-04T18:39:20.931ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ca155172-f90f-41d7-8c9e-1e69278f3d8d
172025-06-04T18:39:20.932ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ca155172-f90f-41d7-8c9e-1e69278f3d8d
182025-06-04T18:39:20.932ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-06-04T18:39:20.932ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
202025-06-04T18:39:20.932ZINFOcrucible-agent (worker): commit
212025-06-04T18:39:20.936ZINFOcrucible-agent (worker): ok!
222025-06-04T18:39:20.962ZINFOcrucible-agent (worker): SMF ok!
232025-06-04T18:39:21.067ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57051 req_id = bdabd4be-69cd-4ff4-82dd-5bff6b76455f response_code = 200 uri = /crucible/0/regions
242025-06-04T18:39:27.495ZINFOcrucible-agent (datafile): region 59ee9f60-bc5c-4b9c-9efe-2650b34b0743 state: Requested
252025-06-04T18:39:27.495ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262025-06-04T18:39:27.495ZINFOcrucible-agent (dropshot): request completed latency_us = 257 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57051 req_id = 68fdd7fc-2dfc-49f6-b017-6fc598ad1ca7 response_code = 200 uri = /crucible/0/regions
272025-06-04T18:39:27.506ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8fe970e0-3ec4-46a8-8458-816b23b73388/crucible/regions/59ee9f60-bc5c-4b9c-9efe-2650b34b0743
282025-06-04T18:39:27.506ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8fe970e0-3ec4-46a8-8458-816b23b73388/crucible/regions/59ee9f60-bc5c-4b9c-9efe-2650b34b0743
292025-06-04T18:39:27.568ZINFOcrucible-agent (worker): creating region Region { id: RegionId("59ee9f60-bc5c-4b9c-9efe-2650b34b0743"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/59ee9f60-bc5c-4b9c-9efe-2650b34b0743" region = 59ee9f60-bc5c-4b9c-9efe-2650b34b0743
302025-06-04T18:39:27.568ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "59ee9f60-bc5c-4b9c-9efe-2650b34b0743" "--data" "/data/regions/59ee9f60-bc5c-4b9c-9efe-2650b34b0743" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 59ee9f60-bc5c-4b9c-9efe-2650b34b0743
312025-06-04T18:39:27.655ZINFOcrucible-agent (worker): region files created ok region = 59ee9f60-bc5c-4b9c-9efe-2650b34b0743
322025-06-04T18:39:27.655ZINFOcrucible-agent (datafile): region 59ee9f60-bc5c-4b9c-9efe-2650b34b0743 state: Requested -> Created
332025-06-04T18:39:27.655ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-06-04T18:39:27.655ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-59ee9f60-bc5c-4b9c-9efe-2650b34b0743
352025-06-04T18:39:27.659ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-59ee9f60-bc5c-4b9c-9efe-2650b34b0743
362025-06-04T18:39:27.668ZINFOcrucible-agent (worker): creating config property group
372025-06-04T18:39:27.671ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-59ee9f60-bc5c-4b9c-9efe-2650b34b0743
382025-06-04T18:39:27.672ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/59ee9f60-bc5c-4b9c-9efe-2650b34b0743
392025-06-04T18:39:27.672ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-06-04T18:39:27.672ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
412025-06-04T18:39:27.672ZINFOcrucible-agent (worker): commit
422025-06-04T18:39:27.675ZINFOcrucible-agent (worker): ok!
432025-06-04T18:39:27.682ZINFOcrucible-agent (worker): SMF ok!
442025-06-04T18:39:27.808ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57051 req_id = 05bb5029-67c1-4ada-86fd-a52c787d8861 response_code = 200 uri = /crucible/0/regions
452025-06-04T18:39:53.405ZINFOcrucible-agent (dropshot): request completed latency_us = 2142 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:57051 req_id = 0adf436c-b984-427b-a2ce-5d10d29a64eb response_code = 200 uri = /crucible/0/regions/59ee9f60-bc5c-4b9c-9efe-2650b34b0743
462025-06-04T18:39:53.408ZINFOcrucible-agent (datafile): path is "/data/regions/59ee9f60-bc5c-4b9c-9efe-2650b34b0743"
472025-06-04T18:39:53.421ZINFOcrucible-agent (datafile): dataset is oxp_8fe970e0-3ec4-46a8-8458-816b23b73388/crucible/regions/59ee9f60-bc5c-4b9c-9efe-2650b34b0743
482025-06-04T18:39:53.431ZINFOcrucible-agent (datafile): region 59ee9f60-bc5c-4b9c-9efe-2650b34b0743 state: Created -> Tombstoned
492025-06-04T18:39:53.432ZINFOcrucible-agent (worker): applying SMF actions before removal...
502025-06-04T18:39:53.432ZINFOcrucible-agent (dropshot): request completed latency_us = 23852 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:57051 req_id = 78d25a9c-6bda-45bd-a28d-71cb662b93a2 response_code = 204 uri = /crucible/0/regions/59ee9f60-bc5c-4b9c-9efe-2650b34b0743
512025-06-04T18:39:53.433ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-59ee9f60-bc5c-4b9c-9efe-2650b34b0743 (instance states: (Some(Online), None))
522025-06-04T18:39:53.436ZINFOcrucible-agent (dropshot): request completed latency_us = 35 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:57051 req_id = 628e603b-390d-48ce-92d7-4bd067c82076 response_code = 200 uri = /crucible/0/regions/59ee9f60-bc5c-4b9c-9efe-2650b34b0743
532025-06-04T18:39:53.442ZINFOcrucible-agent (worker): SMF ok!
542025-06-04T18:39:53.452ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_8fe970e0-3ec4-46a8-8458-816b23b73388/crucible/regions/59ee9f60-bc5c-4b9c-9efe-2650b34b0743" region = 59ee9f60-bc5c-4b9c-9efe-2650b34b0743
552025-06-04T18:39:53.512ZINFOcrucible-agent (datafile): region 59ee9f60-bc5c-4b9c-9efe-2650b34b0743 state: Tombstoned -> Destroyed
562025-06-04T18:39:53.584ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:57051 req_id = 5ebe6382-62fc-4d84-a3e4-85363866ac22 response_code = 200 uri = /crucible/0/regions/59ee9f60-bc5c-4b9c-9efe-2650b34b0743