Max level shown:
12025-02-28T12:10:40.244ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::b]:41870
22025-02-28T12:10:40.244ZINFOcrucible-agent (datafile): region b1c4f32d-c760-41ed-bd45-4a6597e95014 state: Requested
32025-02-28T12:10:40.245ZINFOcrucible-agent (dropshot): request completed latency_us = 1583 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41870 req_id = 12c2d085-8aaa-4f0c-9316-b1da34373e07 response_code = 200 uri = /crucible/0/regions
42025-02-28T12:10:40.245ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-02-28T12:10:40.258ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_61811815-99c2-417c-a654-5920ee12f3d5/crucible/regions/b1c4f32d-c760-41ed-bd45-4a6597e95014
62025-02-28T12:10:40.258ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_61811815-99c2-417c-a654-5920ee12f3d5/crucible/regions/b1c4f32d-c760-41ed-bd45-4a6597e95014
72025-02-28T12:10:40.335ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b1c4f32d-c760-41ed-bd45-4a6597e95014"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b1c4f32d-c760-41ed-bd45-4a6597e95014" region = b1c4f32d-c760-41ed-bd45-4a6597e95014
82025-02-28T12:10:40.335ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b1c4f32d-c760-41ed-bd45-4a6597e95014" "--data" "/data/regions/b1c4f32d-c760-41ed-bd45-4a6597e95014" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b1c4f32d-c760-41ed-bd45-4a6597e95014
92025-02-28T12:10:40.418ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41870 req_id = 3de12cc1-66d9-4cf2-b6ef-237efc8771f3 response_code = 200 uri = /crucible/0/regions
102025-02-28T12:10:40.453ZINFOcrucible-agent (worker): region files created ok region = b1c4f32d-c760-41ed-bd45-4a6597e95014
112025-02-28T12:10:40.454ZINFOcrucible-agent (datafile): region b1c4f32d-c760-41ed-bd45-4a6597e95014 state: Requested -> Created
122025-02-28T12:10:40.454ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-02-28T12:10:40.455ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b1c4f32d-c760-41ed-bd45-4a6597e95014
142025-02-28T12:10:40.466ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b1c4f32d-c760-41ed-bd45-4a6597e95014
152025-02-28T12:10:40.493ZINFOcrucible-agent (worker): creating config property group
162025-02-28T12:10:40.508ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b1c4f32d-c760-41ed-bd45-4a6597e95014
172025-02-28T12:10:40.508ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b1c4f32d-c760-41ed-bd45-4a6597e95014
182025-02-28T12:10:40.508ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-02-28T12:10:40.508ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
202025-02-28T12:10:40.508ZINFOcrucible-agent (worker): commit
212025-02-28T12:10:40.519ZINFOcrucible-agent (worker): ok!
222025-02-28T12:10:40.528ZINFOcrucible-agent (worker): SMF ok!
232025-02-28T12:10:40.814ZINFOcrucible-agent (dropshot): request completed latency_us = 1217 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41870 req_id = 08098550-61d9-4c27-98c7-66b07635fdd0 response_code = 200 uri = /crucible/0/regions
242025-02-28T12:10:46.069ZINFOcrucible-agent (datafile): region 67e1b799-f018-449f-b6be-c269debee7cf state: Requested
252025-02-28T12:10:46.069ZINFOcrucible-agent (dropshot): request completed latency_us = 278 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41870 req_id = 59369d0d-5d28-4dea-9a63-62dc5823a8e9 response_code = 200 uri = /crucible/0/regions
262025-02-28T12:10:46.069ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272025-02-28T12:10:46.080ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_61811815-99c2-417c-a654-5920ee12f3d5/crucible/regions/67e1b799-f018-449f-b6be-c269debee7cf
282025-02-28T12:10:46.080ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_61811815-99c2-417c-a654-5920ee12f3d5/crucible/regions/67e1b799-f018-449f-b6be-c269debee7cf
292025-02-28T12:10:46.150ZINFOcrucible-agent (worker): creating region Region { id: RegionId("67e1b799-f018-449f-b6be-c269debee7cf"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/67e1b799-f018-449f-b6be-c269debee7cf" region = 67e1b799-f018-449f-b6be-c269debee7cf
302025-02-28T12:10:46.150ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "67e1b799-f018-449f-b6be-c269debee7cf" "--data" "/data/regions/67e1b799-f018-449f-b6be-c269debee7cf" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 67e1b799-f018-449f-b6be-c269debee7cf
312025-02-28T12:10:46.281ZINFOcrucible-agent (worker): region files created ok region = 67e1b799-f018-449f-b6be-c269debee7cf
322025-02-28T12:10:46.281ZINFOcrucible-agent (datafile): region 67e1b799-f018-449f-b6be-c269debee7cf state: Requested -> Created
332025-02-28T12:10:46.281ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-02-28T12:10:46.282ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-67e1b799-f018-449f-b6be-c269debee7cf
352025-02-28T12:10:46.295ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-67e1b799-f018-449f-b6be-c269debee7cf
362025-02-28T12:10:46.310ZINFOcrucible-agent (worker): creating config property group
372025-02-28T12:10:46.316ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-67e1b799-f018-449f-b6be-c269debee7cf
382025-02-28T12:10:46.316ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/67e1b799-f018-449f-b6be-c269debee7cf
392025-02-28T12:10:46.316ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-02-28T12:10:46.316ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
412025-02-28T12:10:46.316ZINFOcrucible-agent (worker): commit
422025-02-28T12:10:46.322ZINFOcrucible-agent (worker): ok!
432025-02-28T12:10:46.340ZINFOcrucible-agent (worker): SMF ok!
442025-02-28T12:10:46.354ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41870 req_id = 4e26c4c9-24c0-4673-8a69-f9e229cd61d9 response_code = 200 uri = /crucible/0/regions
452025-02-28T12:11:11.787ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41870 req_id = 9e1aac58-2dd5-48c4-b72f-88f2d29958ef response_code = 200 uri = /crucible/0/regions/67e1b799-f018-449f-b6be-c269debee7cf
462025-02-28T12:11:11.791ZINFOcrucible-agent (datafile): path is "/data/regions/67e1b799-f018-449f-b6be-c269debee7cf"
472025-02-28T12:11:11.803ZINFOcrucible-agent (datafile): dataset is oxp_61811815-99c2-417c-a654-5920ee12f3d5/crucible/regions/67e1b799-f018-449f-b6be-c269debee7cf
482025-02-28T12:11:11.813ZINFOcrucible-agent (datafile): region 67e1b799-f018-449f-b6be-c269debee7cf state: Created -> Tombstoned
492025-02-28T12:11:11.813ZINFOcrucible-agent (worker): applying SMF actions before removal...
502025-02-28T12:11:11.814ZINFOcrucible-agent (dropshot): request completed latency_us = 23181 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:41870 req_id = 42b0e9d4-3f19-49e4-b366-d5aef3311212 response_code = 204 uri = /crucible/0/regions/67e1b799-f018-449f-b6be-c269debee7cf
512025-02-28T12:11:11.815ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-67e1b799-f018-449f-b6be-c269debee7cf (instance states: (Some(Online), None))
522025-02-28T12:11:11.818ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41870 req_id = 7ba8b9c7-39b3-4ecb-bfbe-2465ea0b6cb9 response_code = 200 uri = /crucible/0/regions/67e1b799-f018-449f-b6be-c269debee7cf
532025-02-28T12:11:11.822ZINFOcrucible-agent (worker): SMF ok!
542025-02-28T12:11:11.833ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_61811815-99c2-417c-a654-5920ee12f3d5/crucible/regions/67e1b799-f018-449f-b6be-c269debee7cf" region = 67e1b799-f018-449f-b6be-c269debee7cf
552025-02-28T12:11:11.889ZINFOcrucible-agent (datafile): region 67e1b799-f018-449f-b6be-c269debee7cf state: Tombstoned -> Destroyed
562025-02-28T12:11:11.903ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41870 req_id = 65eaf354-0061-4cdd-9bfa-ae19323569cc response_code = 200 uri = /crucible/0/regions/67e1b799-f018-449f-b6be-c269debee7cf