Max level shown:
12025-06-03T01:02:12.427ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:34529
22025-06-03T01:02:12.427ZINFOcrucible-agent (datafile): region 8ff433bd-ae1b-447a-a932-448df015404b state: Requested
32025-06-03T01:02:12.428ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-06-03T01:02:12.428ZINFOcrucible-agent (dropshot): request completed latency_us = 581 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34529 req_id = cc007c13-47f1-4e50-9c62-258a19b1cb0a response_code = 200 uri = /crucible/0/regions
52025-06-03T01:02:12.439ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_76c533a3-a707-416f-a227-73e64c58e1eb/crucible/regions/8ff433bd-ae1b-447a-a932-448df015404b
62025-06-03T01:02:12.439ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_76c533a3-a707-416f-a227-73e64c58e1eb/crucible/regions/8ff433bd-ae1b-447a-a932-448df015404b
72025-06-03T01:02:12.502ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8ff433bd-ae1b-447a-a932-448df015404b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8ff433bd-ae1b-447a-a932-448df015404b" region = 8ff433bd-ae1b-447a-a932-448df015404b
82025-06-03T01:02:12.502ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8ff433bd-ae1b-447a-a932-448df015404b" "--data" "/data/regions/8ff433bd-ae1b-447a-a932-448df015404b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 8ff433bd-ae1b-447a-a932-448df015404b
92025-06-03T01:02:12.750ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34529 req_id = fdb97bf5-0407-460d-a661-3c851d81b2e6 response_code = 200 uri = /crucible/0/regions
102025-06-03T01:02:12.775ZINFOcrucible-agent (worker): region files created ok region = 8ff433bd-ae1b-447a-a932-448df015404b
112025-06-03T01:02:12.775ZINFOcrucible-agent (datafile): region 8ff433bd-ae1b-447a-a932-448df015404b state: Requested -> Created
122025-06-03T01:02:12.775ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-06-03T01:02:12.777ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8ff433bd-ae1b-447a-a932-448df015404b
142025-06-03T01:02:12.786ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8ff433bd-ae1b-447a-a932-448df015404b
152025-06-03T01:02:12.807ZINFOcrucible-agent (worker): creating config property group
162025-06-03T01:02:12.810ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8ff433bd-ae1b-447a-a932-448df015404b
172025-06-03T01:02:12.810ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8ff433bd-ae1b-447a-a932-448df015404b
182025-06-03T01:02:12.811ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-06-03T01:02:12.811ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
202025-06-03T01:02:12.811ZINFOcrucible-agent (worker): commit
212025-06-03T01:02:12.814ZINFOcrucible-agent (worker): ok!
222025-06-03T01:02:12.819ZINFOcrucible-agent (worker): SMF ok!
232025-06-03T01:02:13.453ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34529 req_id = edd8de88-6fcb-47f0-8e85-762eb229dfa0 response_code = 200 uri = /crucible/0/regions
242025-06-03T01:02:19.695ZINFOcrucible-agent (datafile): region c6ef0b3a-5075-484e-8757-08221d959e55 state: Requested
252025-06-03T01:02:19.695ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262025-06-03T01:02:19.695ZINFOcrucible-agent (dropshot): request completed latency_us = 222 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34529 req_id = 7d8c01b6-9657-4caf-a385-49cb6c3b86f8 response_code = 200 uri = /crucible/0/regions
272025-06-03T01:02:19.706ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_76c533a3-a707-416f-a227-73e64c58e1eb/crucible/regions/c6ef0b3a-5075-484e-8757-08221d959e55
282025-06-03T01:02:19.706ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_76c533a3-a707-416f-a227-73e64c58e1eb/crucible/regions/c6ef0b3a-5075-484e-8757-08221d959e55
292025-06-03T01:02:19.766ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c6ef0b3a-5075-484e-8757-08221d959e55"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c6ef0b3a-5075-484e-8757-08221d959e55" region = c6ef0b3a-5075-484e-8757-08221d959e55
302025-06-03T01:02:19.768ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c6ef0b3a-5075-484e-8757-08221d959e55" "--data" "/data/regions/c6ef0b3a-5075-484e-8757-08221d959e55" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c6ef0b3a-5075-484e-8757-08221d959e55
312025-06-03T01:02:19.864ZINFOcrucible-agent (worker): region files created ok region = c6ef0b3a-5075-484e-8757-08221d959e55
322025-06-03T01:02:19.864ZINFOcrucible-agent (datafile): region c6ef0b3a-5075-484e-8757-08221d959e55 state: Requested -> Created
332025-06-03T01:02:19.864ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-06-03T01:02:19.867ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c6ef0b3a-5075-484e-8757-08221d959e55
352025-06-03T01:02:19.881ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c6ef0b3a-5075-484e-8757-08221d959e55
362025-06-03T01:02:19.888ZINFOcrucible-agent (worker): creating config property group
372025-06-03T01:02:19.892ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c6ef0b3a-5075-484e-8757-08221d959e55
382025-06-03T01:02:19.892ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c6ef0b3a-5075-484e-8757-08221d959e55
392025-06-03T01:02:19.892ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-06-03T01:02:19.892ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
412025-06-03T01:02:19.892ZINFOcrucible-agent (worker): commit
422025-06-03T01:02:19.897ZINFOcrucible-agent (worker): ok!
432025-06-03T01:02:19.902ZINFOcrucible-agent (worker): SMF ok!
442025-06-03T01:02:20.020ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34529 req_id = 4d740c28-1677-420b-b3b2-37c19b32eddb response_code = 200 uri = /crucible/0/regions
452025-06-03T01:02:46.426ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:34529 req_id = 8e76c4f7-21e8-471f-8c9e-3a259a9cf69e response_code = 200 uri = /crucible/0/regions/c6ef0b3a-5075-484e-8757-08221d959e55
462025-06-03T01:02:46.430ZINFOcrucible-agent (datafile): path is "/data/regions/c6ef0b3a-5075-484e-8757-08221d959e55"
472025-06-03T01:02:46.444ZINFOcrucible-agent (datafile): dataset is oxp_76c533a3-a707-416f-a227-73e64c58e1eb/crucible/regions/c6ef0b3a-5075-484e-8757-08221d959e55
482025-06-03T01:02:46.454ZINFOcrucible-agent (datafile): region c6ef0b3a-5075-484e-8757-08221d959e55 state: Created -> Tombstoned
492025-06-03T01:02:46.454ZINFOcrucible-agent (worker): applying SMF actions before removal...
502025-06-03T01:02:46.454ZINFOcrucible-agent (dropshot): request completed latency_us = 24344 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:34529 req_id = 9ff31267-6bde-4e66-afdf-b4de34894699 response_code = 204 uri = /crucible/0/regions/c6ef0b3a-5075-484e-8757-08221d959e55
512025-06-03T01:02:46.456ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-c6ef0b3a-5075-484e-8757-08221d959e55 (instance states: (Some(Online), None))
522025-06-03T01:02:46.458ZINFOcrucible-agent (dropshot): request completed latency_us = 24 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:34529 req_id = 3905ad03-29a7-421d-a17a-562612b91540 response_code = 200 uri = /crucible/0/regions/c6ef0b3a-5075-484e-8757-08221d959e55
532025-06-03T01:02:46.468ZINFOcrucible-agent (worker): SMF ok!
542025-06-03T01:02:46.478ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_76c533a3-a707-416f-a227-73e64c58e1eb/crucible/regions/c6ef0b3a-5075-484e-8757-08221d959e55" region = c6ef0b3a-5075-484e-8757-08221d959e55
552025-06-03T01:02:46.552ZINFOcrucible-agent (datafile): region c6ef0b3a-5075-484e-8757-08221d959e55 state: Tombstoned -> Destroyed
562025-06-03T01:02:46.594ZINFOcrucible-agent (dropshot): request completed latency_us = 88 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:34529 req_id = 397906e8-58f2-46b5-a2d0-9b607477c168 response_code = 200 uri = /crucible/0/regions/c6ef0b3a-5075-484e-8757-08221d959e55