Max level shown:
1 [ Sep 21 00:19:53 Enabled. ]
2 [ Sep 21 00:19:54 Rereading configuration. ]
3 [ Sep 21 00:19:56 Rereading configuration. ]
4 [ Sep 21 00:20:00 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_53c00ed2-7c36-4fa6-81af-7682e8fa5a1d/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-09-21T00:20:01.049ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 779775d5130ff7a4836f52f48b7e64d1479ee104 Commit timestamp: 2025-08-09T00:27:59.000000000Z branch: main rustc: 1.86.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72025-09-21T00:20:01.052ZINFOcrucible-agent: dataset: "oxp_53c00ed2-7c36-4fa6-81af-7682e8fa5a1d/crucible"
82025-09-21T00:20:01.052ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
92025-09-21T00:20:01.052ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102025-09-21T00:20:01.070ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112025-09-21T00:20:01.170ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
122025-09-21T00:21:02.483ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::c]:45331
132025-09-21T00:21:02.531ZINFOcrucible-agent (datafile): region a9a1aae2-0f33-477a-83ea-c5d45a087c12 state: Requested
142025-09-21T00:21:02.538ZINFOcrucible-agent (dropshot): request completed latency_us = 25966 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:45331 req_id = ff3b8554-1de7-4d15-a401-bc3c73e36f4c response_code = 200 uri = /crucible/0/regions
152025-09-21T00:21:02.543ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
162025-09-21T00:21:02.553ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_53c00ed2-7c36-4fa6-81af-7682e8fa5a1d/crucible/regions/a9a1aae2-0f33-477a-83ea-c5d45a087c12
172025-09-21T00:21:02.553ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_53c00ed2-7c36-4fa6-81af-7682e8fa5a1d/crucible/regions/a9a1aae2-0f33-477a-83ea-c5d45a087c12
182025-09-21T00:21:02.619ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a9a1aae2-0f33-477a-83ea-c5d45a087c12"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a9a1aae2-0f33-477a-83ea-c5d45a087c12" region = a9a1aae2-0f33-477a-83ea-c5d45a087c12
192025-09-21T00:21:02.622ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a9a1aae2-0f33-477a-83ea-c5d45a087c12" "--data" "/data/regions/a9a1aae2-0f33-477a-83ea-c5d45a087c12" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = a9a1aae2-0f33-477a-83ea-c5d45a087c12
202025-09-21T00:21:02.869ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:45331 req_id = 04b3d845-02c2-44ab-a754-71f72437d4f7 response_code = 200 uri = /crucible/0/regions
212025-09-21T00:21:02.977ZINFOcrucible-agent (worker): region files created ok region = a9a1aae2-0f33-477a-83ea-c5d45a087c12
222025-09-21T00:21:02.978ZINFOcrucible-agent (datafile): region a9a1aae2-0f33-477a-83ea-c5d45a087c12 state: Requested -> Created
232025-09-21T00:21:02.978ZINFOcrucible-agent (worker): applying SMF actions post create...
242025-09-21T00:21:02.978ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a9a1aae2-0f33-477a-83ea-c5d45a087c12
252025-09-21T00:21:02.997ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a9a1aae2-0f33-477a-83ea-c5d45a087c12
262025-09-21T00:21:03.025ZINFOcrucible-agent (worker): creating config property group
272025-09-21T00:21:03.035ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a9a1aae2-0f33-477a-83ea-c5d45a087c12
282025-09-21T00:21:03.035ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a9a1aae2-0f33-477a-83ea-c5d45a087c12
292025-09-21T00:21:03.046ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302025-09-21T00:21:03.046ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
312025-09-21T00:21:03.046ZINFOcrucible-agent (worker): commit
322025-09-21T00:21:03.071ZINFOcrucible-agent (worker): ok!
332025-09-21T00:21:03.077ZINFOcrucible-agent (worker): SMF ok!
342025-09-21T00:21:03.612ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:45331 req_id = b5d6e4a4-3224-4161-8d34-369dfc1be5a4 response_code = 200 uri = /crucible/0/regions
352025-09-21T00:21:04.153ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:45331 req_id = 852aada9-7076-495d-949b-5447e0ff84cb response_code = 200 uri = /crucible/0/regions/a9a1aae2-0f33-477a-83ea-c5d45a087c12
362025-09-21T00:21:04.156ZINFOcrucible-agent (datafile): path is "/data/regions/a9a1aae2-0f33-477a-83ea-c5d45a087c12"
372025-09-21T00:21:04.168ZINFOcrucible-agent (datafile): dataset is oxp_53c00ed2-7c36-4fa6-81af-7682e8fa5a1d/crucible/regions/a9a1aae2-0f33-477a-83ea-c5d45a087c12
382025-09-21T00:21:04.181ZINFOcrucible-agent (datafile): region a9a1aae2-0f33-477a-83ea-c5d45a087c12 state: Created -> Tombstoned
392025-09-21T00:21:04.181ZINFOcrucible-agent (worker): applying SMF actions before removal...
402025-09-21T00:21:04.181ZINFOcrucible-agent (dropshot): request completed latency_us = 25489 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:45331 req_id = 77f218af-f0bd-41b1-8620-f2fc1e57ee24 response_code = 204 uri = /crucible/0/regions/a9a1aae2-0f33-477a-83ea-c5d45a087c12
412025-09-21T00:21:04.182ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-a9a1aae2-0f33-477a-83ea-c5d45a087c12 (instance states: (Some(Online), None))
422025-09-21T00:21:04.184ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:45331 req_id = 303e49cc-7f13-4a90-9811-d9e538f6a842 response_code = 200 uri = /crucible/0/regions/a9a1aae2-0f33-477a-83ea-c5d45a087c12
432025-09-21T00:21:04.187ZINFOcrucible-agent (worker): SMF ok!
442025-09-21T00:21:04.199ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_53c00ed2-7c36-4fa6-81af-7682e8fa5a1d/crucible/regions/a9a1aae2-0f33-477a-83ea-c5d45a087c12" region = a9a1aae2-0f33-477a-83ea-c5d45a087c12
452025-09-21T00:21:04.279ZINFOcrucible-agent (datafile): region a9a1aae2-0f33-477a-83ea-c5d45a087c12 state: Tombstoned -> Destroyed
462025-09-21T00:21:04.280ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:45331 req_id = aa082e0e-4a15-46a1-bcf3-f10204f3ecc3 response_code = 200 uri = /crucible/0/regions/a9a1aae2-0f33-477a-83ea-c5d45a087c12
472025-09-21T00:21:06.577ZINFOcrucible-agent (datafile): region cb3da441-c864-4e03-9f0c-0c1709c56692 state: Requested
482025-09-21T00:21:06.577ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492025-09-21T00:21:06.577ZINFOcrucible-agent (dropshot): request completed latency_us = 201 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:45331 req_id = a2352f2b-6cad-49d2-8780-fed6fe5793b5 response_code = 200 uri = /crucible/0/regions
502025-09-21T00:21:06.586ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_53c00ed2-7c36-4fa6-81af-7682e8fa5a1d/crucible/regions/cb3da441-c864-4e03-9f0c-0c1709c56692
512025-09-21T00:21:06.586ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_53c00ed2-7c36-4fa6-81af-7682e8fa5a1d/crucible/regions/cb3da441-c864-4e03-9f0c-0c1709c56692
522025-09-21T00:21:06.654ZINFOcrucible-agent (worker): creating region Region { id: RegionId("cb3da441-c864-4e03-9f0c-0c1709c56692"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/cb3da441-c864-4e03-9f0c-0c1709c56692" region = cb3da441-c864-4e03-9f0c-0c1709c56692
532025-09-21T00:21:06.654ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "cb3da441-c864-4e03-9f0c-0c1709c56692" "--data" "/data/regions/cb3da441-c864-4e03-9f0c-0c1709c56692" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = cb3da441-c864-4e03-9f0c-0c1709c56692
542025-09-21T00:21:06.739ZINFOcrucible-agent (worker): region files created ok region = cb3da441-c864-4e03-9f0c-0c1709c56692
552025-09-21T00:21:06.739ZINFOcrucible-agent (datafile): region cb3da441-c864-4e03-9f0c-0c1709c56692 state: Requested -> Created
562025-09-21T00:21:06.739ZINFOcrucible-agent (worker): applying SMF actions post create...
572025-09-21T00:21:06.741ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-cb3da441-c864-4e03-9f0c-0c1709c56692
582025-09-21T00:21:06.744ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-cb3da441-c864-4e03-9f0c-0c1709c56692
592025-09-21T00:21:06.751ZINFOcrucible-agent (worker): creating config property group
602025-09-21T00:21:06.754ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-cb3da441-c864-4e03-9f0c-0c1709c56692
612025-09-21T00:21:06.755ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cb3da441-c864-4e03-9f0c-0c1709c56692
622025-09-21T00:21:06.755ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
632025-09-21T00:21:06.755ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
642025-09-21T00:21:06.755ZINFOcrucible-agent (worker): commit
652025-09-21T00:21:06.759ZINFOcrucible-agent (worker): ok!
662025-09-21T00:21:06.763ZINFOcrucible-agent (worker): SMF ok!
672025-09-21T00:21:06.950ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:45331 req_id = 4c044191-5cee-4529-9607-f743822b4328 response_code = 200 uri = /crucible/0/regions