Max level shown:
1 [ May 22 21:17:24 Enabled. ]
2 [ May 22 21:17:24 Rereading configuration. ]
3 [ May 22 21:17:26 Rereading configuration. ]
4 [ May 22 21:17:29 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_a0181c65-0f4e-456e-8740-999a9f6c2846/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-05-22T21:17:29.745ZINFOcrucible-agent: dataset: "oxp_a0181c65-0f4e-456e-8740-999a9f6c2846/crucible"
72025-05-22T21:17:29.748ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
82025-05-22T21:17:29.748ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-05-22T21:17:29.767ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-05-22T21:17:29.839ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
112025-05-22T21:28:29.781ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:57822
122025-05-22T21:28:29.831ZINFOcrucible-agent (datafile): region 3b0fc9e6-f2db-4094-86f5-16c88f15bb04 state: Requested
132025-05-22T21:28:29.836ZINFOcrucible-agent (dropshot): request completed latency_us = 29893 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57822 req_id = 4405f992-eb45-4cbe-a859-cadd1a4fbcf4 response_code = 200 uri = /crucible/0/regions
142025-05-22T21:28:29.838ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152025-05-22T21:28:29.849ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_a0181c65-0f4e-456e-8740-999a9f6c2846/crucible/regions/3b0fc9e6-f2db-4094-86f5-16c88f15bb04
162025-05-22T21:28:29.849ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_a0181c65-0f4e-456e-8740-999a9f6c2846/crucible/regions/3b0fc9e6-f2db-4094-86f5-16c88f15bb04
172025-05-22T21:28:29.910ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3b0fc9e6-f2db-4094-86f5-16c88f15bb04"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3b0fc9e6-f2db-4094-86f5-16c88f15bb04" region = 3b0fc9e6-f2db-4094-86f5-16c88f15bb04
182025-05-22T21:28:29.910ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3b0fc9e6-f2db-4094-86f5-16c88f15bb04" "--data" "/data/regions/3b0fc9e6-f2db-4094-86f5-16c88f15bb04" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3b0fc9e6-f2db-4094-86f5-16c88f15bb04
192025-05-22T21:28:29.985ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57822 req_id = bef03d55-0208-40f1-af0c-39732376d9ee response_code = 200 uri = /crucible/0/regions
202025-05-22T21:28:30.248ZINFOcrucible-agent (worker): region files created ok region = 3b0fc9e6-f2db-4094-86f5-16c88f15bb04
212025-05-22T21:28:30.248ZINFOcrucible-agent (datafile): region 3b0fc9e6-f2db-4094-86f5-16c88f15bb04 state: Requested -> Created
222025-05-22T21:28:30.248ZINFOcrucible-agent (worker): applying SMF actions post create...
232025-05-22T21:28:30.249ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3b0fc9e6-f2db-4094-86f5-16c88f15bb04
242025-05-22T21:28:30.259ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3b0fc9e6-f2db-4094-86f5-16c88f15bb04
252025-05-22T21:28:30.281ZINFOcrucible-agent (worker): creating config property group
262025-05-22T21:28:30.283ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3b0fc9e6-f2db-4094-86f5-16c88f15bb04
272025-05-22T21:28:30.284ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3b0fc9e6-f2db-4094-86f5-16c88f15bb04
282025-05-22T21:28:30.284ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-05-22T21:28:30.284ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
302025-05-22T21:28:30.284ZINFOcrucible-agent (worker): commit
312025-05-22T21:28:30.288ZINFOcrucible-agent (worker): ok!
322025-05-22T21:28:30.306ZINFOcrucible-agent (worker): SMF ok!
332025-05-22T21:28:30.718ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57822 req_id = 4aafbdc4-e6aa-43b8-b52e-0049c404f714 response_code = 200 uri = /crucible/0/regions
342025-05-22T21:28:55.407ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57822 req_id = acbaf265-b17d-4520-9176-bbc4a8ef4271 response_code = 200 uri = /crucible/0/regions/3b0fc9e6-f2db-4094-86f5-16c88f15bb04
352025-05-22T21:28:55.410ZINFOcrucible-agent (datafile): path is "/data/regions/3b0fc9e6-f2db-4094-86f5-16c88f15bb04"
362025-05-22T21:28:55.422ZINFOcrucible-agent (datafile): dataset is oxp_a0181c65-0f4e-456e-8740-999a9f6c2846/crucible/regions/3b0fc9e6-f2db-4094-86f5-16c88f15bb04
372025-05-22T21:28:55.433ZINFOcrucible-agent (datafile): region 3b0fc9e6-f2db-4094-86f5-16c88f15bb04 state: Created -> Tombstoned
382025-05-22T21:28:55.433ZINFOcrucible-agent (worker): applying SMF actions before removal...
392025-05-22T21:28:55.433ZINFOcrucible-agent (dropshot): request completed latency_us = 23066 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:57822 req_id = 4c148124-68e7-4334-88cb-0b46076261a2 response_code = 204 uri = /crucible/0/regions/3b0fc9e6-f2db-4094-86f5-16c88f15bb04
402025-05-22T21:28:55.434ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-3b0fc9e6-f2db-4094-86f5-16c88f15bb04 (instance states: (Some(Online), None))
412025-05-22T21:28:55.436ZINFOcrucible-agent (dropshot): request completed latency_us = 24 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57822 req_id = 357b8382-6f15-4275-a1fa-8dc5851e01b5 response_code = 200 uri = /crucible/0/regions/3b0fc9e6-f2db-4094-86f5-16c88f15bb04
422025-05-22T21:28:55.443ZINFOcrucible-agent (worker): SMF ok!
432025-05-22T21:28:55.454ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_a0181c65-0f4e-456e-8740-999a9f6c2846/crucible/regions/3b0fc9e6-f2db-4094-86f5-16c88f15bb04" region = 3b0fc9e6-f2db-4094-86f5-16c88f15bb04
442025-05-22T21:28:55.513ZINFOcrucible-agent (datafile): region 3b0fc9e6-f2db-4094-86f5-16c88f15bb04 state: Tombstoned -> Destroyed
452025-05-22T21:28:55.515ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57822 req_id = 504b1600-ba6d-47ae-a93a-3d68eb6bb582 response_code = 200 uri = /crucible/0/regions/3b0fc9e6-f2db-4094-86f5-16c88f15bb04