Max level shown:
1 [ Jan 29 05:08:00 Enabled. ]
2 [ Jan 29 05:08:00 Rereading configuration. ]
3 [ Jan 29 05:08:02 Rereading configuration. ]
4 [ Jan 29 05:08:05 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_ffcf5888-2a86-4258-82a2-0898b84886c7/crucible -l [fd00:1122:3344:101::15]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-01-29T05:08:06.011ZINFOcrucible-agent: dataset: "oxp_ffcf5888-2a86-4258-82a2-0898b84886c7/crucible"
72025-01-29T05:08:06.012ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::15]:32345
82025-01-29T05:08:06.012ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-01-29T05:08:06.031ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-01-29T05:08:06.109ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::15]:32345
112025-01-29T05:08:46.995ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:35049
122025-01-29T05:08:47.022ZINFOcrucible-agent (datafile): region a3bfa6a9-7e3a-4a32-8199-4a69242acb42 state: Requested
132025-01-29T05:08:47.025ZINFOcrucible-agent (dropshot): request completed latency_us = 11083 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:35049 req_id = baa5ce9a-a53c-4796-908e-067c06229cfd response_code = 200 uri = /crucible/0/regions
142025-01-29T05:08:47.027ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152025-01-29T05:08:47.037ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_ffcf5888-2a86-4258-82a2-0898b84886c7/crucible/regions/a3bfa6a9-7e3a-4a32-8199-4a69242acb42
162025-01-29T05:08:47.037ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_ffcf5888-2a86-4258-82a2-0898b84886c7/crucible/regions/a3bfa6a9-7e3a-4a32-8199-4a69242acb42
172025-01-29T05:08:47.127ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a3bfa6a9-7e3a-4a32-8199-4a69242acb42"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a3bfa6a9-7e3a-4a32-8199-4a69242acb42" region = a3bfa6a9-7e3a-4a32-8199-4a69242acb42
182025-01-29T05:08:47.129ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a3bfa6a9-7e3a-4a32-8199-4a69242acb42" "--data" "/data/regions/a3bfa6a9-7e3a-4a32-8199-4a69242acb42" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = a3bfa6a9-7e3a-4a32-8199-4a69242acb42
192025-01-29T05:08:47.303ZINFOcrucible-agent (worker): region files created ok region = a3bfa6a9-7e3a-4a32-8199-4a69242acb42
202025-01-29T05:08:47.303ZINFOcrucible-agent (datafile): region a3bfa6a9-7e3a-4a32-8199-4a69242acb42 state: Requested -> Created
212025-01-29T05:08:47.303ZINFOcrucible-agent (worker): applying SMF actions post create...
222025-01-29T05:08:47.304ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a3bfa6a9-7e3a-4a32-8199-4a69242acb42
232025-01-29T05:08:47.308ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a3bfa6a9-7e3a-4a32-8199-4a69242acb42
242025-01-29T05:08:47.325ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:35049 req_id = 0c968f35-0dc2-46e8-ae2a-19a5e45c1d91 response_code = 200 uri = /crucible/0/regions
252025-01-29T05:08:47.406ZINFOcrucible-agent (worker): creating config property group
262025-01-29T05:08:47.414ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a3bfa6a9-7e3a-4a32-8199-4a69242acb42
272025-01-29T05:08:47.427ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a3bfa6a9-7e3a-4a32-8199-4a69242acb42
282025-01-29T05:08:47.429ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-01-29T05:08:47.429ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
302025-01-29T05:08:47.429ZINFOcrucible-agent (worker): commit
312025-01-29T05:08:47.437ZINFOcrucible-agent (worker): ok!
322025-01-29T05:08:47.444ZINFOcrucible-agent (worker): SMF ok!
332025-01-29T05:08:49.535ZINFOcrucible-agent (dropshot): request completed latency_us = 88 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:35049 req_id = 2812d7aa-a2f3-4ee5-86b3-2458a34d3f81 response_code = 200 uri = /crucible/0/regions/a3bfa6a9-7e3a-4a32-8199-4a69242acb42
342025-01-29T05:08:49.538ZINFOcrucible-agent (datafile): path is "/data/regions/a3bfa6a9-7e3a-4a32-8199-4a69242acb42"
352025-01-29T05:08:49.549ZINFOcrucible-agent (datafile): dataset is oxp_ffcf5888-2a86-4258-82a2-0898b84886c7/crucible/regions/a3bfa6a9-7e3a-4a32-8199-4a69242acb42
362025-01-29T05:08:49.559ZINFOcrucible-agent (datafile): region a3bfa6a9-7e3a-4a32-8199-4a69242acb42 state: Created -> Tombstoned
372025-01-29T05:08:49.559ZINFOcrucible-agent (worker): applying SMF actions before removal...
382025-01-29T05:08:49.560ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-a3bfa6a9-7e3a-4a32-8199-4a69242acb42 (instance states: (Some(Online), None))
392025-01-29T05:08:49.561ZINFOcrucible-agent (dropshot): request completed latency_us = 22630 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:35049 req_id = 997bec51-799c-4d0b-bef7-4258b81305d2 response_code = 204 uri = /crucible/0/regions/a3bfa6a9-7e3a-4a32-8199-4a69242acb42
402025-01-29T05:08:49.564ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:35049 req_id = e54983cb-d918-4592-949e-b77b360c9593 response_code = 200 uri = /crucible/0/regions/a3bfa6a9-7e3a-4a32-8199-4a69242acb42
412025-01-29T05:08:49.665ZINFOcrucible-agent (dropshot): request completed latency_us = 20 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:35049 req_id = cf6b2b61-a3f6-4df5-b342-1127e93230b5 response_code = 200 uri = /crucible/0/regions/a3bfa6a9-7e3a-4a32-8199-4a69242acb42
422025-01-29T05:08:49.694ZINFOcrucible-agent (worker): SMF ok!
432025-01-29T05:08:49.706ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_ffcf5888-2a86-4258-82a2-0898b84886c7/crucible/regions/a3bfa6a9-7e3a-4a32-8199-4a69242acb42" region = a3bfa6a9-7e3a-4a32-8199-4a69242acb42
442025-01-29T05:08:49.823ZINFOcrucible-agent (dropshot): request completed latency_us = 88 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:35049 req_id = 03207d9a-1762-44a3-a90e-49a24ca05c6a response_code = 200 uri = /crucible/0/regions/a3bfa6a9-7e3a-4a32-8199-4a69242acb42
452025-01-29T05:08:49.937ZINFOcrucible-agent (dropshot): request completed latency_us = 37 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:35049 req_id = c724674a-5b15-417d-84ae-56aec6062a41 response_code = 200 uri = /crucible/0/regions/a3bfa6a9-7e3a-4a32-8199-4a69242acb42
462025-01-29T05:08:49.955ZINFOcrucible-agent (datafile): region a3bfa6a9-7e3a-4a32-8199-4a69242acb42 state: Tombstoned -> Destroyed
472025-01-29T05:08:50.068ZINFOcrucible-agent (dropshot): request completed latency_us = 32 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:35049 req_id = 500f3d53-160f-48ce-89a1-b41239240208 response_code = 200 uri = /crucible/0/regions/a3bfa6a9-7e3a-4a32-8199-4a69242acb42