Max level shown:
1 [ Jan 29 05:08:00 Enabled. ]
2 [ Jan 29 05:08:00 Rereading configuration. ]
3 [ Jan 29 05:08:01 Rereading configuration. ]
4 [ Jan 29 05:08:06 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_002e4d33-38d3-4a77-84d3-600f2d6c5d75/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-01-29T05:08:06.169ZINFOcrucible-agent: dataset: "oxp_002e4d33-38d3-4a77-84d3-600f2d6c5d75/crucible"
72025-01-29T05:08:06.170ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
82025-01-29T05:08:06.170ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-01-29T05:08:06.184ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-01-29T05:08:06.243ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
112025-01-29T05:08:46.994ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::c]:62771
122025-01-29T05:08:47.024ZINFOcrucible-agent (datafile): region 261f3732-730b-4209-9cd1-69cee1316c94 state: Requested
132025-01-29T05:08:47.029ZINFOcrucible-agent (dropshot): request completed latency_us = 15645 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:62771 req_id = 71800d76-65ca-4290-a5c7-aa5a45f158e6 response_code = 200 uri = /crucible/0/regions
142025-01-29T05:08:47.029ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152025-01-29T05:08:47.039ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_002e4d33-38d3-4a77-84d3-600f2d6c5d75/crucible/regions/261f3732-730b-4209-9cd1-69cee1316c94
162025-01-29T05:08:47.039ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_002e4d33-38d3-4a77-84d3-600f2d6c5d75/crucible/regions/261f3732-730b-4209-9cd1-69cee1316c94
172025-01-29T05:08:47.104ZINFOcrucible-agent (worker): creating region Region { id: RegionId("261f3732-730b-4209-9cd1-69cee1316c94"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/261f3732-730b-4209-9cd1-69cee1316c94" region = 261f3732-730b-4209-9cd1-69cee1316c94
182025-01-29T05:08:47.106ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "261f3732-730b-4209-9cd1-69cee1316c94" "--data" "/data/regions/261f3732-730b-4209-9cd1-69cee1316c94" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 261f3732-730b-4209-9cd1-69cee1316c94
192025-01-29T05:08:47.238ZINFOcrucible-agent (worker): region files created ok region = 261f3732-730b-4209-9cd1-69cee1316c94
202025-01-29T05:08:47.238ZINFOcrucible-agent (datafile): region 261f3732-730b-4209-9cd1-69cee1316c94 state: Requested -> Created
212025-01-29T05:08:47.238ZINFOcrucible-agent (worker): applying SMF actions post create...
222025-01-29T05:08:47.239ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-261f3732-730b-4209-9cd1-69cee1316c94
232025-01-29T05:08:47.246ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-261f3732-730b-4209-9cd1-69cee1316c94
242025-01-29T05:08:47.269ZINFOcrucible-agent (worker): creating config property group
252025-01-29T05:08:47.282ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-261f3732-730b-4209-9cd1-69cee1316c94
262025-01-29T05:08:47.283ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/261f3732-730b-4209-9cd1-69cee1316c94
272025-01-29T05:08:47.285ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282025-01-29T05:08:47.285ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
292025-01-29T05:08:47.285ZINFOcrucible-agent (worker): commit
302025-01-29T05:08:47.291ZINFOcrucible-agent (worker): ok!
312025-01-29T05:08:47.295ZINFOcrucible-agent (worker): SMF ok!
322025-01-29T05:08:47.321ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:62771 req_id = 2709c896-3169-476b-86b8-dd6e9786a6a8 response_code = 200 uri = /crucible/0/regions
332025-01-29T05:08:49.534ZINFOcrucible-agent (dropshot): request completed latency_us = 97 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62771 req_id = b0e09041-8372-4370-9cf2-b26aaf16d380 response_code = 200 uri = /crucible/0/regions/261f3732-730b-4209-9cd1-69cee1316c94
342025-01-29T05:08:49.537ZINFOcrucible-agent (datafile): path is "/data/regions/261f3732-730b-4209-9cd1-69cee1316c94"
352025-01-29T05:08:49.549ZINFOcrucible-agent (datafile): dataset is oxp_002e4d33-38d3-4a77-84d3-600f2d6c5d75/crucible/regions/261f3732-730b-4209-9cd1-69cee1316c94
362025-01-29T05:08:49.559ZINFOcrucible-agent (datafile): region 261f3732-730b-4209-9cd1-69cee1316c94 state: Created -> Tombstoned
372025-01-29T05:08:49.559ZINFOcrucible-agent (worker): applying SMF actions before removal...
382025-01-29T05:08:49.561ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-261f3732-730b-4209-9cd1-69cee1316c94 (instance states: (Some(Online), None))
392025-01-29T05:08:49.561ZINFOcrucible-agent (dropshot): request completed latency_us = 24206 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:62771 req_id = 7debe113-3b53-4af6-9576-ce2378b2e5d4 response_code = 204 uri = /crucible/0/regions/261f3732-730b-4209-9cd1-69cee1316c94
402025-01-29T05:08:49.564ZINFOcrucible-agent (dropshot): request completed latency_us = 32 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62771 req_id = e73e41ca-e6c5-4dac-8815-c693eb043b4d response_code = 200 uri = /crucible/0/regions/261f3732-730b-4209-9cd1-69cee1316c94
412025-01-29T05:08:49.674ZINFOcrucible-agent (dropshot): request completed latency_us = 25 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62771 req_id = 063ba716-9224-4737-9abc-310e8ac54fb1 response_code = 200 uri = /crucible/0/regions/261f3732-730b-4209-9cd1-69cee1316c94
422025-01-29T05:08:49.718ZINFOcrucible-agent (worker): SMF ok!
432025-01-29T05:08:49.727ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_002e4d33-38d3-4a77-84d3-600f2d6c5d75/crucible/regions/261f3732-730b-4209-9cd1-69cee1316c94" region = 261f3732-730b-4209-9cd1-69cee1316c94
442025-01-29T05:08:49.763ZINFOcrucible-agent (dropshot): request completed latency_us = 96 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62771 req_id = bda7f93f-5bd8-4a6d-9d4c-6d545b239f00 response_code = 200 uri = /crucible/0/regions/261f3732-730b-4209-9cd1-69cee1316c94
452025-01-29T05:08:49.937ZINFOcrucible-agent (dropshot): request completed latency_us = 36 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62771 req_id = 6db7bf10-4acc-4193-b212-b0c9d1944040 response_code = 200 uri = /crucible/0/regions/261f3732-730b-4209-9cd1-69cee1316c94
462025-01-29T05:08:49.952ZINFOcrucible-agent (datafile): region 261f3732-730b-4209-9cd1-69cee1316c94 state: Tombstoned -> Destroyed
472025-01-29T05:08:50.031ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62771 req_id = 3d397b31-fa82-45fa-aaea-b984db1c5bdc response_code = 200 uri = /crucible/0/regions/261f3732-730b-4209-9cd1-69cee1316c94