Max level shown:
1 [ Jun 28 23:40:37 Enabled. ]
2 [ Jun 28 23:40:37 Rereading configuration. ]
3 [ Jun 28 23:40:39 Rereading configuration. ]
4 [ Jun 28 23:40:45 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_12882c07-c253-4405-9cb3-95dd30ae3d50/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-06-28T23:40:45.699ZINFOcrucible-agent: dataset: "oxp_12882c07-c253-4405-9cb3-95dd30ae3d50/crucible"
72024-06-28T23:40:45.703ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
82024-06-28T23:40:45.703ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-06-28T23:40:45.718ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-06-28T23:40:45.910ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
112024-06-28T23:41:12.655ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::c]:39385
122024-06-28T23:41:12.656ZINFOcrucible-agent (datafile): region 9e8e53b4-c4a7-46bf-82a0-350ccc845683 state: Requested
132024-06-28T23:41:12.657ZINFOcrucible-agent (dropshot): request completed latency_us = 1263 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:39385 req_id = d9acccbe-ef4f-4160-a990-422759a42ad5 response_code = 200 uri = /crucible/0/regions
142024-06-28T23:41:12.657ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-06-28T23:41:12.668ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_12882c07-c253-4405-9cb3-95dd30ae3d50/crucible/regions/9e8e53b4-c4a7-46bf-82a0-350ccc845683
162024-06-28T23:41:12.668ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_12882c07-c253-4405-9cb3-95dd30ae3d50/crucible/regions/9e8e53b4-c4a7-46bf-82a0-350ccc845683
172024-06-28T23:41:12.823ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9e8e53b4-c4a7-46bf-82a0-350ccc845683"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9e8e53b4-c4a7-46bf-82a0-350ccc845683" region = 9e8e53b4-c4a7-46bf-82a0-350ccc845683
182024-06-28T23:41:12.825ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9e8e53b4-c4a7-46bf-82a0-350ccc845683" "--data" "/data/regions/9e8e53b4-c4a7-46bf-82a0-350ccc845683" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 9e8e53b4-c4a7-46bf-82a0-350ccc845683
192024-06-28T23:41:13.005ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:39385 req_id = 88ed335c-5287-468f-9538-777d701243cd response_code = 200 uri = /crucible/0/regions
202024-06-28T23:41:13.068ZINFOcrucible-agent (worker): region files created ok region = 9e8e53b4-c4a7-46bf-82a0-350ccc845683
212024-06-28T23:41:13.068ZINFOcrucible-agent (datafile): region 9e8e53b4-c4a7-46bf-82a0-350ccc845683 state: Requested -> Created
222024-06-28T23:41:13.069ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-06-28T23:41:13.069ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9e8e53b4-c4a7-46bf-82a0-350ccc845683
242024-06-28T23:41:13.086ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9e8e53b4-c4a7-46bf-82a0-350ccc845683
252024-06-28T23:41:13.137ZINFOcrucible-agent (worker): creating config property group
262024-06-28T23:41:13.158ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9e8e53b4-c4a7-46bf-82a0-350ccc845683
272024-06-28T23:41:13.158ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9e8e53b4-c4a7-46bf-82a0-350ccc845683
282024-06-28T23:41:13.158ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-06-28T23:41:13.158ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
302024-06-28T23:41:13.159ZINFOcrucible-agent (worker): commit
312024-06-28T23:41:13.169ZINFOcrucible-agent (worker): ok!
322024-06-28T23:41:13.190ZINFOcrucible-agent (worker): SMF ok!
332024-06-28T23:41:13.280ZINFOcrucible-agent (dropshot): request completed latency_us = 578 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:39385 req_id = cd317992-b11e-424c-8769-78d68aaa68f7 response_code = 200 uri = /crucible/0/regions
342024-06-28T23:41:14.145ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:39385 req_id = b337d47c-ac64-4551-a4be-e4caec6c96ae response_code = 200 uri = /crucible/0/regions/9e8e53b4-c4a7-46bf-82a0-350ccc845683
352024-06-28T23:41:14.147ZINFOcrucible-agent (datafile): path is "/data/regions/9e8e53b4-c4a7-46bf-82a0-350ccc845683"
362024-06-28T23:41:14.156ZINFOcrucible-agent (datafile): dataset is oxp_12882c07-c253-4405-9cb3-95dd30ae3d50/crucible/regions/9e8e53b4-c4a7-46bf-82a0-350ccc845683
372024-06-28T23:41:14.165ZINFOcrucible-agent (datafile): region 9e8e53b4-c4a7-46bf-82a0-350ccc845683 state: Created -> Tombstoned
382024-06-28T23:41:14.165ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-06-28T23:41:14.165ZINFOcrucible-agent (dropshot): request completed latency_us = 18545 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:39385 req_id = aa13326c-3cfc-4f9e-abf6-22b3d15d9d62 response_code = 204 uri = /crucible/0/regions/9e8e53b4-c4a7-46bf-82a0-350ccc845683
402024-06-28T23:41:14.167ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-9e8e53b4-c4a7-46bf-82a0-350ccc845683 (instance states: (Some(Online), None))
412024-06-28T23:41:14.168ZINFOcrucible-agent (dropshot): request completed latency_us = 22 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:39385 req_id = c7bd2d08-8104-47c8-87a1-879acd7ffb45 response_code = 200 uri = /crucible/0/regions/9e8e53b4-c4a7-46bf-82a0-350ccc845683
422024-06-28T23:41:14.180ZINFOcrucible-agent (worker): SMF ok!
432024-06-28T23:41:14.190ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_12882c07-c253-4405-9cb3-95dd30ae3d50/crucible/regions/9e8e53b4-c4a7-46bf-82a0-350ccc845683" region = 9e8e53b4-c4a7-46bf-82a0-350ccc845683
442024-06-28T23:41:14.300ZINFOcrucible-agent (dropshot): request completed latency_us = 488 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:39385 req_id = fb112d5f-ef20-41ea-8df1-e8cb5dbe7c19 response_code = 200 uri = /crucible/0/regions/9e8e53b4-c4a7-46bf-82a0-350ccc845683
452024-06-28T23:41:14.303ZINFOcrucible-agent (datafile): region 9e8e53b4-c4a7-46bf-82a0-350ccc845683 state: Tombstoned -> Destroyed
462024-06-28T23:41:14.403ZINFOcrucible-agent (dropshot): request completed latency_us = 41 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:39385 req_id = 2765724b-c05b-4446-94df-88f3aadafb88 response_code = 200 uri = /crucible/0/regions/9e8e53b4-c4a7-46bf-82a0-350ccc845683