Max level shown:
1 [ Nov 9 01:22:13 Enabled. ]
2 [ Nov 9 01:22:13 Rereading configuration. ]
3 [ Nov 9 01:22:16 Rereading configuration. ]
4 [ Nov 9 01:22:29 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e/crucible -l [fd00:1122:3344:101::16]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-11-09T01:22:29.224ZINFOcrucible-agent: dataset: "oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e/crucible"
72024-11-09T01:22:29.227ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::16]:32345
82024-11-09T01:22:29.227ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-11-09T01:22:29.242ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-11-09T01:22:29.367ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::16]:32345
112024-11-09T01:23:10.421ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::b]:41704
122024-11-09T01:23:10.463ZINFOcrucible-agent (datafile): region d8f79d66-6907-480d-b5a9-a52c471bfdc1 state: Requested
132024-11-09T01:23:10.468ZINFOcrucible-agent (dropshot): request completed latency_us = 18838 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41704 req_id = f6a2bc44-c72d-45b2-be4b-9ca2164b940a response_code = 200 uri = /crucible/0/regions
142024-11-09T01:23:10.471ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-11-09T01:23:10.481ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e/crucible/regions/d8f79d66-6907-480d-b5a9-a52c471bfdc1
162024-11-09T01:23:10.481ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e/crucible/regions/d8f79d66-6907-480d-b5a9-a52c471bfdc1
172024-11-09T01:23:10.549ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d8f79d66-6907-480d-b5a9-a52c471bfdc1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d8f79d66-6907-480d-b5a9-a52c471bfdc1" region = d8f79d66-6907-480d-b5a9-a52c471bfdc1
182024-11-09T01:23:10.554ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d8f79d66-6907-480d-b5a9-a52c471bfdc1" "--data" "/data/regions/d8f79d66-6907-480d-b5a9-a52c471bfdc1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = d8f79d66-6907-480d-b5a9-a52c471bfdc1
192024-11-09T01:23:10.726ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41704 req_id = 0d94e83d-9198-4922-825d-ed6ec68c2e3a response_code = 200 uri = /crucible/0/regions
202024-11-09T01:23:10.819ZINFOcrucible-agent (worker): region files created ok region = d8f79d66-6907-480d-b5a9-a52c471bfdc1
212024-11-09T01:23:10.819ZINFOcrucible-agent (datafile): region d8f79d66-6907-480d-b5a9-a52c471bfdc1 state: Requested -> Created
222024-11-09T01:23:10.819ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-11-09T01:23:10.820ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d8f79d66-6907-480d-b5a9-a52c471bfdc1
242024-11-09T01:23:10.825ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d8f79d66-6907-480d-b5a9-a52c471bfdc1
252024-11-09T01:23:10.840ZINFOcrucible-agent (worker): creating config property group
262024-11-09T01:23:10.843ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d8f79d66-6907-480d-b5a9-a52c471bfdc1
272024-11-09T01:23:10.843ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d8f79d66-6907-480d-b5a9-a52c471bfdc1
282024-11-09T01:23:10.846ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-11-09T01:23:10.846ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
302024-11-09T01:23:10.846ZINFOcrucible-agent (worker): commit
312024-11-09T01:23:10.855ZINFOcrucible-agent (worker): ok!
322024-11-09T01:23:10.859ZINFOcrucible-agent (worker): SMF ok!
332024-11-09T01:23:11.035ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41704 req_id = e27b4aa5-a2f8-4993-a6e8-26336627a424 response_code = 200 uri = /crucible/0/regions
342024-11-09T01:23:11.494ZINFOcrucible-agent (dropshot): request completed latency_us = 94 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41704 req_id = 8dae9f12-716d-4ce2-a679-bdc02a91579d response_code = 200 uri = /crucible/0/regions/d8f79d66-6907-480d-b5a9-a52c471bfdc1
352024-11-09T01:23:11.497ZINFOcrucible-agent (datafile): path is "/data/regions/d8f79d66-6907-480d-b5a9-a52c471bfdc1"
362024-11-09T01:23:11.508ZINFOcrucible-agent (datafile): dataset is oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e/crucible/regions/d8f79d66-6907-480d-b5a9-a52c471bfdc1
372024-11-09T01:23:11.518ZINFOcrucible-agent (datafile): region d8f79d66-6907-480d-b5a9-a52c471bfdc1 state: Created -> Tombstoned
382024-11-09T01:23:11.518ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-11-09T01:23:11.518ZINFOcrucible-agent (dropshot): request completed latency_us = 21039 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:41704 req_id = 6cfbbe7d-4efa-409d-a958-b40467647c3e response_code = 204 uri = /crucible/0/regions/d8f79d66-6907-480d-b5a9-a52c471bfdc1
402024-11-09T01:23:11.519ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-d8f79d66-6907-480d-b5a9-a52c471bfdc1 (instance states: (Some(Online), None))
412024-11-09T01:23:11.522ZINFOcrucible-agent (dropshot): request completed latency_us = 36 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41704 req_id = 7c430309-c204-4fb7-8947-323893532540 response_code = 200 uri = /crucible/0/regions/d8f79d66-6907-480d-b5a9-a52c471bfdc1
422024-11-09T01:23:11.524ZINFOcrucible-agent (worker): SMF ok!
432024-11-09T01:23:11.536ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e/crucible/regions/d8f79d66-6907-480d-b5a9-a52c471bfdc1" region = d8f79d66-6907-480d-b5a9-a52c471bfdc1
442024-11-09T01:23:11.600ZINFOcrucible-agent (dropshot): request completed latency_us = 123 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41704 req_id = f08a2501-cabd-4b1c-a3a9-58e3145796dd response_code = 200 uri = /crucible/0/regions/d8f79d66-6907-480d-b5a9-a52c471bfdc1
452024-11-09T01:23:11.606ZINFOcrucible-agent (datafile): region d8f79d66-6907-480d-b5a9-a52c471bfdc1 state: Tombstoned -> Destroyed
462024-11-09T01:23:11.681ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41704 req_id = b45738d4-cc00-468a-bd5f-2a9b5d016cc4 response_code = 200 uri = /crucible/0/regions/d8f79d66-6907-480d-b5a9-a52c471bfdc1