Max level shown:
1 [ Apr 29 22:38:25 Enabled. ]
2 [ Apr 29 22:38:25 Rereading configuration. ]
3 [ Apr 29 22:38:27 Rereading configuration. ]
4 [ Apr 29 22:38:31 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_661f9fd6-5e25-45d3-955c-06a9af9dad35/crucible -l [fd00:1122:3344:101::16]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-04-29T22:38:31.846ZINFOcrucible-agent: dataset: "oxp_661f9fd6-5e25-45d3-955c-06a9af9dad35/crucible"
72024-04-29T22:38:31.851ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::16]:32345
82024-04-29T22:38:31.851ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-04-29T22:38:31.867ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-04-29T22:38:32.047ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::16]:32345
112024-04-29T22:38:51.936ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::c]:41046
122024-04-29T22:38:51.970ZINFOcrucible-agent (datafile): region c268346c-8cda-410b-8f1e-5c425d1fd5cf state: Requested
132024-04-29T22:38:51.973ZINFOcrucible-agent (dropshot): request completed latency_us = 5358 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41046 req_id = fefc9044-b63b-444d-8960-9f3421186fe8 response_code = 200 uri = /crucible/0/regions
142024-04-29T22:38:51.973ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-04-29T22:38:51.982ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_661f9fd6-5e25-45d3-955c-06a9af9dad35/crucible/regions/c268346c-8cda-410b-8f1e-5c425d1fd5cf
162024-04-29T22:38:51.982ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_661f9fd6-5e25-45d3-955c-06a9af9dad35/crucible/regions/c268346c-8cda-410b-8f1e-5c425d1fd5cf
172024-04-29T22:38:52.068ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c268346c-8cda-410b-8f1e-5c425d1fd5cf"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c268346c-8cda-410b-8f1e-5c425d1fd5cf" region = c268346c-8cda-410b-8f1e-5c425d1fd5cf
182024-04-29T22:38:52.070ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c268346c-8cda-410b-8f1e-5c425d1fd5cf" "--data" "/data/regions/c268346c-8cda-410b-8f1e-5c425d1fd5cf" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = c268346c-8cda-410b-8f1e-5c425d1fd5cf
192024-04-29T22:38:52.153ZINFOcrucible-agent (dropshot): request completed latency_us = 647 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41046 req_id = 2b0e4d12-e3ee-43de-ba5f-96086a51141a response_code = 200 uri = /crucible/0/regions
202024-04-29T22:38:52.328ZINFOcrucible-agent (worker): region files created ok region = c268346c-8cda-410b-8f1e-5c425d1fd5cf
212024-04-29T22:38:52.328ZINFOcrucible-agent (datafile): region c268346c-8cda-410b-8f1e-5c425d1fd5cf state: Requested -> Created
222024-04-29T22:38:52.328ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-04-29T22:38:52.328ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c268346c-8cda-410b-8f1e-5c425d1fd5cf
242024-04-29T22:38:52.331ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c268346c-8cda-410b-8f1e-5c425d1fd5cf
252024-04-29T22:38:52.338ZINFOcrucible-agent (worker): creating config property group
262024-04-29T22:38:52.341ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c268346c-8cda-410b-8f1e-5c425d1fd5cf
272024-04-29T22:38:52.342ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c268346c-8cda-410b-8f1e-5c425d1fd5cf
282024-04-29T22:38:52.342ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-04-29T22:38:52.342ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
302024-04-29T22:38:52.342ZINFOcrucible-agent (worker): commit
312024-04-29T22:38:52.346ZINFOcrucible-agent (worker): ok!
322024-04-29T22:38:52.351ZINFOcrucible-agent (worker): SMF ok!
332024-04-29T22:38:52.503ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41046 req_id = 0cd1406e-9698-4499-8c94-e3481cfbd7d0 response_code = 200 uri = /crucible/0/regions
342024-04-29T22:38:52.899ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::c]:43781
352024-04-29T22:38:52.899ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:43781 req_id = c523689b-75f7-4916-a018-985ecce977c5 response_code = 200 uri = /crucible/0/regions/c268346c-8cda-410b-8f1e-5c425d1fd5cf
362024-04-29T22:38:52.900ZINFOcrucible-agent (datafile): path is "/data/regions/c268346c-8cda-410b-8f1e-5c425d1fd5cf"
372024-04-29T22:38:52.909ZINFOcrucible-agent (datafile): dataset is oxp_661f9fd6-5e25-45d3-955c-06a9af9dad35/crucible/regions/c268346c-8cda-410b-8f1e-5c425d1fd5cf
382024-04-29T22:38:52.917ZINFOcrucible-agent (datafile): region c268346c-8cda-410b-8f1e-5c425d1fd5cf state: Created -> Tombstoned
392024-04-29T22:38:52.917ZINFOcrucible-agent (worker): applying SMF actions before removal...
402024-04-29T22:38:52.917ZINFOcrucible-agent (dropshot): request completed latency_us = 17825 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:43781 req_id = 310f8e00-eba9-4497-9b1c-02d8e5df2582 response_code = 204 uri = /crucible/0/regions/c268346c-8cda-410b-8f1e-5c425d1fd5cf
412024-04-29T22:38:52.918ZINFOcrucible-agent (dropshot): request completed latency_us = 21 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:43781 req_id = a9ef17e7-713d-4d06-a927-2cb09d53b5da response_code = 200 uri = /crucible/0/regions/c268346c-8cda-410b-8f1e-5c425d1fd5cf
422024-04-29T22:38:52.919ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-c268346c-8cda-410b-8f1e-5c425d1fd5cf (instance states: (Some(Online), None))
432024-04-29T22:38:52.923ZINFOcrucible-agent (worker): SMF ok!
442024-04-29T22:38:52.932ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_661f9fd6-5e25-45d3-955c-06a9af9dad35/crucible/regions/c268346c-8cda-410b-8f1e-5c425d1fd5cf" region = c268346c-8cda-410b-8f1e-5c425d1fd5cf
452024-04-29T22:38:52.988ZINFOcrucible-agent (dropshot): request completed latency_us = 549 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:43781 req_id = 5c4afedb-1d37-4254-a766-241f51f0c919 response_code = 200 uri = /crucible/0/regions/c268346c-8cda-410b-8f1e-5c425d1fd5cf
462024-04-29T22:38:52.991ZINFOcrucible-agent (datafile): region c268346c-8cda-410b-8f1e-5c425d1fd5cf state: Tombstoned -> Destroyed
472024-04-29T22:38:53.097ZINFOcrucible-agent (dropshot): request completed latency_us = 40 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:43781 req_id = b1cbb931-b8d8-48a5-8f0b-3aae4714110a response_code = 200 uri = /crucible/0/regions/c268346c-8cda-410b-8f1e-5c425d1fd5cf