Max level shown:
1 [ Jun 25 07:10:31 Enabled. ]
2 [ Jun 25 07:10:31 Rereading configuration. ]
3 [ Jun 25 07:10:33 Rereading configuration. ]
4 [ Jun 25 07:10:36 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible -l [fd00:1122:3344:101::17]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-06-25T07:10:36.419ZINFOcrucible-agent: dataset: "oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible"
72024-06-25T07:10:36.420ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::17]:32345
82024-06-25T07:10:36.420ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-06-25T07:10:36.439ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-06-25T07:10:36.526ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::17]:32345
112024-06-25T07:11:23.051ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:35683
122024-06-25T07:11:23.061ZINFOcrucible-agent (datafile): region b5ca7bd5-ec65-49fb-ad02-8e3697efd28a state: Requested
132024-06-25T07:11:23.062ZINFOcrucible-agent (dropshot): request completed latency_us = 3117 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:35683 req_id = ad565cc6-19eb-450b-8b23-6a60c71c18d3 response_code = 200 uri = /crucible/0/regions
142024-06-25T07:11:23.064ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-06-25T07:11:23.073ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/b5ca7bd5-ec65-49fb-ad02-8e3697efd28a
162024-06-25T07:11:23.073ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/b5ca7bd5-ec65-49fb-ad02-8e3697efd28a
172024-06-25T07:11:23.123ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b5ca7bd5-ec65-49fb-ad02-8e3697efd28a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b5ca7bd5-ec65-49fb-ad02-8e3697efd28a" region = b5ca7bd5-ec65-49fb-ad02-8e3697efd28a
182024-06-25T07:11:23.123ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b5ca7bd5-ec65-49fb-ad02-8e3697efd28a" "--data" "/data/regions/b5ca7bd5-ec65-49fb-ad02-8e3697efd28a" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = b5ca7bd5-ec65-49fb-ad02-8e3697efd28a
192024-06-25T07:11:23.201ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:35683 req_id = cd63b0ca-f63b-4215-ab52-b972ffeaba1b response_code = 200 uri = /crucible/0/regions
202024-06-25T07:11:23.397ZINFOcrucible-agent (worker): region files created ok region = b5ca7bd5-ec65-49fb-ad02-8e3697efd28a
212024-06-25T07:11:23.397ZINFOcrucible-agent (datafile): region b5ca7bd5-ec65-49fb-ad02-8e3697efd28a state: Requested -> Created
222024-06-25T07:11:23.397ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-06-25T07:11:23.398ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b5ca7bd5-ec65-49fb-ad02-8e3697efd28a
242024-06-25T07:11:23.402ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b5ca7bd5-ec65-49fb-ad02-8e3697efd28a
252024-06-25T07:11:23.411ZINFOcrucible-agent (worker): creating config property group
262024-06-25T07:11:23.415ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b5ca7bd5-ec65-49fb-ad02-8e3697efd28a
272024-06-25T07:11:23.416ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b5ca7bd5-ec65-49fb-ad02-8e3697efd28a
282024-06-25T07:11:23.416ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-06-25T07:11:23.416ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
302024-06-25T07:11:23.416ZINFOcrucible-agent (worker): commit
312024-06-25T07:11:23.419ZINFOcrucible-agent (worker): ok!
322024-06-25T07:11:23.423ZINFOcrucible-agent (worker): SMF ok!
332024-06-25T07:11:23.712ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:35683 req_id = fa3c5e2a-2106-4002-b917-e32c8dca4d44 response_code = 200 uri = /crucible/0/regions
342024-06-25T07:11:24.201ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:35683 req_id = d3ebc6eb-46e6-4da2-b75f-3166a12ad621 response_code = 200 uri = /crucible/0/regions/b5ca7bd5-ec65-49fb-ad02-8e3697efd28a
352024-06-25T07:11:24.203ZINFOcrucible-agent (datafile): path is "/data/regions/b5ca7bd5-ec65-49fb-ad02-8e3697efd28a"
362024-06-25T07:11:24.212ZINFOcrucible-agent (datafile): dataset is oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/b5ca7bd5-ec65-49fb-ad02-8e3697efd28a
372024-06-25T07:11:24.221ZINFOcrucible-agent (datafile): region b5ca7bd5-ec65-49fb-ad02-8e3697efd28a state: Created -> Tombstoned
382024-06-25T07:11:24.221ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-06-25T07:11:24.221ZINFOcrucible-agent (dropshot): request completed latency_us = 18322 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:35683 req_id = dc94708c-3e9f-479e-adf5-7b44a182305f response_code = 204 uri = /crucible/0/regions/b5ca7bd5-ec65-49fb-ad02-8e3697efd28a
402024-06-25T07:11:24.222ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-b5ca7bd5-ec65-49fb-ad02-8e3697efd28a (instance states: (Some(Online), None))
412024-06-25T07:11:24.223ZINFOcrucible-agent (dropshot): request completed latency_us = 25 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:35683 req_id = fddccf1f-c1b4-4666-b11a-1359bc9ec46f response_code = 200 uri = /crucible/0/regions/b5ca7bd5-ec65-49fb-ad02-8e3697efd28a
422024-06-25T07:11:24.226ZINFOcrucible-agent (worker): SMF ok!
432024-06-25T07:11:24.235ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/b5ca7bd5-ec65-49fb-ad02-8e3697efd28a" region = b5ca7bd5-ec65-49fb-ad02-8e3697efd28a
442024-06-25T07:11:24.287ZINFOcrucible-agent (datafile): region b5ca7bd5-ec65-49fb-ad02-8e3697efd28a state: Tombstoned -> Destroyed
452024-06-25T07:11:24.328ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:35683 req_id = a92ec195-609a-4e1b-929d-c7af584b5c20 response_code = 200 uri = /crucible/0/regions/b5ca7bd5-ec65-49fb-ad02-8e3697efd28a
462024-06-25T07:11:48.082ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:62558
472024-06-25T07:11:48.082ZINFOcrucible-agent (datafile): region b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36 state: Requested
482024-06-25T07:11:48.082ZINFOcrucible-agent (dropshot): request completed latency_us = 840 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62558 req_id = 6b56e0c5-7587-4c76-9414-e22526d57e6e response_code = 200 uri = /crucible/0/regions
492024-06-25T07:11:48.083ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
502024-06-25T07:11:48.092ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36
512024-06-25T07:11:48.092ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36
522024-06-25T07:11:48.140ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36" region = b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36
532024-06-25T07:11:48.140ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36" "--data" "/data/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36
542024-06-25T07:11:48.231ZINFOcrucible-agent (worker): region files created ok region = b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36
552024-06-25T07:11:48.231ZINFOcrucible-agent (datafile): region b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36 state: Requested -> Created
562024-06-25T07:11:48.231ZINFOcrucible-agent (worker): applying SMF actions post create...
572024-06-25T07:11:48.233ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36
582024-06-25T07:11:48.237ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36
592024-06-25T07:11:48.247ZINFOcrucible-agent (worker): creating config property group
602024-06-25T07:11:48.254ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36
612024-06-25T07:11:48.254ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b4a3dc29-7432-4e7b-9e28-3e26b1ddfd36
622024-06-25T07:11:48.254ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
632024-06-25T07:11:48.254ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
642024-06-25T07:11:48.255ZINFOcrucible-agent (worker): commit
652024-06-25T07:11:48.259ZINFOcrucible-agent (worker): ok!
662024-06-25T07:11:48.264ZINFOcrucible-agent (worker): SMF ok!
672024-06-25T07:11:48.428ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62558 req_id = 7aabe7ec-fe03-446c-a643-926996d521c8 response_code = 200 uri = /crucible/0/regions