Max level shown:
12024-11-14T09:09:56.237ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:52070
22024-11-14T09:09:56.237ZINFOcrucible-agent (datafile): region cd92326c-ea58-415a-8897-ae12b99f8059 state: Requested
32024-11-14T09:09:56.238ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-11-14T09:09:56.238ZINFOcrucible-agent (dropshot): request completed latency_us = 958 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52070 req_id = b14445d3-d20b-42d5-95cd-a973dc7de603 response_code = 200 uri = /crucible/0/regions
52024-11-14T09:09:56.247ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_493c27e1-df39-477b-8315-ad9aa5767668/crucible/regions/cd92326c-ea58-415a-8897-ae12b99f8059
62024-11-14T09:09:56.247ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_493c27e1-df39-477b-8315-ad9aa5767668/crucible/regions/cd92326c-ea58-415a-8897-ae12b99f8059
72024-11-14T09:09:56.294ZINFOcrucible-agent (worker): creating region Region { id: RegionId("cd92326c-ea58-415a-8897-ae12b99f8059"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/cd92326c-ea58-415a-8897-ae12b99f8059" region = cd92326c-ea58-415a-8897-ae12b99f8059
82024-11-14T09:09:56.296ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "cd92326c-ea58-415a-8897-ae12b99f8059" "--data" "/data/regions/cd92326c-ea58-415a-8897-ae12b99f8059" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = cd92326c-ea58-415a-8897-ae12b99f8059
92024-11-14T09:09:56.369ZINFOcrucible-agent (worker): region files created ok region = cd92326c-ea58-415a-8897-ae12b99f8059
102024-11-14T09:09:56.369ZINFOcrucible-agent (datafile): region cd92326c-ea58-415a-8897-ae12b99f8059 state: Requested -> Created
112024-11-14T09:09:56.369ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-11-14T09:09:56.371ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-cd92326c-ea58-415a-8897-ae12b99f8059
132024-11-14T09:09:56.381ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-cd92326c-ea58-415a-8897-ae12b99f8059
142024-11-14T09:09:56.402ZINFOcrucible-agent (worker): creating config property group
152024-11-14T09:09:56.405ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-cd92326c-ea58-415a-8897-ae12b99f8059
162024-11-14T09:09:56.405ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cd92326c-ea58-415a-8897-ae12b99f8059
172024-11-14T09:09:56.405ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182024-11-14T09:09:56.405ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
192024-11-14T09:09:56.405ZINFOcrucible-agent (worker): commit
202024-11-14T09:09:56.409ZINFOcrucible-agent (worker): ok!
212024-11-14T09:09:56.414ZINFOcrucible-agent (worker): SMF ok!
222024-11-14T09:09:56.450ZINFOcrucible-agent (dropshot): request completed latency_us = 96 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52070 req_id = 749aa561-b57f-4ab3-97c6-d1f75c0bd5ce response_code = 200 uri = /crucible/0/regions
232024-11-14T09:10:01.699ZINFOcrucible-agent (datafile): region e2bdd1fb-12f4-418c-8c80-640210280c88 state: Requested
242024-11-14T09:10:01.699ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
252024-11-14T09:10:01.699ZINFOcrucible-agent (dropshot): request completed latency_us = 267 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52070 req_id = d099cbda-79aa-4c6e-80c0-95feef7ebdd2 response_code = 200 uri = /crucible/0/regions
262024-11-14T09:10:01.709ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_493c27e1-df39-477b-8315-ad9aa5767668/crucible/regions/e2bdd1fb-12f4-418c-8c80-640210280c88
272024-11-14T09:10:01.709ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_493c27e1-df39-477b-8315-ad9aa5767668/crucible/regions/e2bdd1fb-12f4-418c-8c80-640210280c88
282024-11-14T09:10:01.774ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e2bdd1fb-12f4-418c-8c80-640210280c88"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e2bdd1fb-12f4-418c-8c80-640210280c88" region = e2bdd1fb-12f4-418c-8c80-640210280c88
292024-11-14T09:10:01.774ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e2bdd1fb-12f4-418c-8c80-640210280c88" "--data" "/data/regions/e2bdd1fb-12f4-418c-8c80-640210280c88" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e2bdd1fb-12f4-418c-8c80-640210280c88
302024-11-14T09:10:01.847ZINFOcrucible-agent (worker): region files created ok region = e2bdd1fb-12f4-418c-8c80-640210280c88
312024-11-14T09:10:01.847ZINFOcrucible-agent (datafile): region e2bdd1fb-12f4-418c-8c80-640210280c88 state: Requested -> Created
322024-11-14T09:10:01.848ZINFOcrucible-agent (worker): applying SMF actions post create...
332024-11-14T09:10:01.850ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e2bdd1fb-12f4-418c-8c80-640210280c88
342024-11-14T09:10:01.863ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e2bdd1fb-12f4-418c-8c80-640210280c88
352024-11-14T09:10:01.871ZINFOcrucible-agent (worker): creating config property group
362024-11-14T09:10:01.875ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e2bdd1fb-12f4-418c-8c80-640210280c88
372024-11-14T09:10:01.875ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e2bdd1fb-12f4-418c-8c80-640210280c88
382024-11-14T09:10:01.875ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392024-11-14T09:10:01.875ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
402024-11-14T09:10:01.875ZINFOcrucible-agent (worker): commit
412024-11-14T09:10:01.882ZINFOcrucible-agent (worker): ok!
422024-11-14T09:10:01.887ZINFOcrucible-agent (worker): SMF ok!
432024-11-14T09:10:01.984ZINFOcrucible-agent (dropshot): request completed latency_us = 87 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52070 req_id = 4a1ca26a-393d-4aea-b915-fbc5749d3f07 response_code = 200 uri = /crucible/0/regions
442024-11-14T09:10:27.713ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52070 req_id = 7bb8e8e5-eeeb-4f25-a792-ae2021590995 response_code = 200 uri = /crucible/0/regions/e2bdd1fb-12f4-418c-8c80-640210280c88
452024-11-14T09:10:27.717ZINFOcrucible-agent (datafile): path is "/data/regions/e2bdd1fb-12f4-418c-8c80-640210280c88"
462024-11-14T09:10:27.729ZINFOcrucible-agent (datafile): dataset is oxp_493c27e1-df39-477b-8315-ad9aa5767668/crucible/regions/e2bdd1fb-12f4-418c-8c80-640210280c88
472024-11-14T09:10:27.739ZINFOcrucible-agent (datafile): region e2bdd1fb-12f4-418c-8c80-640210280c88 state: Created -> Tombstoned
482024-11-14T09:10:27.740ZINFOcrucible-agent (worker): applying SMF actions before removal...
492024-11-14T09:10:27.740ZINFOcrucible-agent (dropshot): request completed latency_us = 22960 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:52070 req_id = 9f6a52d1-bc9e-40e0-befd-66cec32fd940 response_code = 204 uri = /crucible/0/regions/e2bdd1fb-12f4-418c-8c80-640210280c88
502024-11-14T09:10:27.741ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e2bdd1fb-12f4-418c-8c80-640210280c88 (instance states: (Some(Online), None))
512024-11-14T09:10:27.743ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52070 req_id = 002e1ae6-8505-467c-834d-b3b53c820b47 response_code = 200 uri = /crucible/0/regions/e2bdd1fb-12f4-418c-8c80-640210280c88
522024-11-14T09:10:27.748ZINFOcrucible-agent (worker): SMF ok!
532024-11-14T09:10:27.757ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_493c27e1-df39-477b-8315-ad9aa5767668/crucible/regions/e2bdd1fb-12f4-418c-8c80-640210280c88" region = e2bdd1fb-12f4-418c-8c80-640210280c88
542024-11-14T09:10:27.811ZINFOcrucible-agent (datafile): region e2bdd1fb-12f4-418c-8c80-640210280c88 state: Tombstoned -> Destroyed
552024-11-14T09:10:27.864ZINFOcrucible-agent (dropshot): request completed latency_us = 669 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52070 req_id = 38b6f682-623d-4ccc-bd76-41965065ced0 response_code = 200 uri = /crucible/0/regions/e2bdd1fb-12f4-418c-8c80-640210280c88