Max level shown:
12024-12-19T01:09:25.735ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:64283
22024-12-19T01:09:25.786ZINFOcrucible-agent (datafile): region 990642f3-98b4-478c-9e6b-6c4779c68954 state: Requested
32024-12-19T01:09:25.791ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-12-19T01:09:25.796ZINFOcrucible-agent (dropshot): request completed latency_us = 17957 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64283 req_id = b38c2abe-7827-4489-a123-d523acf6fecf response_code = 200 uri = /crucible/0/regions
52024-12-19T01:09:25.805ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_499e53d3-d67c-44b6-9c03-b66767baed7e/crucible/regions/990642f3-98b4-478c-9e6b-6c4779c68954
62024-12-19T01:09:25.805ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_499e53d3-d67c-44b6-9c03-b66767baed7e/crucible/regions/990642f3-98b4-478c-9e6b-6c4779c68954
72024-12-19T01:09:25.864ZINFOcrucible-agent (worker): creating region Region { id: RegionId("990642f3-98b4-478c-9e6b-6c4779c68954"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/990642f3-98b4-478c-9e6b-6c4779c68954" region = 990642f3-98b4-478c-9e6b-6c4779c68954
82024-12-19T01:09:25.866ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "990642f3-98b4-478c-9e6b-6c4779c68954" "--data" "/data/regions/990642f3-98b4-478c-9e6b-6c4779c68954" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 990642f3-98b4-478c-9e6b-6c4779c68954
92024-12-19T01:09:26.155ZINFOcrucible-agent (worker): region files created ok region = 990642f3-98b4-478c-9e6b-6c4779c68954
102024-12-19T01:09:26.155ZINFOcrucible-agent (datafile): region 990642f3-98b4-478c-9e6b-6c4779c68954 state: Requested -> Created
112024-12-19T01:09:26.155ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-12-19T01:09:26.156ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-990642f3-98b4-478c-9e6b-6c4779c68954
132024-12-19T01:09:26.162ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-990642f3-98b4-478c-9e6b-6c4779c68954
142024-12-19T01:09:26.172ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64283 req_id = acc5323c-f051-4432-9958-7c9c72fd124a response_code = 200 uri = /crucible/0/regions
152024-12-19T01:09:26.177ZINFOcrucible-agent (worker): creating config property group
162024-12-19T01:09:26.180ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-990642f3-98b4-478c-9e6b-6c4779c68954
172024-12-19T01:09:26.181ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/990642f3-98b4-478c-9e6b-6c4779c68954
182024-12-19T01:09:26.181ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-12-19T01:09:26.181ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
202024-12-19T01:09:26.181ZINFOcrucible-agent (worker): commit
212024-12-19T01:09:26.185ZINFOcrucible-agent (worker): ok!
222024-12-19T01:09:26.189ZINFOcrucible-agent (worker): SMF ok!
232024-12-19T01:09:31.546ZINFOcrucible-agent (datafile): region e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4 state: Requested
242024-12-19T01:09:31.546ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
252024-12-19T01:09:31.546ZINFOcrucible-agent (dropshot): request completed latency_us = 220 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64283 req_id = f6aadd39-898e-4fce-8ddc-a4e6cb4f51c7 response_code = 200 uri = /crucible/0/regions
262024-12-19T01:09:31.556ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_499e53d3-d67c-44b6-9c03-b66767baed7e/crucible/regions/e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4
272024-12-19T01:09:31.556ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_499e53d3-d67c-44b6-9c03-b66767baed7e/crucible/regions/e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4
282024-12-19T01:09:31.612ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4" region = e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4
292024-12-19T01:09:31.612ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4" "--data" "/data/regions/e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4
302024-12-19T01:09:31.679ZINFOcrucible-agent (worker): region files created ok region = e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4
312024-12-19T01:09:31.679ZINFOcrucible-agent (datafile): region e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4 state: Requested -> Created
322024-12-19T01:09:31.679ZINFOcrucible-agent (worker): applying SMF actions post create...
332024-12-19T01:09:31.684ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4
342024-12-19T01:09:31.687ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4
352024-12-19T01:09:31.693ZINFOcrucible-agent (worker): creating config property group
362024-12-19T01:09:31.697ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4
372024-12-19T01:09:31.697ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4
382024-12-19T01:09:31.697ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392024-12-19T01:09:31.697ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
402024-12-19T01:09:31.697ZINFOcrucible-agent (worker): commit
412024-12-19T01:09:31.701ZINFOcrucible-agent (worker): ok!
422024-12-19T01:09:31.705ZINFOcrucible-agent (worker): SMF ok!
432024-12-19T01:09:31.857ZINFOcrucible-agent (dropshot): request completed latency_us = 965 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64283 req_id = 5d9edc24-1221-43bd-b58a-1cb9d9059ad0 response_code = 200 uri = /crucible/0/regions
442024-12-19T01:09:57.193ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64283 req_id = 4ce65ada-60b2-43be-8ce3-f0e3d6921307 response_code = 200 uri = /crucible/0/regions/e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4
452024-12-19T01:09:57.196ZINFOcrucible-agent (datafile): path is "/data/regions/e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4"
462024-12-19T01:09:57.207ZINFOcrucible-agent (datafile): dataset is oxp_499e53d3-d67c-44b6-9c03-b66767baed7e/crucible/regions/e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4
472024-12-19T01:09:57.218ZINFOcrucible-agent (datafile): region e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4 state: Created -> Tombstoned
482024-12-19T01:09:57.218ZINFOcrucible-agent (worker): applying SMF actions before removal...
492024-12-19T01:09:57.218ZINFOcrucible-agent (dropshot): request completed latency_us = 22304 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:64283 req_id = ad6b8cca-4f33-4ca0-9179-db9fb92841c0 response_code = 204 uri = /crucible/0/regions/e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4
502024-12-19T01:09:57.219ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4 (instance states: (Some(Online), None))
512024-12-19T01:09:57.222ZINFOcrucible-agent (dropshot): request completed latency_us = 24 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64283 req_id = b9c6aada-847c-4fb6-ae6d-e30fd230e4cf response_code = 200 uri = /crucible/0/regions/e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4
522024-12-19T01:09:57.224ZINFOcrucible-agent (worker): SMF ok!
532024-12-19T01:09:57.234ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_499e53d3-d67c-44b6-9c03-b66767baed7e/crucible/regions/e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4" region = e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4
542024-12-19T01:09:57.278ZINFOcrucible-agent (dropshot): request completed latency_us = 97 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64283 req_id = 92252ea5-80c0-4505-810c-17d041c27506 response_code = 200 uri = /crucible/0/regions/e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4
552024-12-19T01:09:57.284ZINFOcrucible-agent (datafile): region e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4 state: Tombstoned -> Destroyed
562024-12-19T01:09:57.355ZINFOcrucible-agent (dropshot): request completed latency_us = 34 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64283 req_id = e69ffc43-d68c-4468-acc7-ecba6233bbf8 response_code = 200 uri = /crucible/0/regions/e5d2cce3-3c96-4d17-b7d2-36b8e470f3a4