Max level shown:
12024-08-22T03:18:58.975ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:34703
22024-08-22T03:18:59.002ZINFOcrucible-agent (datafile): region 0a3e4c4e-2be6-46bf-b754-62c0a68b7140 state: Requested
32024-08-22T03:18:59.009ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-08-22T03:18:59.013ZINFOcrucible-agent (dropshot): request completed latency_us = 18854 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34703 req_id = 59f9c359-9914-4ec3-9f54-8579baaf51fc response_code = 200 uri = /crucible/0/regions
52024-08-22T03:18:59.023ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ccbe7092-f68b-4074-accb-3d04aed5167d/crucible/regions/0a3e4c4e-2be6-46bf-b754-62c0a68b7140
62024-08-22T03:18:59.023ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ccbe7092-f68b-4074-accb-3d04aed5167d/crucible/regions/0a3e4c4e-2be6-46bf-b754-62c0a68b7140
72024-08-22T03:18:59.097ZINFOcrucible-agent (worker): creating region Region { id: RegionId("0a3e4c4e-2be6-46bf-b754-62c0a68b7140"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/0a3e4c4e-2be6-46bf-b754-62c0a68b7140" region = 0a3e4c4e-2be6-46bf-b754-62c0a68b7140
82024-08-22T03:18:59.100ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "0a3e4c4e-2be6-46bf-b754-62c0a68b7140" "--data" "/data/regions/0a3e4c4e-2be6-46bf-b754-62c0a68b7140" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 0a3e4c4e-2be6-46bf-b754-62c0a68b7140
92024-08-22T03:18:59.207ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34703 req_id = d9e959e6-d20d-4316-8826-22373fd1df85 response_code = 200 uri = /crucible/0/regions
102024-08-22T03:18:59.469ZINFOcrucible-agent (worker): region files created ok region = 0a3e4c4e-2be6-46bf-b754-62c0a68b7140
112024-08-22T03:18:59.469ZINFOcrucible-agent (datafile): region 0a3e4c4e-2be6-46bf-b754-62c0a68b7140 state: Requested -> Created
122024-08-22T03:18:59.469ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-08-22T03:18:59.470ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-0a3e4c4e-2be6-46bf-b754-62c0a68b7140
142024-08-22T03:18:59.479ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34703 req_id = 7577d441-711b-490a-953d-0d94a99326de response_code = 200 uri = /crucible/0/regions
152024-08-22T03:18:59.484ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-0a3e4c4e-2be6-46bf-b754-62c0a68b7140
162024-08-22T03:18:59.524ZINFOcrucible-agent (worker): creating config property group
172024-08-22T03:18:59.530ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-0a3e4c4e-2be6-46bf-b754-62c0a68b7140
182024-08-22T03:18:59.541ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0a3e4c4e-2be6-46bf-b754-62c0a68b7140
192024-08-22T03:18:59.544ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
202024-08-22T03:18:59.544ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
212024-08-22T03:18:59.544ZINFOcrucible-agent (worker): commit
222024-08-22T03:18:59.553ZINFOcrucible-agent (worker): ok!
232024-08-22T03:18:59.562ZINFOcrucible-agent (worker): SMF ok!
242024-08-22T03:19:04.340ZINFOcrucible-agent (datafile): region e6b0ac08-9ee2-4d1b-9722-1c5260d0c216 state: Requested
252024-08-22T03:19:04.340ZINFOcrucible-agent (dropshot): request completed latency_us = 260 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34703 req_id = a2650cd0-d7b9-40f5-8b92-d0d9ee1c62dc response_code = 200 uri = /crucible/0/regions
262024-08-22T03:19:04.340ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272024-08-22T03:19:04.351ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ccbe7092-f68b-4074-accb-3d04aed5167d/crucible/regions/e6b0ac08-9ee2-4d1b-9722-1c5260d0c216
282024-08-22T03:19:04.351ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ccbe7092-f68b-4074-accb-3d04aed5167d/crucible/regions/e6b0ac08-9ee2-4d1b-9722-1c5260d0c216
292024-08-22T03:19:04.464ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e6b0ac08-9ee2-4d1b-9722-1c5260d0c216"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e6b0ac08-9ee2-4d1b-9722-1c5260d0c216" region = e6b0ac08-9ee2-4d1b-9722-1c5260d0c216
302024-08-22T03:19:04.466ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e6b0ac08-9ee2-4d1b-9722-1c5260d0c216" "--data" "/data/regions/e6b0ac08-9ee2-4d1b-9722-1c5260d0c216" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e6b0ac08-9ee2-4d1b-9722-1c5260d0c216
312024-08-22T03:19:04.489ZINFOcrucible-agent (dropshot): request completed latency_us = 641 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34703 req_id = 75588c4c-0dfb-47ba-a4b8-29e46de6ebf7 response_code = 200 uri = /crucible/0/regions
322024-08-22T03:19:04.602ZINFOcrucible-agent (worker): region files created ok region = e6b0ac08-9ee2-4d1b-9722-1c5260d0c216
332024-08-22T03:19:04.602ZINFOcrucible-agent (datafile): region e6b0ac08-9ee2-4d1b-9722-1c5260d0c216 state: Requested -> Created
342024-08-22T03:19:04.602ZINFOcrucible-agent (worker): applying SMF actions post create...
352024-08-22T03:19:04.603ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/0a3e4c4e-2be6-46bf-b754-62c0a68b7140
362024-08-22T03:19:04.603ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
372024-08-22T03:19:04.604ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::19
382024-08-22T03:19:04.604ZINFOcrucible-agent (worker): reconfig required
392024-08-22T03:19:04.604ZINFOcrucible-agent (worker): using existing config property group
402024-08-22T03:19:04.604ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-0a3e4c4e-2be6-46bf-b754-62c0a68b7140
412024-08-22T03:19:04.604ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0a3e4c4e-2be6-46bf-b754-62c0a68b7140
422024-08-22T03:19:04.604ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
432024-08-22T03:19:04.604ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
442024-08-22T03:19:04.604ZINFOcrucible-agent (worker): commit
452024-08-22T03:19:04.613ZINFOcrucible-agent (worker): ok!
462024-08-22T03:19:04.614ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e6b0ac08-9ee2-4d1b-9722-1c5260d0c216
472024-08-22T03:19:04.621ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e6b0ac08-9ee2-4d1b-9722-1c5260d0c216
482024-08-22T03:19:04.658ZINFOcrucible-agent (worker): creating config property group
492024-08-22T03:19:04.668ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e6b0ac08-9ee2-4d1b-9722-1c5260d0c216
502024-08-22T03:19:04.668ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e6b0ac08-9ee2-4d1b-9722-1c5260d0c216
512024-08-22T03:19:04.668ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
522024-08-22T03:19:04.668ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
532024-08-22T03:19:04.668ZINFOcrucible-agent (worker): commit
542024-08-22T03:19:04.675ZINFOcrucible-agent (worker): ok!
552024-08-22T03:19:04.686ZINFOcrucible-agent (worker): SMF ok!
562024-08-22T03:19:05.079ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34703 req_id = 135b3c85-d545-4400-a63d-6ee26c4d55b4 response_code = 200 uri = /crucible/0/regions
572024-08-22T03:19:30.118ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34703 req_id = fda35069-0f4c-4d41-87f3-18c681b0a82a response_code = 200 uri = /crucible/0/regions/e6b0ac08-9ee2-4d1b-9722-1c5260d0c216
582024-08-22T03:19:30.121ZINFOcrucible-agent (datafile): path is "/data/regions/e6b0ac08-9ee2-4d1b-9722-1c5260d0c216"
592024-08-22T03:19:30.131ZINFOcrucible-agent (datafile): dataset is oxp_ccbe7092-f68b-4074-accb-3d04aed5167d/crucible/regions/e6b0ac08-9ee2-4d1b-9722-1c5260d0c216
602024-08-22T03:19:30.139ZINFOcrucible-agent (datafile): region e6b0ac08-9ee2-4d1b-9722-1c5260d0c216 state: Created -> Tombstoned
612024-08-22T03:19:30.139ZINFOcrucible-agent (worker): applying SMF actions before removal...
622024-08-22T03:19:30.139ZINFOcrucible-agent (dropshot): request completed latency_us = 18183 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:34703 req_id = 40e46fe3-c71b-4e75-ac51-282cb6880aad response_code = 204 uri = /crucible/0/regions/e6b0ac08-9ee2-4d1b-9722-1c5260d0c216
632024-08-22T03:19:30.140ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e6b0ac08-9ee2-4d1b-9722-1c5260d0c216 (instance states: (Some(Online), None))
642024-08-22T03:19:30.142ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34703 req_id = 2cd2d29e-6fba-442f-9d8a-19d251191636 response_code = 200 uri = /crucible/0/regions/e6b0ac08-9ee2-4d1b-9722-1c5260d0c216
652024-08-22T03:19:30.144ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/0a3e4c4e-2be6-46bf-b754-62c0a68b7140
662024-08-22T03:19:30.144ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
672024-08-22T03:19:30.144ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::19
682024-08-22T03:19:30.144ZINFOcrucible-agent (worker): reconfig required
692024-08-22T03:19:30.144ZINFOcrucible-agent (worker): using existing config property group
702024-08-22T03:19:30.145ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-0a3e4c4e-2be6-46bf-b754-62c0a68b7140
712024-08-22T03:19:30.145ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0a3e4c4e-2be6-46bf-b754-62c0a68b7140
722024-08-22T03:19:30.145ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
732024-08-22T03:19:30.145ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
742024-08-22T03:19:30.145ZINFOcrucible-agent (worker): commit
752024-08-22T03:19:30.149ZINFOcrucible-agent (worker): ok!
762024-08-22T03:19:30.149ZINFOcrucible-agent (worker): SMF ok!
772024-08-22T03:19:30.160ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_ccbe7092-f68b-4074-accb-3d04aed5167d/crucible/regions/e6b0ac08-9ee2-4d1b-9722-1c5260d0c216" region = e6b0ac08-9ee2-4d1b-9722-1c5260d0c216
782024-08-22T03:19:30.205ZINFOcrucible-agent (datafile): region e6b0ac08-9ee2-4d1b-9722-1c5260d0c216 state: Tombstoned -> Destroyed
792024-08-22T03:19:30.226ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34703 req_id = 51175d47-bc73-4333-b207-cf1d06a8a828 response_code = 200 uri = /crucible/0/regions/e6b0ac08-9ee2-4d1b-9722-1c5260d0c216