Max level shown:
12024-10-15T23:30:59.862ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:35090
22024-10-15T23:30:59.902ZINFOcrucible-agent (datafile): region b3e39f85-cc8b-4e10-9e6f-47eb9f40860e state: Requested
32024-10-15T23:30:59.907ZINFOcrucible-agent (dropshot): request completed latency_us = 15199 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35090 req_id = 77b932d8-7259-4815-a8c5-12d88bb175d2 response_code = 200 uri = /crucible/0/regions
42024-10-15T23:30:59.912ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52024-10-15T23:30:59.922ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
62024-10-15T23:30:59.922ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
72024-10-15T23:30:59.973ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b3e39f85-cc8b-4e10-9e6f-47eb9f40860e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e" region = b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
82024-10-15T23:30:59.978ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b3e39f85-cc8b-4e10-9e6f-47eb9f40860e" "--data" "/data/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
92024-10-15T23:31:00.091ZINFOcrucible-agent (dropshot): request completed latency_us = 821 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35090 req_id = 19cdede1-1393-413c-83dd-1eadc73f8b87 response_code = 200 uri = /crucible/0/regions
102024-10-15T23:31:00.196ZINFOcrucible-agent (worker): region files created ok region = b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
112024-10-15T23:31:00.196ZINFOcrucible-agent (datafile): region b3e39f85-cc8b-4e10-9e6f-47eb9f40860e state: Requested -> Created
122024-10-15T23:31:00.196ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-10-15T23:31:00.199ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
142024-10-15T23:31:00.203ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
152024-10-15T23:31:00.220ZINFOcrucible-agent (worker): creating config property group
162024-10-15T23:31:00.223ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
172024-10-15T23:31:00.231ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
182024-10-15T23:31:00.231ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-10-15T23:31:00.231ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
202024-10-15T23:31:00.231ZINFOcrucible-agent (worker): commit
212024-10-15T23:31:00.235ZINFOcrucible-agent (worker): ok!
222024-10-15T23:31:00.239ZINFOcrucible-agent (worker): SMF ok!
232024-10-15T23:31:00.708ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35090 req_id = f82e2fd5-01a7-4afb-ba0d-169e08336096 response_code = 200 uri = /crucible/0/regions
242024-10-15T23:34:09.236ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:60304
252024-10-15T23:34:09.236ZINFOcrucible-agent (datafile): region 83c639e1-2d7a-43ad-9b32-b98a097580c1 state: Requested
262024-10-15T23:34:09.237ZINFOcrucible-agent (dropshot): request completed latency_us = 623 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60304 req_id = 04289f70-bfa5-4f81-a35e-2878c589bbf5 response_code = 200 uri = /crucible/0/regions
272024-10-15T23:34:09.237ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
282024-10-15T23:34:09.246ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/83c639e1-2d7a-43ad-9b32-b98a097580c1
292024-10-15T23:34:09.246ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/83c639e1-2d7a-43ad-9b32-b98a097580c1
302024-10-15T23:34:09.298ZINFOcrucible-agent (worker): creating region Region { id: RegionId("83c639e1-2d7a-43ad-9b32-b98a097580c1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/83c639e1-2d7a-43ad-9b32-b98a097580c1" region = 83c639e1-2d7a-43ad-9b32-b98a097580c1
312024-10-15T23:34:09.298ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "83c639e1-2d7a-43ad-9b32-b98a097580c1" "--data" "/data/regions/83c639e1-2d7a-43ad-9b32-b98a097580c1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 83c639e1-2d7a-43ad-9b32-b98a097580c1
322024-10-15T23:34:09.374ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60304 req_id = 209bae3a-cf8b-44ed-b6b8-a07126cecb87 response_code = 200 uri = /crucible/0/regions
332024-10-15T23:34:09.375ZINFOcrucible-agent (worker): region files created ok region = 83c639e1-2d7a-43ad-9b32-b98a097580c1
342024-10-15T23:34:09.375ZINFOcrucible-agent (datafile): region 83c639e1-2d7a-43ad-9b32-b98a097580c1 state: Requested -> Created
352024-10-15T23:34:09.375ZINFOcrucible-agent (worker): applying SMF actions post create...
362024-10-15T23:34:09.375ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-83c639e1-2d7a-43ad-9b32-b98a097580c1
372024-10-15T23:34:09.380ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-83c639e1-2d7a-43ad-9b32-b98a097580c1
382024-10-15T23:34:09.394ZINFOcrucible-agent (worker): creating config property group
392024-10-15T23:34:09.398ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-83c639e1-2d7a-43ad-9b32-b98a097580c1
402024-10-15T23:34:09.398ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/83c639e1-2d7a-43ad-9b32-b98a097580c1
412024-10-15T23:34:09.398ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
422024-10-15T23:34:09.398ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
432024-10-15T23:34:09.398ZINFOcrucible-agent (worker): commit
442024-10-15T23:34:09.402ZINFOcrucible-agent (worker): ok!
452024-10-15T23:34:09.407ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
462024-10-15T23:34:09.407ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
472024-10-15T23:34:09.407ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
482024-10-15T23:34:09.407ZINFOcrucible-agent (worker): reconfig required
492024-10-15T23:34:09.407ZINFOcrucible-agent (worker): using existing config property group
502024-10-15T23:34:09.407ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
512024-10-15T23:34:09.407ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
522024-10-15T23:34:09.407ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
532024-10-15T23:34:09.407ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
542024-10-15T23:34:09.407ZINFOcrucible-agent (worker): commit
552024-10-15T23:34:09.418ZINFOcrucible-agent (worker): ok!
562024-10-15T23:34:09.418ZINFOcrucible-agent (worker): SMF ok!
572024-10-15T23:34:09.958ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60304 req_id = 2cfc7f2f-fe49-45e4-8a8a-445433da89d8 response_code = 200 uri = /crucible/0/regions
582024-10-15T23:34:10.914ZINFOcrucible-agent (dropshot): request completed latency_us = 2832 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60304 req_id = 3ff38022-d63c-4b44-8a30-a2ddacfd3317 response_code = 200 uri = /crucible/0/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
592024-10-15T23:34:10.917ZINFOcrucible-agent (datafile): path is "/data/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e"
602024-10-15T23:34:10.927ZINFOcrucible-agent (datafile): dataset is oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
612024-10-15T23:34:10.936ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e@f510126e-d4c7-4dbc-aa9d-20b76c9ee01f
622024-10-15T23:34:10.936ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e", "f510126e-d4c7-4dbc-aa9d-20b76c9ee01f"]
632024-10-15T23:34:10.949ZINFOcrucible-agent (dropshot): request completed latency_us = 31485 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60304 req_id = be23a3d5-937e-4212-8879-9f31046aeaef response_code = 200 uri = /crucible/0/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e/snapshots/f510126e-d4c7-4dbc-aa9d-20b76c9ee01f
642024-10-15T23:34:10.953ZINFOcrucible-agent (datafile): path is "/data/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e"
652024-10-15T23:34:10.961ZINFOcrucible-agent (datafile): dataset is oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
662024-10-15T23:34:10.969ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e@f510126e-d4c7-4dbc-aa9d-20b76c9ee01f
672024-10-15T23:34:10.969ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e", "f510126e-d4c7-4dbc-aa9d-20b76c9ee01f"]
682024-10-15T23:34:10.977ZINFOcrucible-agent (datafile): requesting running snapshot b3e39f85-cc8b-4e10-9e6f-47eb9f40860e-f510126e-d4c7-4dbc-aa9d-20b76c9ee01f state: Requested
692024-10-15T23:34:10.977ZINFOcrucible-agent (worker): applying SMF actions for region b3e39f85-cc8b-4e10-9e6f-47eb9f40860e running snapshot f510126e-d4c7-4dbc-aa9d-20b76c9ee01f (state Requested)...
702024-10-15T23:34:10.977ZINFOcrucible-agent (dropshot): request completed latency_us = 25243 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60304 req_id = 1ffd188e-e6ec-47e4-8ce3-88ff983a7458 response_code = 200 uri = /crucible/0/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e/snapshots/f510126e-d4c7-4dbc-aa9d-20b76c9ee01f/run
712024-10-15T23:34:10.979ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
722024-10-15T23:34:10.979ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
732024-10-15T23:34:10.979ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
742024-10-15T23:34:10.979ZINFOcrucible-agent (worker): reconfig required
752024-10-15T23:34:10.979ZINFOcrucible-agent (worker): using existing config property group
762024-10-15T23:34:10.979ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
772024-10-15T23:34:10.979ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
782024-10-15T23:34:10.980ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
792024-10-15T23:34:10.980ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
802024-10-15T23:34:10.980ZINFOcrucible-agent (worker): commit
812024-10-15T23:34:10.984ZINFOcrucible-agent (worker): ok!
822024-10-15T23:34:10.984ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-b3e39f85-cc8b-4e10-9e6f-47eb9f40860e-f510126e-d4c7-4dbc-aa9d-20b76c9ee01f
832024-10-15T23:34:10.988ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-b3e39f85-cc8b-4e10-9e6f-47eb9f40860e-f510126e-d4c7-4dbc-aa9d-20b76c9ee01f
842024-10-15T23:34:10.998ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-b3e39f85-cc8b-4e10-9e6f-47eb9f40860e-f510126e-d4c7-4dbc-aa9d-20b76c9ee01f
852024-10-15T23:34:10.998ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e/.zfs/snapshot/f510126e-d4c7-4dbc-aa9d-20b76c9ee01f
862024-10-15T23:34:10.998ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
872024-10-15T23:34:10.998ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
882024-10-15T23:34:10.998ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
892024-10-15T23:34:10.998ZINFOcrucible-agent (worker): commit
902024-10-15T23:34:11.002ZINFOcrucible-agent (worker): ok!
912024-10-15T23:34:11.007ZINFOcrucible-agent (worker): SMF ok!
922024-10-15T23:34:11.007ZINFOcrucible-agent (datafile): region b3e39f85-cc8b-4e10-9e6f-47eb9f40860e running snapshot f510126e-d4c7-4dbc-aa9d-20b76c9ee01f state: Requested -> Created
932024-10-15T23:34:11.184ZINFOcrucible-agent (datafile): path is "/data/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e"
942024-10-15T23:34:11.193ZINFOcrucible-agent (datafile): dataset is oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
952024-10-15T23:34:11.202ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e@f510126e-d4c7-4dbc-aa9d-20b76c9ee01f
962024-10-15T23:34:11.202ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e", "f510126e-d4c7-4dbc-aa9d-20b76c9ee01f"]
972024-10-15T23:34:11.211ZINFOcrucible-agent (dropshot): request completed latency_us = 27560 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60304 req_id = 2d8aee7e-dae4-43c3-9ad0-107ac28eebac response_code = 200 uri = /crucible/0/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e/snapshots/f510126e-d4c7-4dbc-aa9d-20b76c9ee01f/run
982024-10-15T23:34:14.896ZINFOcrucible-agent (datafile): region be26bc86-13fe-4a3e-90a6-436d3e0aaccd state: Requested
992024-10-15T23:34:14.896ZINFOcrucible-agent (dropshot): request completed latency_us = 248 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60304 req_id = 88ac7282-977a-4568-8642-dab2ef6e0164 response_code = 200 uri = /crucible/0/regions
1002024-10-15T23:34:14.897ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1012024-10-15T23:34:14.906ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/be26bc86-13fe-4a3e-90a6-436d3e0aaccd
1022024-10-15T23:34:14.906ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/be26bc86-13fe-4a3e-90a6-436d3e0aaccd
1032024-10-15T23:34:14.958ZINFOcrucible-agent (worker): creating region Region { id: RegionId("be26bc86-13fe-4a3e-90a6-436d3e0aaccd"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/be26bc86-13fe-4a3e-90a6-436d3e0aaccd" region = be26bc86-13fe-4a3e-90a6-436d3e0aaccd
1042024-10-15T23:34:14.960ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "be26bc86-13fe-4a3e-90a6-436d3e0aaccd" "--data" "/data/regions/be26bc86-13fe-4a3e-90a6-436d3e0aaccd" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = be26bc86-13fe-4a3e-90a6-436d3e0aaccd
1052024-10-15T23:34:15.030ZINFOcrucible-agent (worker): region files created ok region = be26bc86-13fe-4a3e-90a6-436d3e0aaccd
1062024-10-15T23:34:15.030ZINFOcrucible-agent (datafile): region be26bc86-13fe-4a3e-90a6-436d3e0aaccd state: Requested -> Created
1072024-10-15T23:34:15.030ZINFOcrucible-agent (worker): applying SMF actions post create...
1082024-10-15T23:34:15.031ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
1092024-10-15T23:34:15.031ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1102024-10-15T23:34:15.031ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
1112024-10-15T23:34:15.031ZINFOcrucible-agent (worker): reconfig required
1122024-10-15T23:34:15.031ZINFOcrucible-agent (worker): using existing config property group
1132024-10-15T23:34:15.031ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
1142024-10-15T23:34:15.032ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
1152024-10-15T23:34:15.032ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1162024-10-15T23:34:15.032ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
1172024-10-15T23:34:15.032ZINFOcrucible-agent (worker): commit
1182024-10-15T23:34:15.036ZINFOcrucible-agent (worker): ok!
1192024-10-15T23:34:15.037ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-be26bc86-13fe-4a3e-90a6-436d3e0aaccd
1202024-10-15T23:34:15.040ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-be26bc86-13fe-4a3e-90a6-436d3e0aaccd
1212024-10-15T23:34:15.047ZINFOcrucible-agent (worker): creating config property group
1222024-10-15T23:34:15.050ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-be26bc86-13fe-4a3e-90a6-436d3e0aaccd
1232024-10-15T23:34:15.051ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/be26bc86-13fe-4a3e-90a6-436d3e0aaccd
1242024-10-15T23:34:15.051ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
1252024-10-15T23:34:15.051ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
1262024-10-15T23:34:15.051ZINFOcrucible-agent (worker): commit
1272024-10-15T23:34:15.054ZINFOcrucible-agent (worker): ok!
1282024-10-15T23:34:15.060ZINFOcrucible-agent (worker): SMF ok!
1292024-10-15T23:34:15.101ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60304 req_id = d72cf7d2-1e39-413f-9bee-ddd732546e0f response_code = 200 uri = /crucible/0/regions
1302024-10-15T23:34:40.598ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60304 req_id = 3af5229f-a618-4515-b884-207345993e3b response_code = 200 uri = /crucible/0/regions/be26bc86-13fe-4a3e-90a6-436d3e0aaccd
1312024-10-15T23:34:40.601ZINFOcrucible-agent (datafile): path is "/data/regions/be26bc86-13fe-4a3e-90a6-436d3e0aaccd"
1322024-10-15T23:34:40.620ZINFOcrucible-agent (datafile): dataset is oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/be26bc86-13fe-4a3e-90a6-436d3e0aaccd
1332024-10-15T23:34:40.630ZINFOcrucible-agent (datafile): region be26bc86-13fe-4a3e-90a6-436d3e0aaccd state: Created -> Tombstoned
1342024-10-15T23:34:40.630ZINFOcrucible-agent (worker): applying SMF actions before removal...
1352024-10-15T23:34:40.631ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-be26bc86-13fe-4a3e-90a6-436d3e0aaccd (instance states: (Some(Online), None))
1362024-10-15T23:34:40.638ZINFOcrucible-agent (dropshot): request completed latency_us = 37416 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:60304 req_id = bd7899dc-ff32-4827-9760-ce9ba5333743 response_code = 204 uri = /crucible/0/regions/be26bc86-13fe-4a3e-90a6-436d3e0aaccd
1372024-10-15T23:34:40.641ZINFOcrucible-agent (dropshot): request completed latency_us = 23 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60304 req_id = a6e85abd-dfb7-4615-ae35-9afd683bb818 response_code = 200 uri = /crucible/0/regions/be26bc86-13fe-4a3e-90a6-436d3e0aaccd
1382024-10-15T23:34:40.680ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
1392024-10-15T23:34:40.680ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1402024-10-15T23:34:40.680ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
1412024-10-15T23:34:40.680ZINFOcrucible-agent (worker): reconfig required
1422024-10-15T23:34:40.680ZINFOcrucible-agent (worker): using existing config property group
1432024-10-15T23:34:40.680ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
1442024-10-15T23:34:40.681ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b3e39f85-cc8b-4e10-9e6f-47eb9f40860e
1452024-10-15T23:34:40.681ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1462024-10-15T23:34:40.681ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
1472024-10-15T23:34:40.681ZINFOcrucible-agent (worker): commit
1482024-10-15T23:34:40.736ZINFOcrucible-agent (worker): ok!
1492024-10-15T23:34:40.738ZINFOcrucible-agent (worker): SMF ok!
1502024-10-15T23:34:40.749ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_616fef6a-4ce2-48b8-800d-66d51e63d4c7/crucible/regions/be26bc86-13fe-4a3e-90a6-436d3e0aaccd" region = be26bc86-13fe-4a3e-90a6-436d3e0aaccd
1512024-10-15T23:34:40.790ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60304 req_id = 7c92285f-fdb5-471d-940b-26b6711bdc0e response_code = 200 uri = /crucible/0/regions/be26bc86-13fe-4a3e-90a6-436d3e0aaccd
1522024-10-15T23:34:40.846ZINFOcrucible-agent (datafile): region be26bc86-13fe-4a3e-90a6-436d3e0aaccd state: Tombstoned -> Destroyed
1532024-10-15T23:34:40.890ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60304 req_id = bc8561cc-f90b-43cb-a7bb-9e59f088201f response_code = 200 uri = /crucible/0/regions/be26bc86-13fe-4a3e-90a6-436d3e0aaccd