Max level shown:
1 [ Jun 26 05:37:40 Enabled. ]
2 [ Jun 26 05:37:40 Rereading configuration. ]
3 [ Jun 26 05:37:45 Rereading configuration. ]
4 [ Jun 26 05:37:52 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible -l [fd00:1122:3344:101::16]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-06-26T05:37:52.316ZINFOcrucible-agent: dataset: "oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible"
72024-06-26T05:37:52.333ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::16]:32345
82024-06-26T05:37:52.333ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-06-26T05:37:52.411ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-06-26T05:37:52.548ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::16]:32345
112024-06-26T05:39:04.369ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:62254
122024-06-26T05:39:04.386ZINFOcrucible-agent (datafile): region aa34934a-211d-448c-a34c-0118de801ee8 state: Requested
132024-06-26T05:39:04.394ZINFOcrucible-agent (dropshot): request completed latency_us = 16002 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62254 req_id = 334b476a-a7e3-444a-a448-dd40b1d84792 response_code = 200 uri = /crucible/0/regions
142024-06-26T05:39:04.394ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152024-06-26T05:39:04.408ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible/regions/aa34934a-211d-448c-a34c-0118de801ee8
162024-06-26T05:39:04.408ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible/regions/aa34934a-211d-448c-a34c-0118de801ee8
172024-06-26T05:39:04.461ZINFOcrucible-agent (worker): creating region Region { id: RegionId("aa34934a-211d-448c-a34c-0118de801ee8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/aa34934a-211d-448c-a34c-0118de801ee8" region = aa34934a-211d-448c-a34c-0118de801ee8
182024-06-26T05:39:04.463ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "aa34934a-211d-448c-a34c-0118de801ee8" "--data" "/data/regions/aa34934a-211d-448c-a34c-0118de801ee8" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = aa34934a-211d-448c-a34c-0118de801ee8
192024-06-26T05:39:04.582ZINFOcrucible-agent (worker): region files created ok region = aa34934a-211d-448c-a34c-0118de801ee8
202024-06-26T05:39:04.582ZINFOcrucible-agent (datafile): region aa34934a-211d-448c-a34c-0118de801ee8 state: Requested -> Created
212024-06-26T05:39:04.582ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-06-26T05:39:04.583ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-aa34934a-211d-448c-a34c-0118de801ee8
232024-06-26T05:39:04.589ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-aa34934a-211d-448c-a34c-0118de801ee8
242024-06-26T05:39:04.603ZINFOcrucible-agent (worker): creating config property group
252024-06-26T05:39:04.607ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-aa34934a-211d-448c-a34c-0118de801ee8
262024-06-26T05:39:04.608ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/aa34934a-211d-448c-a34c-0118de801ee8
272024-06-26T05:39:04.610ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-06-26T05:39:04.610ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
292024-06-26T05:39:04.610ZINFOcrucible-agent (worker): commit
302024-06-26T05:39:04.619ZINFOcrucible-agent (worker): ok!
312024-06-26T05:39:04.624ZINFOcrucible-agent (worker): SMF ok!
322024-06-26T05:39:04.677ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62254 req_id = 75eb7b9b-bad6-427e-8107-a2201b049746 response_code = 200 uri = /crucible/0/regions
332024-06-26T05:44:11.308ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:40217
342024-06-26T05:44:11.308ZINFOcrucible-agent (datafile): region 8e5604d6-9c47-4f54-9555-eb6f8eb2a9ff state: Requested
352024-06-26T05:44:11.309ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
362024-06-26T05:44:11.309ZINFOcrucible-agent (dropshot): request completed latency_us = 908 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40217 req_id = fcc7e454-5db5-4fa1-8f53-b6620ca6f985 response_code = 200 uri = /crucible/0/regions
372024-06-26T05:44:11.317ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible/regions/8e5604d6-9c47-4f54-9555-eb6f8eb2a9ff
382024-06-26T05:44:11.317ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible/regions/8e5604d6-9c47-4f54-9555-eb6f8eb2a9ff
392024-06-26T05:44:11.365ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8e5604d6-9c47-4f54-9555-eb6f8eb2a9ff"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8e5604d6-9c47-4f54-9555-eb6f8eb2a9ff" region = 8e5604d6-9c47-4f54-9555-eb6f8eb2a9ff
402024-06-26T05:44:11.366ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8e5604d6-9c47-4f54-9555-eb6f8eb2a9ff" "--data" "/data/regions/8e5604d6-9c47-4f54-9555-eb6f8eb2a9ff" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 8e5604d6-9c47-4f54-9555-eb6f8eb2a9ff
412024-06-26T05:44:11.431ZINFOcrucible-agent (worker): region files created ok region = 8e5604d6-9c47-4f54-9555-eb6f8eb2a9ff
422024-06-26T05:44:11.431ZINFOcrucible-agent (datafile): region 8e5604d6-9c47-4f54-9555-eb6f8eb2a9ff state: Requested -> Created
432024-06-26T05:44:11.431ZINFOcrucible-agent (worker): applying SMF actions post create...
442024-06-26T05:44:11.432ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8e5604d6-9c47-4f54-9555-eb6f8eb2a9ff
452024-06-26T05:44:11.437ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8e5604d6-9c47-4f54-9555-eb6f8eb2a9ff
462024-06-26T05:44:11.454ZINFOcrucible-agent (worker): creating config property group
472024-06-26T05:44:11.457ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40217 req_id = 0629dfda-f883-4c9f-a044-b2d2f618ec20 response_code = 200 uri = /crucible/0/regions
482024-06-26T05:44:11.457ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8e5604d6-9c47-4f54-9555-eb6f8eb2a9ff
492024-06-26T05:44:11.457ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8e5604d6-9c47-4f54-9555-eb6f8eb2a9ff
502024-06-26T05:44:11.457ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
512024-06-26T05:44:11.458ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
522024-06-26T05:44:11.458ZINFOcrucible-agent (worker): commit
532024-06-26T05:44:11.461ZINFOcrucible-agent (worker): ok!
542024-06-26T05:44:11.470ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/aa34934a-211d-448c-a34c-0118de801ee8
552024-06-26T05:44:11.470ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
562024-06-26T05:44:11.470ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::16
572024-06-26T05:44:11.470ZINFOcrucible-agent (worker): reconfig required
582024-06-26T05:44:11.470ZINFOcrucible-agent (worker): using existing config property group
592024-06-26T05:44:11.470ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-aa34934a-211d-448c-a34c-0118de801ee8
602024-06-26T05:44:11.470ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/aa34934a-211d-448c-a34c-0118de801ee8
612024-06-26T05:44:11.470ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622024-06-26T05:44:11.470ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
632024-06-26T05:44:11.470ZINFOcrucible-agent (worker): commit
642024-06-26T05:44:11.477ZINFOcrucible-agent (worker): ok!
652024-06-26T05:44:11.478ZINFOcrucible-agent (worker): SMF ok!
662024-06-26T05:44:12.525ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:41553
672024-06-26T05:44:12.526ZINFOcrucible-agent (dropshot): request completed latency_us = 749 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41553 req_id = b13fa0c5-9077-45f7-8d4a-48844ecfe89c response_code = 200 uri = /crucible/0/regions/aa34934a-211d-448c-a34c-0118de801ee8
682024-06-26T05:44:12.528ZINFOcrucible-agent (datafile): path is "/data/regions/aa34934a-211d-448c-a34c-0118de801ee8"
692024-06-26T05:44:12.537ZINFOcrucible-agent (datafile): dataset is oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible/regions/aa34934a-211d-448c-a34c-0118de801ee8
702024-06-26T05:44:12.546ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible/regions/aa34934a-211d-448c-a34c-0118de801ee8@d1f64d12-be07-447f-a2b0-fbdc20684eae
712024-06-26T05:44:12.546ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible/regions/aa34934a-211d-448c-a34c-0118de801ee8", "d1f64d12-be07-447f-a2b0-fbdc20684eae"]
722024-06-26T05:44:12.557ZINFOcrucible-agent (dropshot): request completed latency_us = 31118 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41553 req_id = 24222f27-309f-4577-8510-bf1e1ae30f3a response_code = 200 uri = /crucible/0/regions/aa34934a-211d-448c-a34c-0118de801ee8/snapshots/d1f64d12-be07-447f-a2b0-fbdc20684eae
732024-06-26T05:44:12.557ZINFOcrucible-agent (datafile): path is "/data/regions/aa34934a-211d-448c-a34c-0118de801ee8"
742024-06-26T05:44:12.566ZINFOcrucible-agent (datafile): dataset is oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible/regions/aa34934a-211d-448c-a34c-0118de801ee8
752024-06-26T05:44:12.574ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible/regions/aa34934a-211d-448c-a34c-0118de801ee8@d1f64d12-be07-447f-a2b0-fbdc20684eae
762024-06-26T05:44:12.574ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible/regions/aa34934a-211d-448c-a34c-0118de801ee8", "d1f64d12-be07-447f-a2b0-fbdc20684eae"]
772024-06-26T05:44:12.584ZINFOcrucible-agent (datafile): requesting running snapshot aa34934a-211d-448c-a34c-0118de801ee8-d1f64d12-be07-447f-a2b0-fbdc20684eae state: Requested
782024-06-26T05:44:12.584ZINFOcrucible-agent (worker): applying SMF actions for region aa34934a-211d-448c-a34c-0118de801ee8 running snapshot d1f64d12-be07-447f-a2b0-fbdc20684eae (state Requested)...
792024-06-26T05:44:12.584ZINFOcrucible-agent (dropshot): request completed latency_us = 27066 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41553 req_id = 8726d203-a2d1-4b53-8fbb-01bef5e775b1 response_code = 200 uri = /crucible/0/regions/aa34934a-211d-448c-a34c-0118de801ee8/snapshots/d1f64d12-be07-447f-a2b0-fbdc20684eae/run
802024-06-26T05:44:12.586ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/aa34934a-211d-448c-a34c-0118de801ee8
812024-06-26T05:44:12.586ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
822024-06-26T05:44:12.586ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::16
832024-06-26T05:44:12.586ZINFOcrucible-agent (worker): reconfig required
842024-06-26T05:44:12.586ZINFOcrucible-agent (worker): using existing config property group
852024-06-26T05:44:12.586ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-aa34934a-211d-448c-a34c-0118de801ee8
862024-06-26T05:44:12.586ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/aa34934a-211d-448c-a34c-0118de801ee8
872024-06-26T05:44:12.586ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
882024-06-26T05:44:12.586ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
892024-06-26T05:44:12.586ZINFOcrucible-agent (worker): commit
902024-06-26T05:44:12.590ZINFOcrucible-agent (worker): ok!
912024-06-26T05:44:12.590ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-aa34934a-211d-448c-a34c-0118de801ee8-d1f64d12-be07-447f-a2b0-fbdc20684eae
922024-06-26T05:44:12.598ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-aa34934a-211d-448c-a34c-0118de801ee8-d1f64d12-be07-447f-a2b0-fbdc20684eae
932024-06-26T05:44:12.608ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-aa34934a-211d-448c-a34c-0118de801ee8-d1f64d12-be07-447f-a2b0-fbdc20684eae
942024-06-26T05:44:12.608ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/aa34934a-211d-448c-a34c-0118de801ee8/.zfs/snapshot/d1f64d12-be07-447f-a2b0-fbdc20684eae
952024-06-26T05:44:12.608ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
962024-06-26T05:44:12.608ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
972024-06-26T05:44:12.608ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
982024-06-26T05:44:12.608ZINFOcrucible-agent (worker): commit
992024-06-26T05:44:12.613ZINFOcrucible-agent (worker): ok!
1002024-06-26T05:44:12.618ZINFOcrucible-agent (worker): SMF ok!
1012024-06-26T05:44:12.618ZINFOcrucible-agent (datafile): region aa34934a-211d-448c-a34c-0118de801ee8 running snapshot d1f64d12-be07-447f-a2b0-fbdc20684eae state: Requested -> Created
1022024-06-26T05:44:15.620ZINFOcrucible-agent (datafile): region 6bfbe308-16eb-4582-897d-5283c58704c0 state: Requested
1032024-06-26T05:44:15.620ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1042024-06-26T05:44:15.620ZINFOcrucible-agent (dropshot): request completed latency_us = 200 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40217 req_id = 2ed5748f-e0dd-4dc3-aba3-ceb07c9e5ff6 response_code = 200 uri = /crucible/0/regions
1052024-06-26T05:44:15.630ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible/regions/6bfbe308-16eb-4582-897d-5283c58704c0
1062024-06-26T05:44:15.630ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible/regions/6bfbe308-16eb-4582-897d-5283c58704c0
1072024-06-26T05:44:15.705ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6bfbe308-16eb-4582-897d-5283c58704c0"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6bfbe308-16eb-4582-897d-5283c58704c0" region = 6bfbe308-16eb-4582-897d-5283c58704c0
1082024-06-26T05:44:15.705ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6bfbe308-16eb-4582-897d-5283c58704c0" "--data" "/data/regions/6bfbe308-16eb-4582-897d-5283c58704c0" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6bfbe308-16eb-4582-897d-5283c58704c0
1092024-06-26T05:44:15.770ZINFOcrucible-agent (worker): region files created ok region = 6bfbe308-16eb-4582-897d-5283c58704c0
1102024-06-26T05:44:15.770ZINFOcrucible-agent (datafile): region 6bfbe308-16eb-4582-897d-5283c58704c0 state: Requested -> Created
1112024-06-26T05:44:15.770ZINFOcrucible-agent (worker): applying SMF actions post create...
1122024-06-26T05:44:15.771ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6bfbe308-16eb-4582-897d-5283c58704c0
1132024-06-26T05:44:15.773ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6bfbe308-16eb-4582-897d-5283c58704c0
1142024-06-26T05:44:15.781ZINFOcrucible-agent (worker): creating config property group
1152024-06-26T05:44:15.784ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6bfbe308-16eb-4582-897d-5283c58704c0
1162024-06-26T05:44:15.785ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6bfbe308-16eb-4582-897d-5283c58704c0
1172024-06-26T05:44:15.785ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
1182024-06-26T05:44:15.785ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
1192024-06-26T05:44:15.785ZINFOcrucible-agent (worker): commit
1202024-06-26T05:44:15.788ZINFOcrucible-agent (worker): ok!
1212024-06-26T05:44:15.795ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/aa34934a-211d-448c-a34c-0118de801ee8
1222024-06-26T05:44:15.795ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1232024-06-26T05:44:15.795ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::16
1242024-06-26T05:44:15.795ZINFOcrucible-agent (worker): reconfig required
1252024-06-26T05:44:15.795ZINFOcrucible-agent (worker): using existing config property group
1262024-06-26T05:44:15.795ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-aa34934a-211d-448c-a34c-0118de801ee8
1272024-06-26T05:44:15.799ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/aa34934a-211d-448c-a34c-0118de801ee8
1282024-06-26T05:44:15.799ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1292024-06-26T05:44:15.799ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
1302024-06-26T05:44:15.799ZINFOcrucible-agent (worker): commit
1312024-06-26T05:44:15.804ZINFOcrucible-agent (worker): ok!
1322024-06-26T05:44:15.805ZINFOcrucible-agent (worker): SMF ok!
1332024-06-26T05:44:15.948ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40217 req_id = 3d5d9c06-7bf6-42c4-8ada-42f8244bd94f response_code = 200 uri = /crucible/0/regions
1342024-06-26T05:44:39.765ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:40217 req_id = 2bdfbf10-f981-4c2f-bc44-5dbd5e380d66 response_code = 200 uri = /crucible/0/regions/6bfbe308-16eb-4582-897d-5283c58704c0
1352024-06-26T05:44:39.768ZINFOcrucible-agent (datafile): path is "/data/regions/6bfbe308-16eb-4582-897d-5283c58704c0"
1362024-06-26T05:44:39.794ZINFOcrucible-agent (datafile): dataset is oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible/regions/6bfbe308-16eb-4582-897d-5283c58704c0
1372024-06-26T05:44:39.802ZINFOcrucible-agent (datafile): region 6bfbe308-16eb-4582-897d-5283c58704c0 state: Created -> Tombstoned
1382024-06-26T05:44:39.803ZINFOcrucible-agent (worker): applying SMF actions before removal...
1392024-06-26T05:44:39.803ZINFOcrucible-agent (dropshot): request completed latency_us = 35004 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:40217 req_id = b648b390-8607-4898-a5e5-5daaa42e0967 response_code = 204 uri = /crucible/0/regions/6bfbe308-16eb-4582-897d-5283c58704c0
1402024-06-26T05:44:39.804ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6bfbe308-16eb-4582-897d-5283c58704c0 (instance states: (Some(Online), None))
1412024-06-26T05:44:39.806ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:40217 req_id = 9927843e-147f-48c5-b80a-4601d79e86e1 response_code = 200 uri = /crucible/0/regions/6bfbe308-16eb-4582-897d-5283c58704c0
1422024-06-26T05:44:39.823ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/aa34934a-211d-448c-a34c-0118de801ee8
1432024-06-26T05:44:39.823ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1442024-06-26T05:44:39.823ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::16
1452024-06-26T05:44:39.823ZINFOcrucible-agent (worker): reconfig required
1462024-06-26T05:44:39.823ZINFOcrucible-agent (worker): using existing config property group
1472024-06-26T05:44:39.823ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-aa34934a-211d-448c-a34c-0118de801ee8
1482024-06-26T05:44:39.824ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/aa34934a-211d-448c-a34c-0118de801ee8
1492024-06-26T05:44:39.824ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1502024-06-26T05:44:39.824ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
1512024-06-26T05:44:39.824ZINFOcrucible-agent (worker): commit
1522024-06-26T05:44:39.836ZINFOcrucible-agent (worker): ok!
1532024-06-26T05:44:39.838ZINFOcrucible-agent (worker): SMF ok!
1542024-06-26T05:44:39.848ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_9ffbf4d7-0dbd-45c3-94b3-17c5d304c2bd/crucible/regions/6bfbe308-16eb-4582-897d-5283c58704c0" region = 6bfbe308-16eb-4582-897d-5283c58704c0
1552024-06-26T05:44:39.923ZINFOcrucible-agent (dropshot): request completed latency_us = 97 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:40217 req_id = 74f1f3c1-8354-4518-902d-28ecbbb76bfa response_code = 200 uri = /crucible/0/regions/6bfbe308-16eb-4582-897d-5283c58704c0
1562024-06-26T05:44:39.930ZINFOcrucible-agent (datafile): region 6bfbe308-16eb-4582-897d-5283c58704c0 state: Tombstoned -> Destroyed
1572024-06-26T05:44:40.045ZINFOcrucible-agent (dropshot): request completed latency_us = 511 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:40217 req_id = 6997af3d-0bd3-49c9-9613-b04c9d84905b response_code = 200 uri = /crucible/0/regions/6bfbe308-16eb-4582-897d-5283c58704c0