Max level shown:
1 [ Jul 12 03:34:03 Enabled. ]
2 [ Jul 12 03:34:03 Rereading configuration. ]
3 [ Jul 12 03:34:07 Rereading configuration. ]
4 [ Jul 12 03:34:15 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_e27deccc-da38-4f26-b640-882767521f29/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-07-12T03:34:15.598ZINFOcrucible-agent: dataset: "oxp_e27deccc-da38-4f26-b640-882767521f29/crucible"
72024-07-12T03:34:15.604ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
82024-07-12T03:34:15.604ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-07-12T03:34:15.616ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-07-12T03:34:15.867ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
112024-07-12T03:35:28.417ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:38737
122024-07-12T03:35:28.436ZINFOcrucible-agent (datafile): region 82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6 state: Requested
132024-07-12T03:35:28.445ZINFOcrucible-agent (dropshot): request completed latency_us = 18581 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38737 req_id = 1d88bb9f-e0fe-43c2-9e5c-a32907737eac response_code = 200 uri = /crucible/0/regions
142024-07-12T03:35:28.445ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152024-07-12T03:35:28.459ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e27deccc-da38-4f26-b640-882767521f29/crucible/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
162024-07-12T03:35:28.459ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e27deccc-da38-4f26-b640-882767521f29/crucible/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
172024-07-12T03:35:28.511ZINFOcrucible-agent (worker): creating region Region { id: RegionId("82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6" region = 82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
182024-07-12T03:35:28.511ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6" "--data" "/data/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
192024-07-12T03:35:28.610ZINFOcrucible-agent (dropshot): request completed latency_us = 93 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38737 req_id = 8fff0e46-fd86-4ab2-94a5-5126feaef324 response_code = 200 uri = /crucible/0/regions
202024-07-12T03:35:28.807ZINFOcrucible-agent (worker): region files created ok region = 82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
212024-07-12T03:35:28.808ZINFOcrucible-agent (datafile): region 82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6 state: Requested -> Created
222024-07-12T03:35:28.808ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-07-12T03:35:28.808ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
242024-07-12T03:35:28.815ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
252024-07-12T03:35:28.837ZINFOcrucible-agent (worker): creating config property group
262024-07-12T03:35:28.840ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
272024-07-12T03:35:28.840ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
282024-07-12T03:35:28.845ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-07-12T03:35:28.845ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
302024-07-12T03:35:28.845ZINFOcrucible-agent (worker): commit
312024-07-12T03:35:28.853ZINFOcrucible-agent (worker): ok!
322024-07-12T03:35:28.861ZINFOcrucible-agent (worker): SMF ok!
332024-07-12T03:35:29.233ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38737 req_id = d24bbb74-2244-4a53-ae3f-402577cff571 response_code = 200 uri = /crucible/0/regions
342024-07-12T03:40:43.866ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:58606
352024-07-12T03:40:43.866ZINFOcrucible-agent (datafile): region 50e27405-9215-402f-a148-a6d6759dc12d state: Requested
362024-07-12T03:40:43.869ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
372024-07-12T03:40:43.869ZINFOcrucible-agent (dropshot): request completed latency_us = 2965 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58606 req_id = 561e956e-3181-4dbf-a6ca-74b40e77b978 response_code = 200 uri = /crucible/0/regions
382024-07-12T03:40:43.879ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e27deccc-da38-4f26-b640-882767521f29/crucible/regions/50e27405-9215-402f-a148-a6d6759dc12d
392024-07-12T03:40:43.879ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e27deccc-da38-4f26-b640-882767521f29/crucible/regions/50e27405-9215-402f-a148-a6d6759dc12d
402024-07-12T03:40:43.938ZINFOcrucible-agent (worker): creating region Region { id: RegionId("50e27405-9215-402f-a148-a6d6759dc12d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/50e27405-9215-402f-a148-a6d6759dc12d" region = 50e27405-9215-402f-a148-a6d6759dc12d
412024-07-12T03:40:43.938ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "50e27405-9215-402f-a148-a6d6759dc12d" "--data" "/data/regions/50e27405-9215-402f-a148-a6d6759dc12d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 50e27405-9215-402f-a148-a6d6759dc12d
422024-07-12T03:40:44.054ZINFOcrucible-agent (worker): region files created ok region = 50e27405-9215-402f-a148-a6d6759dc12d
432024-07-12T03:40:44.055ZINFOcrucible-agent (datafile): region 50e27405-9215-402f-a148-a6d6759dc12d state: Requested -> Created
442024-07-12T03:40:44.055ZINFOcrucible-agent (worker): applying SMF actions post create...
452024-07-12T03:40:44.055ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-50e27405-9215-402f-a148-a6d6759dc12d
462024-07-12T03:40:44.063ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-50e27405-9215-402f-a148-a6d6759dc12d
472024-07-12T03:40:44.082ZINFOcrucible-agent (worker): creating config property group
482024-07-12T03:40:44.089ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-50e27405-9215-402f-a148-a6d6759dc12d
492024-07-12T03:40:44.089ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/50e27405-9215-402f-a148-a6d6759dc12d
502024-07-12T03:40:44.089ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
512024-07-12T03:40:44.089ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
522024-07-12T03:40:44.089ZINFOcrucible-agent (worker): commit
532024-07-12T03:40:44.100ZINFOcrucible-agent (worker): ok!
542024-07-12T03:40:44.114ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
552024-07-12T03:40:44.114ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
562024-07-12T03:40:44.114ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
572024-07-12T03:40:44.114ZINFOcrucible-agent (worker): reconfig required
582024-07-12T03:40:44.114ZINFOcrucible-agent (worker): using existing config property group
592024-07-12T03:40:44.114ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
602024-07-12T03:40:44.114ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
612024-07-12T03:40:44.114ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622024-07-12T03:40:44.114ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
632024-07-12T03:40:44.114ZINFOcrucible-agent (worker): commit
642024-07-12T03:40:44.129ZINFOcrucible-agent (worker): ok!
652024-07-12T03:40:44.129ZINFOcrucible-agent (worker): SMF ok!
662024-07-12T03:40:44.149ZINFOcrucible-agent (dropshot): request completed latency_us = 690 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58606 req_id = 24c25cf8-067b-4684-bfe6-c43daf07052f response_code = 200 uri = /crucible/0/regions
672024-07-12T03:40:44.872ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:44217
682024-07-12T03:40:44.875ZINFOcrucible-agent (dropshot): request completed latency_us = 2548 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:44217 req_id = bdb5fb82-2634-475c-890d-e9ec2c802257 response_code = 200 uri = /crucible/0/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
692024-07-12T03:40:44.879ZINFOcrucible-agent (datafile): path is "/data/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6"
702024-07-12T03:40:44.888ZINFOcrucible-agent (datafile): dataset is oxp_e27deccc-da38-4f26-b640-882767521f29/crucible/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
712024-07-12T03:40:44.897ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_e27deccc-da38-4f26-b640-882767521f29/crucible/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6@43cd5a3a-62c1-4a53-871a-f5ed7471faa2
722024-07-12T03:40:44.897ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_e27deccc-da38-4f26-b640-882767521f29/crucible/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6", "43cd5a3a-62c1-4a53-871a-f5ed7471faa2"]
732024-07-12T03:40:44.905ZINFOcrucible-agent (dropshot): request completed latency_us = 28352 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:44217 req_id = b9085fb5-069b-440e-8f18-aeb6c93a73c1 response_code = 200 uri = /crucible/0/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6/snapshots/43cd5a3a-62c1-4a53-871a-f5ed7471faa2
742024-07-12T03:40:44.906ZINFOcrucible-agent (datafile): path is "/data/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6"
752024-07-12T03:40:44.914ZINFOcrucible-agent (datafile): dataset is oxp_e27deccc-da38-4f26-b640-882767521f29/crucible/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
762024-07-12T03:40:44.921ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_e27deccc-da38-4f26-b640-882767521f29/crucible/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6@43cd5a3a-62c1-4a53-871a-f5ed7471faa2
772024-07-12T03:40:44.921ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_e27deccc-da38-4f26-b640-882767521f29/crucible/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6", "43cd5a3a-62c1-4a53-871a-f5ed7471faa2"]
782024-07-12T03:40:44.930ZINFOcrucible-agent (datafile): requesting running snapshot 82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6-43cd5a3a-62c1-4a53-871a-f5ed7471faa2 state: Requested
792024-07-12T03:40:44.931ZINFOcrucible-agent (worker): applying SMF actions for region 82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6 running snapshot 43cd5a3a-62c1-4a53-871a-f5ed7471faa2 (state Requested)...
802024-07-12T03:40:44.931ZINFOcrucible-agent (dropshot): request completed latency_us = 25061 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:44217 req_id = 3144a60a-9af5-416c-ac55-9cc0cb724751 response_code = 200 uri = /crucible/0/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6/snapshots/43cd5a3a-62c1-4a53-871a-f5ed7471faa2/run
812024-07-12T03:40:44.932ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
822024-07-12T03:40:44.932ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
832024-07-12T03:40:44.933ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
842024-07-12T03:40:44.933ZINFOcrucible-agent (worker): reconfig required
852024-07-12T03:40:44.933ZINFOcrucible-agent (worker): using existing config property group
862024-07-12T03:40:44.933ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
872024-07-12T03:40:44.933ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
882024-07-12T03:40:44.933ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
892024-07-12T03:40:44.933ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
902024-07-12T03:40:44.933ZINFOcrucible-agent (worker): commit
912024-07-12T03:40:44.941ZINFOcrucible-agent (worker): ok!
922024-07-12T03:40:44.941ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6-43cd5a3a-62c1-4a53-871a-f5ed7471faa2
932024-07-12T03:40:44.948ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6-43cd5a3a-62c1-4a53-871a-f5ed7471faa2
942024-07-12T03:40:44.967ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6-43cd5a3a-62c1-4a53-871a-f5ed7471faa2
952024-07-12T03:40:44.968ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6/.zfs/snapshot/43cd5a3a-62c1-4a53-871a-f5ed7471faa2
962024-07-12T03:40:44.968ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
972024-07-12T03:40:44.968ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
982024-07-12T03:40:44.968ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
992024-07-12T03:40:44.968ZINFOcrucible-agent (worker): commit
1002024-07-12T03:40:44.975ZINFOcrucible-agent (worker): ok!
1012024-07-12T03:40:44.981ZINFOcrucible-agent (worker): SMF ok!
1022024-07-12T03:40:44.981ZINFOcrucible-agent (datafile): region 82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6 running snapshot 43cd5a3a-62c1-4a53-871a-f5ed7471faa2 state: Requested -> Created
1032024-07-12T03:40:48.230ZINFOcrucible-agent (datafile): region 01c0c5dc-1d01-4861-a26c-29ddf1ce7046 state: Requested
1042024-07-12T03:40:48.230ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1052024-07-12T03:40:48.230ZINFOcrucible-agent (dropshot): request completed latency_us = 233 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58606 req_id = e312bac5-7712-45ac-82fb-065130729939 response_code = 200 uri = /crucible/0/regions
1062024-07-12T03:40:48.239ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e27deccc-da38-4f26-b640-882767521f29/crucible/regions/01c0c5dc-1d01-4861-a26c-29ddf1ce7046
1072024-07-12T03:40:48.239ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e27deccc-da38-4f26-b640-882767521f29/crucible/regions/01c0c5dc-1d01-4861-a26c-29ddf1ce7046
1082024-07-12T03:40:48.310ZINFOcrucible-agent (worker): creating region Region { id: RegionId("01c0c5dc-1d01-4861-a26c-29ddf1ce7046"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/01c0c5dc-1d01-4861-a26c-29ddf1ce7046" region = 01c0c5dc-1d01-4861-a26c-29ddf1ce7046
1092024-07-12T03:40:48.310ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "01c0c5dc-1d01-4861-a26c-29ddf1ce7046" "--data" "/data/regions/01c0c5dc-1d01-4861-a26c-29ddf1ce7046" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 01c0c5dc-1d01-4861-a26c-29ddf1ce7046
1102024-07-12T03:40:48.409ZINFOcrucible-agent (worker): region files created ok region = 01c0c5dc-1d01-4861-a26c-29ddf1ce7046
1112024-07-12T03:40:48.409ZINFOcrucible-agent (datafile): region 01c0c5dc-1d01-4861-a26c-29ddf1ce7046 state: Requested -> Created
1122024-07-12T03:40:48.409ZINFOcrucible-agent (worker): applying SMF actions post create...
1132024-07-12T03:40:48.410ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-01c0c5dc-1d01-4861-a26c-29ddf1ce7046
1142024-07-12T03:40:48.417ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-01c0c5dc-1d01-4861-a26c-29ddf1ce7046
1152024-07-12T03:40:48.435ZINFOcrucible-agent (worker): creating config property group
1162024-07-12T03:40:48.442ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-01c0c5dc-1d01-4861-a26c-29ddf1ce7046
1172024-07-12T03:40:48.442ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/01c0c5dc-1d01-4861-a26c-29ddf1ce7046
1182024-07-12T03:40:48.442ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
1192024-07-12T03:40:48.442ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
1202024-07-12T03:40:48.442ZINFOcrucible-agent (worker): commit
1212024-07-12T03:40:48.444ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58606 req_id = e6830575-c0e4-45b3-b21d-bcb42c4b9784 response_code = 200 uri = /crucible/0/regions
1222024-07-12T03:40:48.452ZINFOcrucible-agent (worker): ok!
1232024-07-12T03:40:48.463ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
1242024-07-12T03:40:48.463ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1252024-07-12T03:40:48.463ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
1262024-07-12T03:40:48.463ZINFOcrucible-agent (worker): reconfig required
1272024-07-12T03:40:48.463ZINFOcrucible-agent (worker): using existing config property group
1282024-07-12T03:40:48.463ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
1292024-07-12T03:40:48.471ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
1302024-07-12T03:40:48.471ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1312024-07-12T03:40:48.471ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
1322024-07-12T03:40:48.471ZINFOcrucible-agent (worker): commit
1332024-07-12T03:40:48.479ZINFOcrucible-agent (worker): ok!
1342024-07-12T03:40:48.481ZINFOcrucible-agent (worker): SMF ok!
1352024-07-12T03:41:14.591ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58606 req_id = ba414775-51df-4f1b-9cea-5d9b1e409241 response_code = 200 uri = /crucible/0/regions/01c0c5dc-1d01-4861-a26c-29ddf1ce7046
1362024-07-12T03:41:14.594ZINFOcrucible-agent (datafile): path is "/data/regions/01c0c5dc-1d01-4861-a26c-29ddf1ce7046"
1372024-07-12T03:41:14.605ZINFOcrucible-agent (datafile): dataset is oxp_e27deccc-da38-4f26-b640-882767521f29/crucible/regions/01c0c5dc-1d01-4861-a26c-29ddf1ce7046
1382024-07-12T03:41:14.614ZINFOcrucible-agent (datafile): region 01c0c5dc-1d01-4861-a26c-29ddf1ce7046 state: Created -> Tombstoned
1392024-07-12T03:41:14.614ZINFOcrucible-agent (worker): applying SMF actions before removal...
1402024-07-12T03:41:14.614ZINFOcrucible-agent (dropshot): request completed latency_us = 20191 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:58606 req_id = 2e41221c-59de-4864-ba00-e9d4a4adbbf2 response_code = 204 uri = /crucible/0/regions/01c0c5dc-1d01-4861-a26c-29ddf1ce7046
1412024-07-12T03:41:14.615ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-01c0c5dc-1d01-4861-a26c-29ddf1ce7046 (instance states: (Some(Online), None))
1422024-07-12T03:41:14.617ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58606 req_id = 1e0e67c2-4667-473f-a69a-49e74e0f3a2b response_code = 200 uri = /crucible/0/regions/01c0c5dc-1d01-4861-a26c-29ddf1ce7046
1432024-07-12T03:41:14.622ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
1442024-07-12T03:41:14.622ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1452024-07-12T03:41:14.622ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
1462024-07-12T03:41:14.622ZINFOcrucible-agent (worker): reconfig required
1472024-07-12T03:41:14.622ZINFOcrucible-agent (worker): using existing config property group
1482024-07-12T03:41:14.622ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
1492024-07-12T03:41:14.623ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/82f691e4-69ff-4eb5-a5c4-f1070b9fc7d6
1502024-07-12T03:41:14.623ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1512024-07-12T03:41:14.623ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
1522024-07-12T03:41:14.623ZINFOcrucible-agent (worker): commit
1532024-07-12T03:41:14.627ZINFOcrucible-agent (worker): ok!
1542024-07-12T03:41:14.629ZINFOcrucible-agent (worker): SMF ok!
1552024-07-12T03:41:14.638ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_e27deccc-da38-4f26-b640-882767521f29/crucible/regions/01c0c5dc-1d01-4861-a26c-29ddf1ce7046" region = 01c0c5dc-1d01-4861-a26c-29ddf1ce7046
1562024-07-12T03:41:14.689ZINFOcrucible-agent (datafile): region 01c0c5dc-1d01-4861-a26c-29ddf1ce7046 state: Tombstoned -> Destroyed
1572024-07-12T03:41:14.722ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58606 req_id = ad730690-b223-4626-b85b-25aa90be7f35 response_code = 200 uri = /crucible/0/regions/01c0c5dc-1d01-4861-a26c-29ddf1ce7046