Max level shown:
1 [ Jan 28 08:30:13 Enabled. ]
2 [ Jan 28 08:30:13 Rereading configuration. ]
3 [ Jan 28 08:30:18 Rereading configuration. ]
4 [ Jan 28 08:30:22 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-01-28T08:30:22.465ZINFOcrucible-agent: dataset: "oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible"
72025-01-28T08:30:22.466ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82025-01-28T08:30:22.466ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-01-28T08:30:22.484ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-01-28T08:30:22.547ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
112025-01-28T08:31:14.869ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:49589
122025-01-28T08:31:14.905ZINFOcrucible-agent (datafile): region 8f1a11fa-69be-4675-83da-23b586f54c46 state: Requested
132025-01-28T08:31:14.908ZINFOcrucible-agent (dropshot): request completed latency_us = 15222 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49589 req_id = 32d47d4f-44dd-4ad4-8060-05cf0deb545c response_code = 200 uri = /crucible/0/regions
142025-01-28T08:31:14.910ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152025-01-28T08:31:14.920ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/8f1a11fa-69be-4675-83da-23b586f54c46
162025-01-28T08:31:14.920ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/8f1a11fa-69be-4675-83da-23b586f54c46
172025-01-28T08:31:14.969ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8f1a11fa-69be-4675-83da-23b586f54c46"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8f1a11fa-69be-4675-83da-23b586f54c46" region = 8f1a11fa-69be-4675-83da-23b586f54c46
182025-01-28T08:31:14.971ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8f1a11fa-69be-4675-83da-23b586f54c46" "--data" "/data/regions/8f1a11fa-69be-4675-83da-23b586f54c46" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 8f1a11fa-69be-4675-83da-23b586f54c46
192025-01-28T08:31:15.143ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49589 req_id = b4b1d261-5bea-45ba-8bc5-5e54a5ab86e6 response_code = 200 uri = /crucible/0/regions
202025-01-28T08:31:15.184ZINFOcrucible-agent (worker): region files created ok region = 8f1a11fa-69be-4675-83da-23b586f54c46
212025-01-28T08:31:15.184ZINFOcrucible-agent (datafile): region 8f1a11fa-69be-4675-83da-23b586f54c46 state: Requested -> Created
222025-01-28T08:31:15.184ZINFOcrucible-agent (worker): applying SMF actions post create...
232025-01-28T08:31:15.184ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8f1a11fa-69be-4675-83da-23b586f54c46
242025-01-28T08:31:15.190ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8f1a11fa-69be-4675-83da-23b586f54c46
252025-01-28T08:31:15.205ZINFOcrucible-agent (worker): creating config property group
262025-01-28T08:31:15.217ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8f1a11fa-69be-4675-83da-23b586f54c46
272025-01-28T08:31:15.217ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8f1a11fa-69be-4675-83da-23b586f54c46
282025-01-28T08:31:15.219ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-01-28T08:31:15.220ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
302025-01-28T08:31:15.220ZINFOcrucible-agent (worker): commit
312025-01-28T08:31:15.223ZINFOcrucible-agent (worker): ok!
322025-01-28T08:31:15.227ZINFOcrucible-agent (worker): SMF ok!
332025-01-28T08:31:15.727ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49589 req_id = 63480c95-8881-45ea-9c37-2b975613aaae response_code = 200 uri = /crucible/0/regions
342025-01-28T08:41:39.439ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:57343
352025-01-28T08:41:39.439ZINFOcrucible-agent (datafile): region f545282c-4056-4571-ab43-4e6f85bd64ca state: Requested
362025-01-28T08:41:39.443ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
372025-01-28T08:41:39.443ZINFOcrucible-agent (dropshot): request completed latency_us = 3932 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57343 req_id = 4b963a37-eacf-4d85-8da2-2699dde9c3cf response_code = 200 uri = /crucible/0/regions
382025-01-28T08:41:39.455ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/f545282c-4056-4571-ab43-4e6f85bd64ca
392025-01-28T08:41:39.455ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/f545282c-4056-4571-ab43-4e6f85bd64ca
402025-01-28T08:41:39.511ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f545282c-4056-4571-ab43-4e6f85bd64ca"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/f545282c-4056-4571-ab43-4e6f85bd64ca" region = f545282c-4056-4571-ab43-4e6f85bd64ca
412025-01-28T08:41:39.511ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "f545282c-4056-4571-ab43-4e6f85bd64ca" "--data" "/data/regions/f545282c-4056-4571-ab43-4e6f85bd64ca" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = f545282c-4056-4571-ab43-4e6f85bd64ca
422025-01-28T08:41:39.588ZINFOcrucible-agent (dropshot): request completed latency_us = 88 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57343 req_id = 27d78954-4137-4f66-9407-1c857c39b8c5 response_code = 200 uri = /crucible/0/regions
432025-01-28T08:41:39.588ZINFOcrucible-agent (worker): region files created ok region = f545282c-4056-4571-ab43-4e6f85bd64ca
442025-01-28T08:41:39.588ZINFOcrucible-agent (datafile): region f545282c-4056-4571-ab43-4e6f85bd64ca state: Requested -> Created
452025-01-28T08:41:39.588ZINFOcrucible-agent (worker): applying SMF actions post create...
462025-01-28T08:41:39.597ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/8f1a11fa-69be-4675-83da-23b586f54c46
472025-01-28T08:41:39.597ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
482025-01-28T08:41:39.597ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::19
492025-01-28T08:41:39.597ZINFOcrucible-agent (worker): reconfig required
502025-01-28T08:41:39.597ZINFOcrucible-agent (worker): using existing config property group
512025-01-28T08:41:39.597ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8f1a11fa-69be-4675-83da-23b586f54c46
522025-01-28T08:41:39.597ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8f1a11fa-69be-4675-83da-23b586f54c46
532025-01-28T08:41:39.597ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
542025-01-28T08:41:39.597ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
552025-01-28T08:41:39.597ZINFOcrucible-agent (worker): commit
562025-01-28T08:41:39.602ZINFOcrucible-agent (worker): ok!
572025-01-28T08:41:39.602ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f545282c-4056-4571-ab43-4e6f85bd64ca
582025-01-28T08:41:39.605ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f545282c-4056-4571-ab43-4e6f85bd64ca
592025-01-28T08:41:39.615ZINFOcrucible-agent (worker): creating config property group
602025-01-28T08:41:39.618ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f545282c-4056-4571-ab43-4e6f85bd64ca
612025-01-28T08:41:39.618ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f545282c-4056-4571-ab43-4e6f85bd64ca
622025-01-28T08:41:39.619ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
632025-01-28T08:41:39.619ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
642025-01-28T08:41:39.619ZINFOcrucible-agent (worker): commit
652025-01-28T08:41:39.623ZINFOcrucible-agent (worker): ok!
662025-01-28T08:41:39.628ZINFOcrucible-agent (worker): SMF ok!
672025-01-28T08:41:40.257ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57343 req_id = cd4cc311-4b54-4e24-b5d2-90417c16e690 response_code = 200 uri = /crucible/0/regions
682025-01-28T08:41:40.628ZINFOcrucible-agent (dropshot): request completed latency_us = 4549 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:57343 req_id = e4d54ea5-b593-4664-ac5b-d516512cda80 response_code = 200 uri = /crucible/0/regions/8f1a11fa-69be-4675-83da-23b586f54c46
692025-01-28T08:41:40.631ZINFOcrucible-agent (datafile): path is "/data/regions/8f1a11fa-69be-4675-83da-23b586f54c46"
702025-01-28T08:41:40.640ZINFOcrucible-agent (datafile): dataset is oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/8f1a11fa-69be-4675-83da-23b586f54c46
712025-01-28T08:41:40.649ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/8f1a11fa-69be-4675-83da-23b586f54c46@66a26527-bfac-4f64-b405-31937457829b
722025-01-28T08:41:40.649ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/8f1a11fa-69be-4675-83da-23b586f54c46", "66a26527-bfac-4f64-b405-31937457829b"]
732025-01-28T08:41:40.662ZINFOcrucible-agent (dropshot): request completed latency_us = 31474 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:57343 req_id = 5174da4c-b2d3-4af0-b390-5f541ad4a584 response_code = 200 uri = /crucible/0/regions/8f1a11fa-69be-4675-83da-23b586f54c46/snapshots/66a26527-bfac-4f64-b405-31937457829b
742025-01-28T08:41:40.665ZINFOcrucible-agent (datafile): path is "/data/regions/8f1a11fa-69be-4675-83da-23b586f54c46"
752025-01-28T08:41:40.673ZINFOcrucible-agent (datafile): dataset is oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/8f1a11fa-69be-4675-83da-23b586f54c46
762025-01-28T08:41:40.683ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/8f1a11fa-69be-4675-83da-23b586f54c46@66a26527-bfac-4f64-b405-31937457829b
772025-01-28T08:41:40.683ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/8f1a11fa-69be-4675-83da-23b586f54c46", "66a26527-bfac-4f64-b405-31937457829b"]
782025-01-28T08:41:40.691ZINFOcrucible-agent (datafile): requesting running snapshot 8f1a11fa-69be-4675-83da-23b586f54c46-66a26527-bfac-4f64-b405-31937457829b state: Requested
792025-01-28T08:41:40.691ZINFOcrucible-agent (worker): applying SMF actions for region 8f1a11fa-69be-4675-83da-23b586f54c46 running snapshot 66a26527-bfac-4f64-b405-31937457829b (state Requested)...
802025-01-28T08:41:40.691ZINFOcrucible-agent (dropshot): request completed latency_us = 26173 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57343 req_id = e3315f32-6a3b-4fc2-8a2b-94107284e6ce response_code = 200 uri = /crucible/0/regions/8f1a11fa-69be-4675-83da-23b586f54c46/snapshots/66a26527-bfac-4f64-b405-31937457829b/run
812025-01-28T08:41:40.692ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/8f1a11fa-69be-4675-83da-23b586f54c46
822025-01-28T08:41:40.692ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
832025-01-28T08:41:40.692ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::19
842025-01-28T08:41:40.692ZINFOcrucible-agent (worker): reconfig required
852025-01-28T08:41:40.692ZINFOcrucible-agent (worker): using existing config property group
862025-01-28T08:41:40.692ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8f1a11fa-69be-4675-83da-23b586f54c46
872025-01-28T08:41:40.693ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8f1a11fa-69be-4675-83da-23b586f54c46
882025-01-28T08:41:40.693ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
892025-01-28T08:41:40.693ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
902025-01-28T08:41:40.693ZINFOcrucible-agent (worker): commit
912025-01-28T08:41:40.696ZINFOcrucible-agent (worker): ok!
922025-01-28T08:41:40.698ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-8f1a11fa-69be-4675-83da-23b586f54c46-66a26527-bfac-4f64-b405-31937457829b
932025-01-28T08:41:40.707ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-8f1a11fa-69be-4675-83da-23b586f54c46-66a26527-bfac-4f64-b405-31937457829b
942025-01-28T08:41:40.717ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-8f1a11fa-69be-4675-83da-23b586f54c46-66a26527-bfac-4f64-b405-31937457829b
952025-01-28T08:41:40.717ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8f1a11fa-69be-4675-83da-23b586f54c46/.zfs/snapshot/66a26527-bfac-4f64-b405-31937457829b
962025-01-28T08:41:40.717ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
972025-01-28T08:41:40.717ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
982025-01-28T08:41:40.717ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
992025-01-28T08:41:40.717ZINFOcrucible-agent (worker): commit
1002025-01-28T08:41:40.721ZINFOcrucible-agent (worker): ok!
1012025-01-28T08:41:40.725ZINFOcrucible-agent (worker): SMF ok!
1022025-01-28T08:41:40.725ZINFOcrucible-agent (datafile): region 8f1a11fa-69be-4675-83da-23b586f54c46 running snapshot 66a26527-bfac-4f64-b405-31937457829b state: Requested -> Created
1032025-01-28T08:41:41.008ZINFOcrucible-agent (datafile): path is "/data/regions/8f1a11fa-69be-4675-83da-23b586f54c46"
1042025-01-28T08:41:41.017ZINFOcrucible-agent (datafile): dataset is oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/8f1a11fa-69be-4675-83da-23b586f54c46
1052025-01-28T08:41:41.027ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/8f1a11fa-69be-4675-83da-23b586f54c46@66a26527-bfac-4f64-b405-31937457829b
1062025-01-28T08:41:41.027ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/8f1a11fa-69be-4675-83da-23b586f54c46", "66a26527-bfac-4f64-b405-31937457829b"]
1072025-01-28T08:41:41.035ZINFOcrucible-agent (dropshot): request completed latency_us = 27537 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57343 req_id = 174f4a49-405e-4787-bb5b-955f0f7df1d1 response_code = 200 uri = /crucible/0/regions/8f1a11fa-69be-4675-83da-23b586f54c46/snapshots/66a26527-bfac-4f64-b405-31937457829b/run
1082025-01-28T08:41:45.129ZINFOcrucible-agent (datafile): region e2136d31-79ac-4be9-9fcc-e7613635abf5 state: Requested
1092025-01-28T08:41:45.129ZINFOcrucible-agent (dropshot): request completed latency_us = 1102 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57343 req_id = 39ceb10a-584a-404d-9be8-d2d3eff1987e response_code = 200 uri = /crucible/0/regions
1102025-01-28T08:41:45.129ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1112025-01-28T08:41:45.140ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/e2136d31-79ac-4be9-9fcc-e7613635abf5
1122025-01-28T08:41:45.140ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/e2136d31-79ac-4be9-9fcc-e7613635abf5
1132025-01-28T08:41:45.203ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e2136d31-79ac-4be9-9fcc-e7613635abf5"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e2136d31-79ac-4be9-9fcc-e7613635abf5" region = e2136d31-79ac-4be9-9fcc-e7613635abf5
1142025-01-28T08:41:45.205ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e2136d31-79ac-4be9-9fcc-e7613635abf5" "--data" "/data/regions/e2136d31-79ac-4be9-9fcc-e7613635abf5" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e2136d31-79ac-4be9-9fcc-e7613635abf5
1152025-01-28T08:41:45.274ZINFOcrucible-agent (worker): region files created ok region = e2136d31-79ac-4be9-9fcc-e7613635abf5
1162025-01-28T08:41:45.274ZINFOcrucible-agent (datafile): region e2136d31-79ac-4be9-9fcc-e7613635abf5 state: Requested -> Created
1172025-01-28T08:41:45.274ZINFOcrucible-agent (worker): applying SMF actions post create...
1182025-01-28T08:41:45.275ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/8f1a11fa-69be-4675-83da-23b586f54c46
1192025-01-28T08:41:45.275ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1202025-01-28T08:41:45.275ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::19
1212025-01-28T08:41:45.275ZINFOcrucible-agent (worker): reconfig required
1222025-01-28T08:41:45.275ZINFOcrucible-agent (worker): using existing config property group
1232025-01-28T08:41:45.276ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8f1a11fa-69be-4675-83da-23b586f54c46
1242025-01-28T08:41:45.276ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8f1a11fa-69be-4675-83da-23b586f54c46
1252025-01-28T08:41:45.276ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1262025-01-28T08:41:45.276ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
1272025-01-28T08:41:45.276ZINFOcrucible-agent (worker): commit
1282025-01-28T08:41:45.281ZINFOcrucible-agent (worker): ok!
1292025-01-28T08:41:45.281ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e2136d31-79ac-4be9-9fcc-e7613635abf5
1302025-01-28T08:41:45.285ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e2136d31-79ac-4be9-9fcc-e7613635abf5
1312025-01-28T08:41:45.294ZINFOcrucible-agent (worker): creating config property group
1322025-01-28T08:41:45.298ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e2136d31-79ac-4be9-9fcc-e7613635abf5
1332025-01-28T08:41:45.298ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e2136d31-79ac-4be9-9fcc-e7613635abf5
1342025-01-28T08:41:45.298ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
1352025-01-28T08:41:45.299ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
1362025-01-28T08:41:45.299ZINFOcrucible-agent (worker): commit
1372025-01-28T08:41:45.302ZINFOcrucible-agent (worker): ok!
1382025-01-28T08:41:45.314ZINFOcrucible-agent (worker): SMF ok!
1392025-01-28T08:41:45.505ZINFOcrucible-agent (dropshot): request completed latency_us = 100 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57343 req_id = b0e37ad9-a3a2-43c3-8aad-b37f4a5c42b8 response_code = 200 uri = /crucible/0/regions
1402025-01-28T08:42:10.729ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:57343 req_id = b942c17b-3355-4c2e-88b3-cbe461e25b2d response_code = 200 uri = /crucible/0/regions/e2136d31-79ac-4be9-9fcc-e7613635abf5
1412025-01-28T08:42:10.732ZINFOcrucible-agent (datafile): path is "/data/regions/e2136d31-79ac-4be9-9fcc-e7613635abf5"
1422025-01-28T08:42:10.747ZINFOcrucible-agent (datafile): dataset is oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/e2136d31-79ac-4be9-9fcc-e7613635abf5
1432025-01-28T08:42:10.756ZINFOcrucible-agent (datafile): region e2136d31-79ac-4be9-9fcc-e7613635abf5 state: Created -> Tombstoned
1442025-01-28T08:42:10.756ZINFOcrucible-agent (worker): applying SMF actions before removal...
1452025-01-28T08:42:10.758ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e2136d31-79ac-4be9-9fcc-e7613635abf5 (instance states: (Some(Online), None))
1462025-01-28T08:42:10.759ZINFOcrucible-agent (dropshot): request completed latency_us = 27098 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:57343 req_id = 125f214a-05ee-4c7f-8d6a-64601c23ae99 response_code = 204 uri = /crucible/0/regions/e2136d31-79ac-4be9-9fcc-e7613635abf5
1472025-01-28T08:42:10.762ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:57343 req_id = d3d73cbf-ea04-4fa1-8eaf-ca2b4e0088d2 response_code = 200 uri = /crucible/0/regions/e2136d31-79ac-4be9-9fcc-e7613635abf5
1482025-01-28T08:42:10.769ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/8f1a11fa-69be-4675-83da-23b586f54c46
1492025-01-28T08:42:10.769ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1502025-01-28T08:42:10.770ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::19
1512025-01-28T08:42:10.770ZINFOcrucible-agent (worker): reconfig required
1522025-01-28T08:42:10.770ZINFOcrucible-agent (worker): using existing config property group
1532025-01-28T08:42:10.770ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8f1a11fa-69be-4675-83da-23b586f54c46
1542025-01-28T08:42:10.770ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8f1a11fa-69be-4675-83da-23b586f54c46
1552025-01-28T08:42:10.770ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1562025-01-28T08:42:10.770ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
1572025-01-28T08:42:10.770ZINFOcrucible-agent (worker): commit
1582025-01-28T08:42:10.779ZINFOcrucible-agent (worker): ok!
1592025-01-28T08:42:10.781ZINFOcrucible-agent (worker): SMF ok!
1602025-01-28T08:42:10.792ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible/regions/e2136d31-79ac-4be9-9fcc-e7613635abf5" region = e2136d31-79ac-4be9-9fcc-e7613635abf5
1612025-01-28T08:42:10.866ZINFOcrucible-agent (datafile): region e2136d31-79ac-4be9-9fcc-e7613635abf5 state: Tombstoned -> Destroyed
1622025-01-28T08:42:10.871ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:57343 req_id = 3166e8ba-4617-4016-b6ae-6e6b52418fb7 response_code = 200 uri = /crucible/0/regions/e2136d31-79ac-4be9-9fcc-e7613635abf5