Max level shown:
1 [ Aug 16 04:35:00 Enabled. ]
2 [ Aug 16 04:35:00 Rereading configuration. ]
3 [ Aug 16 04:35:02 Rereading configuration. ]
4 [ Aug 16 04:35:04 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-08-16T04:35:04.789ZINFOcrucible-agent: dataset: "oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible"
72024-08-16T04:35:04.790ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
82024-08-16T04:35:04.790ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-08-16T04:35:04.815ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-08-16T04:35:04.932ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
112024-08-16T04:36:01.846ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:54577
122024-08-16T04:36:01.867ZINFOcrucible-agent (datafile): region da08bbbe-1673-4a0a-ac11-e039a9d3e139 state: Requested
132024-08-16T04:36:01.872ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142024-08-16T04:36:01.875ZINFOcrucible-agent (dropshot): request completed latency_us = 14941 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54577 req_id = 5252008e-73c5-41e1-aaa8-36a959336316 response_code = 200 uri = /crucible/0/regions
152024-08-16T04:36:01.884ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139
162024-08-16T04:36:01.884ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139
172024-08-16T04:36:01.952ZINFOcrucible-agent (worker): creating region Region { id: RegionId("da08bbbe-1673-4a0a-ac11-e039a9d3e139"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139" region = da08bbbe-1673-4a0a-ac11-e039a9d3e139
182024-08-16T04:36:01.954ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "da08bbbe-1673-4a0a-ac11-e039a9d3e139" "--data" "/data/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = da08bbbe-1673-4a0a-ac11-e039a9d3e139
192024-08-16T04:36:02.084ZINFOcrucible-agent (worker): region files created ok region = da08bbbe-1673-4a0a-ac11-e039a9d3e139
202024-08-16T04:36:02.084ZINFOcrucible-agent (datafile): region da08bbbe-1673-4a0a-ac11-e039a9d3e139 state: Requested -> Created
212024-08-16T04:36:02.084ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-08-16T04:36:02.084ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-da08bbbe-1673-4a0a-ac11-e039a9d3e139
232024-08-16T04:36:02.090ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-da08bbbe-1673-4a0a-ac11-e039a9d3e139
242024-08-16T04:36:02.095ZINFOcrucible-agent (dropshot): request completed latency_us = 99 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54577 req_id = 3a194965-4f94-4b1e-ac7b-69e6ad27ea54 response_code = 200 uri = /crucible/0/regions
252024-08-16T04:36:02.107ZINFOcrucible-agent (worker): creating config property group
262024-08-16T04:36:02.110ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-da08bbbe-1673-4a0a-ac11-e039a9d3e139
272024-08-16T04:36:02.119ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139
282024-08-16T04:36:02.121ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-08-16T04:36:02.122ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
302024-08-16T04:36:02.122ZINFOcrucible-agent (worker): commit
312024-08-16T04:36:02.126ZINFOcrucible-agent (worker): ok!
322024-08-16T04:36:02.130ZINFOcrucible-agent (worker): SMF ok!
332024-08-16T04:41:18.512ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:52372
342024-08-16T04:41:18.512ZINFOcrucible-agent (datafile): region d46259b8-5d8d-4caf-b8a5-beb931042183 state: Requested
352024-08-16T04:41:18.513ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
362024-08-16T04:41:18.513ZINFOcrucible-agent (dropshot): request completed latency_us = 1455 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52372 req_id = 41c8a544-5e5d-40b9-b9e1-9424fe6d54c1 response_code = 200 uri = /crucible/0/regions
372024-08-16T04:41:18.524ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/d46259b8-5d8d-4caf-b8a5-beb931042183
382024-08-16T04:41:18.524ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/d46259b8-5d8d-4caf-b8a5-beb931042183
392024-08-16T04:41:18.595ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d46259b8-5d8d-4caf-b8a5-beb931042183"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d46259b8-5d8d-4caf-b8a5-beb931042183" region = d46259b8-5d8d-4caf-b8a5-beb931042183
402024-08-16T04:41:18.595ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d46259b8-5d8d-4caf-b8a5-beb931042183" "--data" "/data/regions/d46259b8-5d8d-4caf-b8a5-beb931042183" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d46259b8-5d8d-4caf-b8a5-beb931042183
412024-08-16T04:41:18.692ZINFOcrucible-agent (worker): region files created ok region = d46259b8-5d8d-4caf-b8a5-beb931042183
422024-08-16T04:41:18.692ZINFOcrucible-agent (datafile): region d46259b8-5d8d-4caf-b8a5-beb931042183 state: Requested -> Created
432024-08-16T04:41:18.692ZINFOcrucible-agent (worker): applying SMF actions post create...
442024-08-16T04:41:18.692ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d46259b8-5d8d-4caf-b8a5-beb931042183
452024-08-16T04:41:18.701ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d46259b8-5d8d-4caf-b8a5-beb931042183
462024-08-16T04:41:18.712ZINFOcrucible-agent (worker): creating config property group
472024-08-16T04:41:18.718ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d46259b8-5d8d-4caf-b8a5-beb931042183
482024-08-16T04:41:18.718ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d46259b8-5d8d-4caf-b8a5-beb931042183
492024-08-16T04:41:18.718ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
502024-08-16T04:41:18.718ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
512024-08-16T04:41:18.718ZINFOcrucible-agent (worker): commit
522024-08-16T04:41:18.723ZINFOcrucible-agent (worker): ok!
532024-08-16T04:41:18.731ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139
542024-08-16T04:41:18.731ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
552024-08-16T04:41:18.731ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
562024-08-16T04:41:18.731ZINFOcrucible-agent (worker): reconfig required
572024-08-16T04:41:18.731ZINFOcrucible-agent (worker): using existing config property group
582024-08-16T04:41:18.731ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-da08bbbe-1673-4a0a-ac11-e039a9d3e139
592024-08-16T04:41:18.731ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139
602024-08-16T04:41:18.732ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-08-16T04:41:18.732ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
622024-08-16T04:41:18.732ZINFOcrucible-agent (worker): commit
632024-08-16T04:41:18.750ZINFOcrucible-agent (worker): ok!
642024-08-16T04:41:18.750ZINFOcrucible-agent (worker): SMF ok!
652024-08-16T04:41:18.849ZINFOcrucible-agent (dropshot): request completed latency_us = 768 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52372 req_id = 8bc9fe05-e858-44c1-af8e-e7fb863593a2 response_code = 200 uri = /crucible/0/regions
662024-08-16T04:41:20.081ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52372 req_id = ca83a199-8564-4c7c-b640-951b0d5c22ec response_code = 200 uri = /crucible/0/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139
672024-08-16T04:41:20.087ZINFOcrucible-agent (datafile): path is "/data/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139"
682024-08-16T04:41:20.097ZINFOcrucible-agent (datafile): dataset is oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139
692024-08-16T04:41:20.105ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139@e59028bb-7f16-4e41-80d8-a197ded34d5e
702024-08-16T04:41:20.105ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139", "e59028bb-7f16-4e41-80d8-a197ded34d5e"]
712024-08-16T04:41:20.115ZINFOcrucible-agent (dropshot): request completed latency_us = 31565 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52372 req_id = 214ef70d-bdef-4c90-a1ef-e9266a54eeee response_code = 200 uri = /crucible/0/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139/snapshots/e59028bb-7f16-4e41-80d8-a197ded34d5e
722024-08-16T04:41:20.118ZINFOcrucible-agent (datafile): path is "/data/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139"
732024-08-16T04:41:20.127ZINFOcrucible-agent (datafile): dataset is oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139
742024-08-16T04:41:20.135ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139@e59028bb-7f16-4e41-80d8-a197ded34d5e
752024-08-16T04:41:20.135ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139", "e59028bb-7f16-4e41-80d8-a197ded34d5e"]
762024-08-16T04:41:20.144ZINFOcrucible-agent (datafile): requesting running snapshot da08bbbe-1673-4a0a-ac11-e039a9d3e139-e59028bb-7f16-4e41-80d8-a197ded34d5e state: Requested
772024-08-16T04:41:20.144ZINFOcrucible-agent (worker): applying SMF actions for region da08bbbe-1673-4a0a-ac11-e039a9d3e139 running snapshot e59028bb-7f16-4e41-80d8-a197ded34d5e (state Requested)...
782024-08-16T04:41:20.144ZINFOcrucible-agent (dropshot): request completed latency_us = 25446 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52372 req_id = f276d998-c79d-428b-a16b-87a26cb2a61c response_code = 200 uri = /crucible/0/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139/snapshots/e59028bb-7f16-4e41-80d8-a197ded34d5e/run
792024-08-16T04:41:20.145ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139
802024-08-16T04:41:20.145ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
812024-08-16T04:41:20.145ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
822024-08-16T04:41:20.145ZINFOcrucible-agent (worker): reconfig required
832024-08-16T04:41:20.145ZINFOcrucible-agent (worker): using existing config property group
842024-08-16T04:41:20.146ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-da08bbbe-1673-4a0a-ac11-e039a9d3e139
852024-08-16T04:41:20.146ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139
862024-08-16T04:41:20.146ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
872024-08-16T04:41:20.146ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
882024-08-16T04:41:20.146ZINFOcrucible-agent (worker): commit
892024-08-16T04:41:20.153ZINFOcrucible-agent (worker): ok!
902024-08-16T04:41:20.153ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-da08bbbe-1673-4a0a-ac11-e039a9d3e139-e59028bb-7f16-4e41-80d8-a197ded34d5e
912024-08-16T04:41:20.161ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-da08bbbe-1673-4a0a-ac11-e039a9d3e139-e59028bb-7f16-4e41-80d8-a197ded34d5e
922024-08-16T04:41:20.178ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-da08bbbe-1673-4a0a-ac11-e039a9d3e139-e59028bb-7f16-4e41-80d8-a197ded34d5e
932024-08-16T04:41:20.179ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139/.zfs/snapshot/e59028bb-7f16-4e41-80d8-a197ded34d5e
942024-08-16T04:41:20.179ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
952024-08-16T04:41:20.179ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
962024-08-16T04:41:20.179ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
972024-08-16T04:41:20.179ZINFOcrucible-agent (worker): commit
982024-08-16T04:41:20.186ZINFOcrucible-agent (worker): ok!
992024-08-16T04:41:20.193ZINFOcrucible-agent (worker): SMF ok!
1002024-08-16T04:41:20.193ZINFOcrucible-agent (datafile): region da08bbbe-1673-4a0a-ac11-e039a9d3e139 running snapshot e59028bb-7f16-4e41-80d8-a197ded34d5e state: Requested -> Created
1012024-08-16T04:41:20.323ZINFOcrucible-agent (datafile): path is "/data/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139"
1022024-08-16T04:41:20.331ZINFOcrucible-agent (datafile): dataset is oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139
1032024-08-16T04:41:20.339ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139@e59028bb-7f16-4e41-80d8-a197ded34d5e
1042024-08-16T04:41:20.339ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139", "e59028bb-7f16-4e41-80d8-a197ded34d5e"]
1052024-08-16T04:41:20.347ZINFOcrucible-agent (dropshot): request completed latency_us = 25501 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52372 req_id = 94f4bb05-c93e-4c57-aa30-c35d9a138b76 response_code = 200 uri = /crucible/0/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139/snapshots/e59028bb-7f16-4e41-80d8-a197ded34d5e/run
1062024-08-16T04:41:23.443ZINFOcrucible-agent (datafile): region e434a63c-e176-4e1b-9b60-53581cd85b58 state: Requested
1072024-08-16T04:41:23.443ZINFOcrucible-agent (dropshot): request completed latency_us = 219 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52372 req_id = bafef64c-b257-4eea-bce1-ef69320df268 response_code = 200 uri = /crucible/0/regions
1082024-08-16T04:41:23.443ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1092024-08-16T04:41:23.452ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/e434a63c-e176-4e1b-9b60-53581cd85b58
1102024-08-16T04:41:23.452ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/e434a63c-e176-4e1b-9b60-53581cd85b58
1112024-08-16T04:41:23.509ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e434a63c-e176-4e1b-9b60-53581cd85b58"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e434a63c-e176-4e1b-9b60-53581cd85b58" region = e434a63c-e176-4e1b-9b60-53581cd85b58
1122024-08-16T04:41:23.509ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e434a63c-e176-4e1b-9b60-53581cd85b58" "--data" "/data/regions/e434a63c-e176-4e1b-9b60-53581cd85b58" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e434a63c-e176-4e1b-9b60-53581cd85b58
1132024-08-16T04:41:23.611ZINFOcrucible-agent (worker): region files created ok region = e434a63c-e176-4e1b-9b60-53581cd85b58
1142024-08-16T04:41:23.611ZINFOcrucible-agent (datafile): region e434a63c-e176-4e1b-9b60-53581cd85b58 state: Requested -> Created
1152024-08-16T04:41:23.611ZINFOcrucible-agent (worker): applying SMF actions post create...
1162024-08-16T04:41:23.612ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139
1172024-08-16T04:41:23.612ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1182024-08-16T04:41:23.612ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
1192024-08-16T04:41:23.612ZINFOcrucible-agent (worker): reconfig required
1202024-08-16T04:41:23.612ZINFOcrucible-agent (worker): using existing config property group
1212024-08-16T04:41:23.612ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-da08bbbe-1673-4a0a-ac11-e039a9d3e139
1222024-08-16T04:41:23.613ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139
1232024-08-16T04:41:23.613ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1242024-08-16T04:41:23.613ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
1252024-08-16T04:41:23.613ZINFOcrucible-agent (worker): commit
1262024-08-16T04:41:23.617ZINFOcrucible-agent (worker): ok!
1272024-08-16T04:41:23.617ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e434a63c-e176-4e1b-9b60-53581cd85b58
1282024-08-16T04:41:23.622ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e434a63c-e176-4e1b-9b60-53581cd85b58
1292024-08-16T04:41:23.632ZINFOcrucible-agent (worker): creating config property group
1302024-08-16T04:41:23.635ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e434a63c-e176-4e1b-9b60-53581cd85b58
1312024-08-16T04:41:23.636ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e434a63c-e176-4e1b-9b60-53581cd85b58
1322024-08-16T04:41:23.636ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
1332024-08-16T04:41:23.636ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
1342024-08-16T04:41:23.636ZINFOcrucible-agent (worker): commit
1352024-08-16T04:41:23.640ZINFOcrucible-agent (worker): ok!
1362024-08-16T04:41:23.643ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52372 req_id = 99c56d09-60e1-4dda-9354-01fa5cf2bf94 response_code = 200 uri = /crucible/0/regions
1372024-08-16T04:41:23.654ZINFOcrucible-agent (worker): SMF ok!
1382024-08-16T04:41:57.104ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52372 req_id = f621b406-e1cb-439c-b812-418de189f650 response_code = 200 uri = /crucible/0/regions/e434a63c-e176-4e1b-9b60-53581cd85b58
1392024-08-16T04:41:57.107ZINFOcrucible-agent (datafile): path is "/data/regions/e434a63c-e176-4e1b-9b60-53581cd85b58"
1402024-08-16T04:41:57.117ZINFOcrucible-agent (datafile): dataset is oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/e434a63c-e176-4e1b-9b60-53581cd85b58
1412024-08-16T04:41:57.126ZINFOcrucible-agent (datafile): region e434a63c-e176-4e1b-9b60-53581cd85b58 state: Created -> Tombstoned
1422024-08-16T04:41:57.126ZINFOcrucible-agent (worker): applying SMF actions before removal...
1432024-08-16T04:41:57.126ZINFOcrucible-agent (dropshot): request completed latency_us = 19003 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:52372 req_id = be7ec82d-f13e-44a0-8a32-642512610df1 response_code = 204 uri = /crucible/0/regions/e434a63c-e176-4e1b-9b60-53581cd85b58
1442024-08-16T04:41:57.127ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e434a63c-e176-4e1b-9b60-53581cd85b58 (instance states: (Some(Online), None))
1452024-08-16T04:41:57.129ZINFOcrucible-agent (dropshot): request completed latency_us = 23 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52372 req_id = 4574b9de-e391-43fc-84f2-a754adaaaffb response_code = 200 uri = /crucible/0/regions/e434a63c-e176-4e1b-9b60-53581cd85b58
1462024-08-16T04:41:57.133ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139
1472024-08-16T04:41:57.133ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1482024-08-16T04:41:57.133ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
1492024-08-16T04:41:57.133ZINFOcrucible-agent (worker): reconfig required
1502024-08-16T04:41:57.133ZINFOcrucible-agent (worker): using existing config property group
1512024-08-16T04:41:57.133ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-da08bbbe-1673-4a0a-ac11-e039a9d3e139
1522024-08-16T04:41:57.134ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/da08bbbe-1673-4a0a-ac11-e039a9d3e139
1532024-08-16T04:41:57.134ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1542024-08-16T04:41:57.134ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
1552024-08-16T04:41:57.134ZINFOcrucible-agent (worker): commit
1562024-08-16T04:41:57.138ZINFOcrucible-agent (worker): ok!
1572024-08-16T04:41:57.140ZINFOcrucible-agent (worker): SMF ok!
1582024-08-16T04:41:57.150ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_0755d67c-86c1-459a-823f-cb31dd590c5a/crucible/regions/e434a63c-e176-4e1b-9b60-53581cd85b58" region = e434a63c-e176-4e1b-9b60-53581cd85b58
1592024-08-16T04:41:57.199ZINFOcrucible-agent (datafile): region e434a63c-e176-4e1b-9b60-53581cd85b58 state: Tombstoned -> Destroyed
1602024-08-16T04:41:57.233ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52372 req_id = d8b0ea20-592a-469c-802b-2e848e645e06 response_code = 200 uri = /crucible/0/regions/e434a63c-e176-4e1b-9b60-53581cd85b58