Max level shown:
1 [ Aug 3 04:36:44 Enabled. ]
2 [ Aug 3 04:36:44 Rereading configuration. ]
3 [ Aug 3 04:36:50 Rereading configuration. ]
4 [ Aug 3 04:36:54 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible -l [fd00:1122:3344:101::1a]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-08-03T04:36:54.131ZINFOcrucible-agent: dataset: "oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible"
72024-08-03T04:36:54.132ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::1a]:32345
82024-08-03T04:36:54.132ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-08-03T04:36:54.153ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-08-03T04:36:54.299ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::1a]:32345
112024-08-03T04:38:09.408ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:54141
122024-08-03T04:38:09.436ZINFOcrucible-agent (datafile): region e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8 state: Requested
132024-08-03T04:38:09.444ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142024-08-03T04:38:09.448ZINFOcrucible-agent (dropshot): request completed latency_us = 19205 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54141 req_id = 1bd3059a-c5b3-4b67-8c18-ae36b81a0b8c response_code = 200 uri = /crucible/0/regions
152024-08-03T04:38:09.455ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
162024-08-03T04:38:09.455ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
172024-08-03T04:38:09.511ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8" region = e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
182024-08-03T04:38:09.513ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8" "--data" "/data/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
192024-08-03T04:38:09.601ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54141 req_id = 646642de-d90f-4b79-b3e8-bae1cfc6b37c response_code = 200 uri = /crucible/0/regions
202024-08-03T04:38:09.824ZINFOcrucible-agent (worker): region files created ok region = e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
212024-08-03T04:38:09.824ZINFOcrucible-agent (datafile): region e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8 state: Requested -> Created
222024-08-03T04:38:09.824ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-08-03T04:38:09.825ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
242024-08-03T04:38:09.830ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
252024-08-03T04:38:09.847ZINFOcrucible-agent (worker): creating config property group
262024-08-03T04:38:09.857ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
272024-08-03T04:38:09.860ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
282024-08-03T04:38:09.862ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-08-03T04:38:09.862ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
302024-08-03T04:38:09.862ZINFOcrucible-agent (worker): commit
312024-08-03T04:38:09.867ZINFOcrucible-agent (worker): ok!
322024-08-03T04:38:09.871ZINFOcrucible-agent (worker): SMF ok!
332024-08-03T04:38:10.246ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54141 req_id = ba0ce726-b76b-4e5d-8957-9bf9be223c09 response_code = 200 uri = /crucible/0/regions
342024-08-03T04:43:37.035ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:55744
352024-08-03T04:43:37.035ZINFOcrucible-agent (datafile): region 534b0b61-ebb3-467a-a154-9158f9afad9a state: Requested
362024-08-03T04:43:37.036ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
372024-08-03T04:43:37.036ZINFOcrucible-agent (dropshot): request completed latency_us = 740 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55744 req_id = 3880ea7d-ed04-4deb-be75-2243d4919439 response_code = 200 uri = /crucible/0/regions
382024-08-03T04:43:37.047ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible/regions/534b0b61-ebb3-467a-a154-9158f9afad9a
392024-08-03T04:43:37.047ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible/regions/534b0b61-ebb3-467a-a154-9158f9afad9a
402024-08-03T04:43:37.114ZINFOcrucible-agent (worker): creating region Region { id: RegionId("534b0b61-ebb3-467a-a154-9158f9afad9a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/534b0b61-ebb3-467a-a154-9158f9afad9a" region = 534b0b61-ebb3-467a-a154-9158f9afad9a
412024-08-03T04:43:37.114ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "534b0b61-ebb3-467a-a154-9158f9afad9a" "--data" "/data/regions/534b0b61-ebb3-467a-a154-9158f9afad9a" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 534b0b61-ebb3-467a-a154-9158f9afad9a
422024-08-03T04:43:37.194ZINFOcrucible-agent (worker): region files created ok region = 534b0b61-ebb3-467a-a154-9158f9afad9a
432024-08-03T04:43:37.194ZINFOcrucible-agent (datafile): region 534b0b61-ebb3-467a-a154-9158f9afad9a state: Requested -> Created
442024-08-03T04:43:37.194ZINFOcrucible-agent (worker): applying SMF actions post create...
452024-08-03T04:43:37.195ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-534b0b61-ebb3-467a-a154-9158f9afad9a
462024-08-03T04:43:37.200ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-534b0b61-ebb3-467a-a154-9158f9afad9a
472024-08-03T04:43:37.215ZINFOcrucible-agent (worker): creating config property group
482024-08-03T04:43:37.222ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-534b0b61-ebb3-467a-a154-9158f9afad9a
492024-08-03T04:43:37.222ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/534b0b61-ebb3-467a-a154-9158f9afad9a
502024-08-03T04:43:37.222ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
512024-08-03T04:43:37.222ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
522024-08-03T04:43:37.222ZINFOcrucible-agent (worker): commit
532024-08-03T04:43:37.228ZINFOcrucible-agent (worker): ok!
542024-08-03T04:43:37.234ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
552024-08-03T04:43:37.234ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
562024-08-03T04:43:37.234ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::1a
572024-08-03T04:43:37.234ZINFOcrucible-agent (worker): reconfig required
582024-08-03T04:43:37.234ZINFOcrucible-agent (worker): using existing config property group
592024-08-03T04:43:37.234ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
602024-08-03T04:43:37.234ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
612024-08-03T04:43:37.234ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622024-08-03T04:43:37.234ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
632024-08-03T04:43:37.234ZINFOcrucible-agent (worker): commit
642024-08-03T04:43:37.237ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55744 req_id = 11b9f1a0-a829-48ac-991f-7205d4fec05b response_code = 200 uri = /crucible/0/regions
652024-08-03T04:43:37.245ZINFOcrucible-agent (worker): ok!
662024-08-03T04:43:37.246ZINFOcrucible-agent (worker): SMF ok!
672024-08-03T04:43:37.739ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:45007
682024-08-03T04:43:37.739ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45007 req_id = 1615c0cd-76f8-468f-8adc-6af8a334f193 response_code = 200 uri = /crucible/0/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
692024-08-03T04:43:37.742ZINFOcrucible-agent (datafile): path is "/data/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8"
702024-08-03T04:43:37.752ZINFOcrucible-agent (datafile): dataset is oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
712024-08-03T04:43:37.761ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8@b65cb9c8-ff1b-4ef9-a79a-705765fb831b
722024-08-03T04:43:37.761ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8", "b65cb9c8-ff1b-4ef9-a79a-705765fb831b"]
732024-08-03T04:43:37.773ZINFOcrucible-agent (dropshot): request completed latency_us = 33860 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45007 req_id = 55818e76-af2b-469f-9a53-296d32f03279 response_code = 200 uri = /crucible/0/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8/snapshots/b65cb9c8-ff1b-4ef9-a79a-705765fb831b
742024-08-03T04:43:37.773ZINFOcrucible-agent (datafile): path is "/data/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8"
752024-08-03T04:43:37.782ZINFOcrucible-agent (datafile): dataset is oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
762024-08-03T04:43:37.790ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8@b65cb9c8-ff1b-4ef9-a79a-705765fb831b
772024-08-03T04:43:37.790ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8", "b65cb9c8-ff1b-4ef9-a79a-705765fb831b"]
782024-08-03T04:43:37.798ZINFOcrucible-agent (datafile): requesting running snapshot e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8-b65cb9c8-ff1b-4ef9-a79a-705765fb831b state: Requested
792024-08-03T04:43:37.799ZINFOcrucible-agent (worker): applying SMF actions for region e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8 running snapshot b65cb9c8-ff1b-4ef9-a79a-705765fb831b (state Requested)...
802024-08-03T04:43:37.799ZINFOcrucible-agent (dropshot): request completed latency_us = 25788 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45007 req_id = 68b513a2-8b5f-48fe-a098-6e03ee12dfce response_code = 200 uri = /crucible/0/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8/snapshots/b65cb9c8-ff1b-4ef9-a79a-705765fb831b/run
812024-08-03T04:43:37.800ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
822024-08-03T04:43:37.800ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
832024-08-03T04:43:37.801ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::1a
842024-08-03T04:43:37.801ZINFOcrucible-agent (worker): reconfig required
852024-08-03T04:43:37.801ZINFOcrucible-agent (worker): using existing config property group
862024-08-03T04:43:37.801ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
872024-08-03T04:43:37.801ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
882024-08-03T04:43:37.801ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
892024-08-03T04:43:37.801ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
902024-08-03T04:43:37.801ZINFOcrucible-agent (worker): commit
912024-08-03T04:43:37.806ZINFOcrucible-agent (worker): ok!
922024-08-03T04:43:37.806ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8-b65cb9c8-ff1b-4ef9-a79a-705765fb831b
932024-08-03T04:43:37.816ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8-b65cb9c8-ff1b-4ef9-a79a-705765fb831b
942024-08-03T04:43:37.828ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8-b65cb9c8-ff1b-4ef9-a79a-705765fb831b
952024-08-03T04:43:37.828ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8/.zfs/snapshot/b65cb9c8-ff1b-4ef9-a79a-705765fb831b
962024-08-03T04:43:37.828ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
972024-08-03T04:43:37.828ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
982024-08-03T04:43:37.828ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
992024-08-03T04:43:37.828ZINFOcrucible-agent (worker): commit
1002024-08-03T04:43:37.834ZINFOcrucible-agent (worker): ok!
1012024-08-03T04:43:37.843ZINFOcrucible-agent (worker): SMF ok!
1022024-08-03T04:43:37.843ZINFOcrucible-agent (datafile): region e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8 running snapshot b65cb9c8-ff1b-4ef9-a79a-705765fb831b state: Requested -> Created
1032024-08-03T04:43:41.219ZINFOcrucible-agent (datafile): region 5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79 state: Requested
1042024-08-03T04:43:41.219ZINFOcrucible-agent (dropshot): request completed latency_us = 205 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55744 req_id = 4bf3d85c-4a50-410f-92d9-7aee01ac697c response_code = 200 uri = /crucible/0/regions
1052024-08-03T04:43:41.219ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1062024-08-03T04:43:41.228ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible/regions/5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79
1072024-08-03T04:43:41.228ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible/regions/5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79
1082024-08-03T04:43:41.284ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79" region = 5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79
1092024-08-03T04:43:41.284ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79" "--data" "/data/regions/5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79
1102024-08-03T04:43:41.357ZINFOcrucible-agent (worker): region files created ok region = 5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79
1112024-08-03T04:43:41.357ZINFOcrucible-agent (datafile): region 5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79 state: Requested -> Created
1122024-08-03T04:43:41.357ZINFOcrucible-agent (worker): applying SMF actions post create...
1132024-08-03T04:43:41.358ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79
1142024-08-03T04:43:41.362ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79
1152024-08-03T04:43:41.370ZINFOcrucible-agent (worker): creating config property group
1162024-08-03T04:43:41.373ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79
1172024-08-03T04:43:41.374ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79
1182024-08-03T04:43:41.374ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
1192024-08-03T04:43:41.374ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
1202024-08-03T04:43:41.374ZINFOcrucible-agent (worker): commit
1212024-08-03T04:43:41.378ZINFOcrucible-agent (worker): ok!
1222024-08-03T04:43:41.384ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
1232024-08-03T04:43:41.384ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1242024-08-03T04:43:41.384ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::1a
1252024-08-03T04:43:41.384ZINFOcrucible-agent (worker): reconfig required
1262024-08-03T04:43:41.384ZINFOcrucible-agent (worker): using existing config property group
1272024-08-03T04:43:41.384ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
1282024-08-03T04:43:41.389ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
1292024-08-03T04:43:41.389ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1302024-08-03T04:43:41.389ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
1312024-08-03T04:43:41.389ZINFOcrucible-agent (worker): commit
1322024-08-03T04:43:41.392ZINFOcrucible-agent (worker): ok!
1332024-08-03T04:43:41.394ZINFOcrucible-agent (worker): SMF ok!
1342024-08-03T04:43:41.575ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55744 req_id = 766a04c7-ab31-48fd-8324-d37dd69c3118 response_code = 200 uri = /crucible/0/regions
1352024-08-03T04:44:06.158ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55744 req_id = 61b66b23-0a96-46b3-a40d-60e3dd65b48a response_code = 200 uri = /crucible/0/regions/5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79
1362024-08-03T04:44:06.160ZINFOcrucible-agent (datafile): path is "/data/regions/5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79"
1372024-08-03T04:44:06.172ZINFOcrucible-agent (datafile): dataset is oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible/regions/5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79
1382024-08-03T04:44:06.181ZINFOcrucible-agent (datafile): region 5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79 state: Created -> Tombstoned
1392024-08-03T04:44:06.182ZINFOcrucible-agent (worker): applying SMF actions before removal...
1402024-08-03T04:44:06.182ZINFOcrucible-agent (dropshot): request completed latency_us = 21453 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:55744 req_id = 9d3a672c-e390-4a4d-9b2e-133d0abab4d3 response_code = 204 uri = /crucible/0/regions/5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79
1412024-08-03T04:44:06.183ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79 (instance states: (Some(Online), None))
1422024-08-03T04:44:06.185ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55744 req_id = 8f1cf0b7-e480-486e-9b6a-d9e57e5bbda7 response_code = 200 uri = /crucible/0/regions/5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79
1432024-08-03T04:44:06.189ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
1442024-08-03T04:44:06.189ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1452024-08-03T04:44:06.189ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::1a
1462024-08-03T04:44:06.189ZINFOcrucible-agent (worker): reconfig required
1472024-08-03T04:44:06.189ZINFOcrucible-agent (worker): using existing config property group
1482024-08-03T04:44:06.189ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
1492024-08-03T04:44:06.190ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e5e45ede-9f3e-4578-9bc0-2ed90f1d0ea8
1502024-08-03T04:44:06.190ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1512024-08-03T04:44:06.190ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
1522024-08-03T04:44:06.190ZINFOcrucible-agent (worker): commit
1532024-08-03T04:44:06.195ZINFOcrucible-agent (worker): ok!
1542024-08-03T04:44:06.196ZINFOcrucible-agent (worker): SMF ok!
1552024-08-03T04:44:06.206ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible/regions/5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79" region = 5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79
1562024-08-03T04:44:06.258ZINFOcrucible-agent (datafile): region 5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79 state: Tombstoned -> Destroyed
1572024-08-03T04:44:06.265ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55744 req_id = bc987019-d22e-4e03-ba0a-155062c8f6e4 response_code = 200 uri = /crucible/0/regions/5b7a0ca7-c1c3-4df3-93a3-01fa5de5ef79