Max level shown:
1 [ Aug 16 05:47:29 Enabled. ]
2 [ Aug 16 05:47:29 Rereading configuration. ]
3 [ Aug 16 05:47:31 Rereading configuration. ]
4 [ Aug 16 05:47:33 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-08-16T05:47:33.789ZINFOcrucible-agent: dataset: "oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible"
72024-08-16T05:47:33.790ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
82024-08-16T05:47:33.790ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-08-16T05:47:33.809ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-08-16T05:47:33.954ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
112024-08-16T05:48:51.123ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:34913
122024-08-16T05:48:51.147ZINFOcrucible-agent (datafile): region 82efeab4-c4a6-4792-87b4-53a7a97e54e0 state: Requested
132024-08-16T05:48:51.152ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142024-08-16T05:48:51.156ZINFOcrucible-agent (dropshot): request completed latency_us = 16596 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34913 req_id = d53398dc-caa2-41d8-b6f6-12f0091c0bb1 response_code = 200 uri = /crucible/0/regions
152024-08-16T05:48:51.163ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0
162024-08-16T05:48:51.163ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0
172024-08-16T05:48:51.216ZINFOcrucible-agent (worker): creating region Region { id: RegionId("82efeab4-c4a6-4792-87b4-53a7a97e54e0"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0" region = 82efeab4-c4a6-4792-87b4-53a7a97e54e0
182024-08-16T05:48:51.218ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "82efeab4-c4a6-4792-87b4-53a7a97e54e0" "--data" "/data/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 82efeab4-c4a6-4792-87b4-53a7a97e54e0
192024-08-16T05:48:51.306ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34913 req_id = 53ab05b0-1a18-475c-91e7-81439f63e464 response_code = 200 uri = /crucible/0/regions
202024-08-16T05:48:51.359ZINFOcrucible-agent (worker): region files created ok region = 82efeab4-c4a6-4792-87b4-53a7a97e54e0
212024-08-16T05:48:51.359ZINFOcrucible-agent (datafile): region 82efeab4-c4a6-4792-87b4-53a7a97e54e0 state: Requested -> Created
222024-08-16T05:48:51.359ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-08-16T05:48:51.359ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-82efeab4-c4a6-4792-87b4-53a7a97e54e0
242024-08-16T05:48:51.364ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-82efeab4-c4a6-4792-87b4-53a7a97e54e0
252024-08-16T05:48:51.381ZINFOcrucible-agent (worker): creating config property group
262024-08-16T05:48:51.384ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-82efeab4-c4a6-4792-87b4-53a7a97e54e0
272024-08-16T05:48:51.392ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0
282024-08-16T05:48:51.394ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-08-16T05:48:51.394ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
302024-08-16T05:48:51.394ZINFOcrucible-agent (worker): commit
312024-08-16T05:48:51.401ZINFOcrucible-agent (worker): ok!
322024-08-16T05:48:51.405ZINFOcrucible-agent (worker): SMF ok!
332024-08-16T05:48:51.865ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34913 req_id = cf22885d-b353-4dec-9bd5-1f9088514214 response_code = 200 uri = /crucible/0/regions
342024-08-16T05:54:08.101ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:42009
352024-08-16T05:54:08.101ZINFOcrucible-agent (datafile): region 89bf90f5-6ed4-47c5-9327-8e23d96e9114 state: Requested
362024-08-16T05:54:08.102ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
372024-08-16T05:54:08.102ZINFOcrucible-agent (dropshot): request completed latency_us = 837 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42009 req_id = fc0d2393-4c26-410a-9951-093cb95fb32c response_code = 200 uri = /crucible/0/regions
382024-08-16T05:54:08.112ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/89bf90f5-6ed4-47c5-9327-8e23d96e9114
392024-08-16T05:54:08.112ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/89bf90f5-6ed4-47c5-9327-8e23d96e9114
402024-08-16T05:54:08.175ZINFOcrucible-agent (worker): creating region Region { id: RegionId("89bf90f5-6ed4-47c5-9327-8e23d96e9114"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/89bf90f5-6ed4-47c5-9327-8e23d96e9114" region = 89bf90f5-6ed4-47c5-9327-8e23d96e9114
412024-08-16T05:54:08.177ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "89bf90f5-6ed4-47c5-9327-8e23d96e9114" "--data" "/data/regions/89bf90f5-6ed4-47c5-9327-8e23d96e9114" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 89bf90f5-6ed4-47c5-9327-8e23d96e9114
422024-08-16T05:54:08.280ZINFOcrucible-agent (worker): region files created ok region = 89bf90f5-6ed4-47c5-9327-8e23d96e9114
432024-08-16T05:54:08.280ZINFOcrucible-agent (datafile): region 89bf90f5-6ed4-47c5-9327-8e23d96e9114 state: Requested -> Created
442024-08-16T05:54:08.280ZINFOcrucible-agent (worker): applying SMF actions post create...
452024-08-16T05:54:08.286ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0
462024-08-16T05:54:08.286ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
472024-08-16T05:54:08.286ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
482024-08-16T05:54:08.286ZINFOcrucible-agent (worker): reconfig required
492024-08-16T05:54:08.286ZINFOcrucible-agent (worker): using existing config property group
502024-08-16T05:54:08.286ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-82efeab4-c4a6-4792-87b4-53a7a97e54e0
512024-08-16T05:54:08.286ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0
522024-08-16T05:54:08.286ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
532024-08-16T05:54:08.286ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
542024-08-16T05:54:08.286ZINFOcrucible-agent (worker): commit
552024-08-16T05:54:08.292ZINFOcrucible-agent (worker): ok!
562024-08-16T05:54:08.293ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-89bf90f5-6ed4-47c5-9327-8e23d96e9114
572024-08-16T05:54:08.296ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-89bf90f5-6ed4-47c5-9327-8e23d96e9114
582024-08-16T05:54:08.303ZINFOcrucible-agent (worker): creating config property group
592024-08-16T05:54:08.306ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-89bf90f5-6ed4-47c5-9327-8e23d96e9114
602024-08-16T05:54:08.307ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/89bf90f5-6ed4-47c5-9327-8e23d96e9114
612024-08-16T05:54:08.307ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
622024-08-16T05:54:08.307ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
632024-08-16T05:54:08.307ZINFOcrucible-agent (worker): commit
642024-08-16T05:54:08.311ZINFOcrucible-agent (worker): ok!
652024-08-16T05:54:08.315ZINFOcrucible-agent (worker): SMF ok!
662024-08-16T05:54:08.320ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42009 req_id = fdae3ec9-391e-427c-a28a-3f114e710e39 response_code = 200 uri = /crucible/0/regions
672024-08-16T05:54:10.189ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42009 req_id = 9ef969ae-e8b6-42ae-bc67-d36e46912679 response_code = 200 uri = /crucible/0/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0
682024-08-16T05:54:10.194ZINFOcrucible-agent (datafile): path is "/data/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0"
692024-08-16T05:54:10.204ZINFOcrucible-agent (datafile): dataset is oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0
702024-08-16T05:54:10.213ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0@aad67429-2c23-4990-8bea-62e98cb52dba
712024-08-16T05:54:10.213ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0", "aad67429-2c23-4990-8bea-62e98cb52dba"]
722024-08-16T05:54:10.228ZINFOcrucible-agent (dropshot): request completed latency_us = 36741 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42009 req_id = 7b23cf65-c60e-4ec7-8827-8114fda1710e response_code = 200 uri = /crucible/0/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0/snapshots/aad67429-2c23-4990-8bea-62e98cb52dba
732024-08-16T05:54:10.232ZINFOcrucible-agent (datafile): path is "/data/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0"
742024-08-16T05:54:10.243ZINFOcrucible-agent (datafile): dataset is oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0
752024-08-16T05:54:10.254ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0@aad67429-2c23-4990-8bea-62e98cb52dba
762024-08-16T05:54:10.254ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0", "aad67429-2c23-4990-8bea-62e98cb52dba"]
772024-08-16T05:54:10.266ZINFOcrucible-agent (datafile): requesting running snapshot 82efeab4-c4a6-4792-87b4-53a7a97e54e0-aad67429-2c23-4990-8bea-62e98cb52dba state: Requested
782024-08-16T05:54:10.266ZINFOcrucible-agent (worker): applying SMF actions for region 82efeab4-c4a6-4792-87b4-53a7a97e54e0 running snapshot aad67429-2c23-4990-8bea-62e98cb52dba (state Requested)...
792024-08-16T05:54:10.266ZINFOcrucible-agent (dropshot): request completed latency_us = 34521 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42009 req_id = 20bac433-8c37-4b5a-8a74-c74a1947b38f response_code = 200 uri = /crucible/0/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0/snapshots/aad67429-2c23-4990-8bea-62e98cb52dba/run
802024-08-16T05:54:10.267ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0
812024-08-16T05:54:10.267ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
822024-08-16T05:54:10.267ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
832024-08-16T05:54:10.267ZINFOcrucible-agent (worker): reconfig required
842024-08-16T05:54:10.267ZINFOcrucible-agent (worker): using existing config property group
852024-08-16T05:54:10.267ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-82efeab4-c4a6-4792-87b4-53a7a97e54e0
862024-08-16T05:54:10.268ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0
872024-08-16T05:54:10.268ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
882024-08-16T05:54:10.268ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
892024-08-16T05:54:10.268ZINFOcrucible-agent (worker): commit
902024-08-16T05:54:10.273ZINFOcrucible-agent (worker): ok!
912024-08-16T05:54:10.276ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-82efeab4-c4a6-4792-87b4-53a7a97e54e0-aad67429-2c23-4990-8bea-62e98cb52dba
922024-08-16T05:54:10.284ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-82efeab4-c4a6-4792-87b4-53a7a97e54e0-aad67429-2c23-4990-8bea-62e98cb52dba
932024-08-16T05:54:10.296ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-82efeab4-c4a6-4792-87b4-53a7a97e54e0-aad67429-2c23-4990-8bea-62e98cb52dba
942024-08-16T05:54:10.297ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0/.zfs/snapshot/aad67429-2c23-4990-8bea-62e98cb52dba
952024-08-16T05:54:10.297ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
962024-08-16T05:54:10.297ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
972024-08-16T05:54:10.297ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
982024-08-16T05:54:10.297ZINFOcrucible-agent (worker): commit
992024-08-16T05:54:10.302ZINFOcrucible-agent (worker): ok!
1002024-08-16T05:54:10.308ZINFOcrucible-agent (worker): SMF ok!
1012024-08-16T05:54:10.308ZINFOcrucible-agent (datafile): region 82efeab4-c4a6-4792-87b4-53a7a97e54e0 running snapshot aad67429-2c23-4990-8bea-62e98cb52dba state: Requested -> Created
1022024-08-16T05:54:10.566ZINFOcrucible-agent (datafile): path is "/data/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0"
1032024-08-16T05:54:10.575ZINFOcrucible-agent (datafile): dataset is oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0
1042024-08-16T05:54:10.583ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0@aad67429-2c23-4990-8bea-62e98cb52dba
1052024-08-16T05:54:10.583ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0", "aad67429-2c23-4990-8bea-62e98cb52dba"]
1062024-08-16T05:54:10.591ZINFOcrucible-agent (dropshot): request completed latency_us = 24782 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42009 req_id = f9f6f0cb-9689-402b-b24a-8efe738a2406 response_code = 200 uri = /crucible/0/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0/snapshots/aad67429-2c23-4990-8bea-62e98cb52dba/run
1072024-08-16T05:54:13.605ZINFOcrucible-agent (datafile): region 32c6619c-4b96-4888-ab95-9b6dee21583d state: Requested
1082024-08-16T05:54:13.605ZINFOcrucible-agent (dropshot): request completed latency_us = 213 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42009 req_id = 4663b9b8-1796-422f-8b4f-15bdc77de6b1 response_code = 200 uri = /crucible/0/regions
1092024-08-16T05:54:13.605ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1102024-08-16T05:54:13.613ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/32c6619c-4b96-4888-ab95-9b6dee21583d
1112024-08-16T05:54:13.613ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/32c6619c-4b96-4888-ab95-9b6dee21583d
1122024-08-16T05:54:13.666ZINFOcrucible-agent (worker): creating region Region { id: RegionId("32c6619c-4b96-4888-ab95-9b6dee21583d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/32c6619c-4b96-4888-ab95-9b6dee21583d" region = 32c6619c-4b96-4888-ab95-9b6dee21583d
1132024-08-16T05:54:13.667ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "32c6619c-4b96-4888-ab95-9b6dee21583d" "--data" "/data/regions/32c6619c-4b96-4888-ab95-9b6dee21583d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 32c6619c-4b96-4888-ab95-9b6dee21583d
1142024-08-16T05:54:13.750ZINFOcrucible-agent (worker): region files created ok region = 32c6619c-4b96-4888-ab95-9b6dee21583d
1152024-08-16T05:54:13.751ZINFOcrucible-agent (datafile): region 32c6619c-4b96-4888-ab95-9b6dee21583d state: Requested -> Created
1162024-08-16T05:54:13.751ZINFOcrucible-agent (worker): applying SMF actions post create...
1172024-08-16T05:54:13.751ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-32c6619c-4b96-4888-ab95-9b6dee21583d
1182024-08-16T05:54:13.757ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-32c6619c-4b96-4888-ab95-9b6dee21583d
1192024-08-16T05:54:13.765ZINFOcrucible-agent (worker): creating config property group
1202024-08-16T05:54:13.769ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-32c6619c-4b96-4888-ab95-9b6dee21583d
1212024-08-16T05:54:13.769ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/32c6619c-4b96-4888-ab95-9b6dee21583d
1222024-08-16T05:54:13.769ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
1232024-08-16T05:54:13.769ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
1242024-08-16T05:54:13.769ZINFOcrucible-agent (worker): commit
1252024-08-16T05:54:13.773ZINFOcrucible-agent (worker): ok!
1262024-08-16T05:54:13.778ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0
1272024-08-16T05:54:13.778ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1282024-08-16T05:54:13.778ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
1292024-08-16T05:54:13.778ZINFOcrucible-agent (worker): reconfig required
1302024-08-16T05:54:13.778ZINFOcrucible-agent (worker): using existing config property group
1312024-08-16T05:54:13.778ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-82efeab4-c4a6-4792-87b4-53a7a97e54e0
1322024-08-16T05:54:13.783ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0
1332024-08-16T05:54:13.783ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1342024-08-16T05:54:13.783ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
1352024-08-16T05:54:13.783ZINFOcrucible-agent (worker): commit
1362024-08-16T05:54:13.787ZINFOcrucible-agent (worker): ok!
1372024-08-16T05:54:13.789ZINFOcrucible-agent (worker): SMF ok!
1382024-08-16T05:54:13.822ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42009 req_id = 0d74141f-9b8f-467b-8394-3645071c346d response_code = 200 uri = /crucible/0/regions
1392024-08-16T05:54:37.529ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42009 req_id = 9adcd01e-7f39-46e5-959f-442267fdd4fa response_code = 200 uri = /crucible/0/regions/32c6619c-4b96-4888-ab95-9b6dee21583d
1402024-08-16T05:54:37.532ZINFOcrucible-agent (datafile): path is "/data/regions/32c6619c-4b96-4888-ab95-9b6dee21583d"
1412024-08-16T05:54:37.543ZINFOcrucible-agent (datafile): dataset is oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/32c6619c-4b96-4888-ab95-9b6dee21583d
1422024-08-16T05:54:37.552ZINFOcrucible-agent (datafile): region 32c6619c-4b96-4888-ab95-9b6dee21583d state: Created -> Tombstoned
1432024-08-16T05:54:37.552ZINFOcrucible-agent (worker): applying SMF actions before removal...
1442024-08-16T05:54:37.552ZINFOcrucible-agent (dropshot): request completed latency_us = 20188 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:42009 req_id = a863ba53-7156-47a9-8aac-1bcda0be947f response_code = 204 uri = /crucible/0/regions/32c6619c-4b96-4888-ab95-9b6dee21583d
1452024-08-16T05:54:37.553ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-32c6619c-4b96-4888-ab95-9b6dee21583d (instance states: (Some(Online), None))
1462024-08-16T05:54:37.555ZINFOcrucible-agent (dropshot): request completed latency_us = 23 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42009 req_id = a252dcf0-7d52-4b9b-aaff-ce60a651cda6 response_code = 200 uri = /crucible/0/regions/32c6619c-4b96-4888-ab95-9b6dee21583d
1472024-08-16T05:54:37.558ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0
1482024-08-16T05:54:37.558ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1492024-08-16T05:54:37.558ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
1502024-08-16T05:54:37.558ZINFOcrucible-agent (worker): reconfig required
1512024-08-16T05:54:37.558ZINFOcrucible-agent (worker): using existing config property group
1522024-08-16T05:54:37.558ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-82efeab4-c4a6-4792-87b4-53a7a97e54e0
1532024-08-16T05:54:37.559ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/82efeab4-c4a6-4792-87b4-53a7a97e54e0
1542024-08-16T05:54:37.559ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1552024-08-16T05:54:37.559ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
1562024-08-16T05:54:37.559ZINFOcrucible-agent (worker): commit
1572024-08-16T05:54:37.563ZINFOcrucible-agent (worker): ok!
1582024-08-16T05:54:37.565ZINFOcrucible-agent (worker): SMF ok!
1592024-08-16T05:54:37.574ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_1bc1aa50-0f37-447e-9805-f7a390b81c5d/crucible/regions/32c6619c-4b96-4888-ab95-9b6dee21583d" region = 32c6619c-4b96-4888-ab95-9b6dee21583d
1602024-08-16T05:54:37.623ZINFOcrucible-agent (datafile): region 32c6619c-4b96-4888-ab95-9b6dee21583d state: Tombstoned -> Destroyed
1612024-08-16T05:54:37.708ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42009 req_id = b1e59c42-8088-496f-9d92-0613555c77e4 response_code = 200 uri = /crucible/0/regions/32c6619c-4b96-4888-ab95-9b6dee21583d