Max level shown:
1 [ Dec 13 23:00:09 Enabled. ]
2 [ Dec 13 23:00:09 Rereading configuration. ]
3 [ Dec 13 23:00:15 Rereading configuration. ]
4 [ Dec 13 23:00:20 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-12-13T23:00:20.343ZINFOcrucible-agent: dataset: "oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible"
72024-12-13T23:00:20.349ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
82024-12-13T23:00:20.349ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-12-13T23:00:20.363ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-12-13T23:00:20.484ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
112024-12-13T23:01:05.469ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:51310
122024-12-13T23:01:05.502ZINFOcrucible-agent (datafile): region cf374909-1e83-4b54-9237-49e962f73746 state: Requested
132024-12-13T23:01:05.507ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142024-12-13T23:01:05.512ZINFOcrucible-agent (dropshot): request completed latency_us = 12685 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51310 req_id = 69a9a567-69c7-4d50-8951-73156a94a16b response_code = 200 uri = /crucible/0/regions
152024-12-13T23:01:05.520ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/cf374909-1e83-4b54-9237-49e962f73746
162024-12-13T23:01:05.520ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/cf374909-1e83-4b54-9237-49e962f73746
172024-12-13T23:01:05.583ZINFOcrucible-agent (worker): creating region Region { id: RegionId("cf374909-1e83-4b54-9237-49e962f73746"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/cf374909-1e83-4b54-9237-49e962f73746" region = cf374909-1e83-4b54-9237-49e962f73746
182024-12-13T23:01:05.585ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "cf374909-1e83-4b54-9237-49e962f73746" "--data" "/data/regions/cf374909-1e83-4b54-9237-49e962f73746" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = cf374909-1e83-4b54-9237-49e962f73746
192024-12-13T23:01:05.756ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51310 req_id = 0658e2f5-eeea-4344-bc61-2febf5f2f78d response_code = 200 uri = /crucible/0/regions
202024-12-13T23:01:05.910ZINFOcrucible-agent (worker): region files created ok region = cf374909-1e83-4b54-9237-49e962f73746
212024-12-13T23:01:05.910ZINFOcrucible-agent (datafile): region cf374909-1e83-4b54-9237-49e962f73746 state: Requested -> Created
222024-12-13T23:01:05.910ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-12-13T23:01:05.910ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-cf374909-1e83-4b54-9237-49e962f73746
242024-12-13T23:01:05.916ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-cf374909-1e83-4b54-9237-49e962f73746
252024-12-13T23:01:05.934ZINFOcrucible-agent (worker): creating config property group
262024-12-13T23:01:05.939ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-cf374909-1e83-4b54-9237-49e962f73746
272024-12-13T23:01:05.939ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cf374909-1e83-4b54-9237-49e962f73746
282024-12-13T23:01:05.940ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-12-13T23:01:05.940ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
302024-12-13T23:01:05.940ZINFOcrucible-agent (worker): commit
312024-12-13T23:01:05.947ZINFOcrucible-agent (worker): ok!
322024-12-13T23:01:05.954ZINFOcrucible-agent (worker): SMF ok!
332024-12-13T23:01:06.356ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51310 req_id = eae57265-2a6a-4b54-978e-cdcac218449b response_code = 200 uri = /crucible/0/regions
342024-12-13T23:11:08.953ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:54308
352024-12-13T23:11:08.953ZINFOcrucible-agent (datafile): region d4aef9e9-b72e-401e-ac74-20a4fc7b4c5e state: Requested
362024-12-13T23:11:08.954ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
372024-12-13T23:11:08.954ZINFOcrucible-agent (dropshot): request completed latency_us = 858 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54308 req_id = fb34dd8c-9a03-4a30-90f5-4ca968a5ed0d response_code = 200 uri = /crucible/0/regions
382024-12-13T23:11:08.966ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/d4aef9e9-b72e-401e-ac74-20a4fc7b4c5e
392024-12-13T23:11:08.966ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/d4aef9e9-b72e-401e-ac74-20a4fc7b4c5e
402024-12-13T23:11:09.033ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d4aef9e9-b72e-401e-ac74-20a4fc7b4c5e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d4aef9e9-b72e-401e-ac74-20a4fc7b4c5e" region = d4aef9e9-b72e-401e-ac74-20a4fc7b4c5e
412024-12-13T23:11:09.035ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d4aef9e9-b72e-401e-ac74-20a4fc7b4c5e" "--data" "/data/regions/d4aef9e9-b72e-401e-ac74-20a4fc7b4c5e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d4aef9e9-b72e-401e-ac74-20a4fc7b4c5e
422024-12-13T23:11:09.123ZINFOcrucible-agent (worker): region files created ok region = d4aef9e9-b72e-401e-ac74-20a4fc7b4c5e
432024-12-13T23:11:09.123ZINFOcrucible-agent (datafile): region d4aef9e9-b72e-401e-ac74-20a4fc7b4c5e state: Requested -> Created
442024-12-13T23:11:09.123ZINFOcrucible-agent (worker): applying SMF actions post create...
452024-12-13T23:11:09.138ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d4aef9e9-b72e-401e-ac74-20a4fc7b4c5e
462024-12-13T23:11:09.145ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d4aef9e9-b72e-401e-ac74-20a4fc7b4c5e
472024-12-13T23:11:09.155ZINFOcrucible-agent (worker): creating config property group
482024-12-13T23:11:09.158ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d4aef9e9-b72e-401e-ac74-20a4fc7b4c5e
492024-12-13T23:11:09.159ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d4aef9e9-b72e-401e-ac74-20a4fc7b4c5e
502024-12-13T23:11:09.159ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
512024-12-13T23:11:09.159ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
522024-12-13T23:11:09.159ZINFOcrucible-agent (worker): commit
532024-12-13T23:11:09.163ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54308 req_id = 69794aa2-89f0-4d37-816c-ac1dc24ef00e response_code = 200 uri = /crucible/0/regions
542024-12-13T23:11:09.163ZINFOcrucible-agent (worker): ok!
552024-12-13T23:11:09.168ZINFOcrucible-agent (worker): SMF ok!
562024-12-13T23:11:11.102ZINFOcrucible-agent (dropshot): request completed latency_us = 2311 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54308 req_id = f1d0625f-2fdf-4505-92d8-796dee109047 response_code = 200 uri = /crucible/0/regions/cf374909-1e83-4b54-9237-49e962f73746
572024-12-13T23:11:11.106ZINFOcrucible-agent (datafile): path is "/data/regions/cf374909-1e83-4b54-9237-49e962f73746"
582024-12-13T23:11:11.114ZINFOcrucible-agent (datafile): dataset is oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/cf374909-1e83-4b54-9237-49e962f73746
592024-12-13T23:11:11.122ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/cf374909-1e83-4b54-9237-49e962f73746@b0a42f65-f337-4889-aa17-0f10ab86bc92
602024-12-13T23:11:11.122ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/cf374909-1e83-4b54-9237-49e962f73746", "b0a42f65-f337-4889-aa17-0f10ab86bc92"]
612024-12-13T23:11:11.132ZINFOcrucible-agent (dropshot): request completed latency_us = 26096 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54308 req_id = b4f52d12-e605-4501-a126-056c813d0fbc response_code = 200 uri = /crucible/0/regions/cf374909-1e83-4b54-9237-49e962f73746/snapshots/b0a42f65-f337-4889-aa17-0f10ab86bc92
622024-12-13T23:11:11.136ZINFOcrucible-agent (datafile): path is "/data/regions/cf374909-1e83-4b54-9237-49e962f73746"
632024-12-13T23:11:11.145ZINFOcrucible-agent (datafile): dataset is oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/cf374909-1e83-4b54-9237-49e962f73746
642024-12-13T23:11:11.152ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/cf374909-1e83-4b54-9237-49e962f73746@b0a42f65-f337-4889-aa17-0f10ab86bc92
652024-12-13T23:11:11.152ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/cf374909-1e83-4b54-9237-49e962f73746", "b0a42f65-f337-4889-aa17-0f10ab86bc92"]
662024-12-13T23:11:11.161ZINFOcrucible-agent (datafile): requesting running snapshot cf374909-1e83-4b54-9237-49e962f73746-b0a42f65-f337-4889-aa17-0f10ab86bc92 state: Requested
672024-12-13T23:11:11.161ZINFOcrucible-agent (worker): applying SMF actions for region cf374909-1e83-4b54-9237-49e962f73746 running snapshot b0a42f65-f337-4889-aa17-0f10ab86bc92 (state Requested)...
682024-12-13T23:11:11.161ZINFOcrucible-agent (dropshot): request completed latency_us = 26246 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54308 req_id = 19fb6d59-12d8-4f11-a613-7b6fbbcf0af8 response_code = 200 uri = /crucible/0/regions/cf374909-1e83-4b54-9237-49e962f73746/snapshots/b0a42f65-f337-4889-aa17-0f10ab86bc92/run
692024-12-13T23:11:11.164ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-cf374909-1e83-4b54-9237-49e962f73746-b0a42f65-f337-4889-aa17-0f10ab86bc92
702024-12-13T23:11:11.173ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-cf374909-1e83-4b54-9237-49e962f73746-b0a42f65-f337-4889-aa17-0f10ab86bc92
712024-12-13T23:11:11.185ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-cf374909-1e83-4b54-9237-49e962f73746-b0a42f65-f337-4889-aa17-0f10ab86bc92
722024-12-13T23:11:11.185ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cf374909-1e83-4b54-9237-49e962f73746/.zfs/snapshot/b0a42f65-f337-4889-aa17-0f10ab86bc92
732024-12-13T23:11:11.185ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
742024-12-13T23:11:11.185ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
752024-12-13T23:11:11.185ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
762024-12-13T23:11:11.185ZINFOcrucible-agent (worker): commit
772024-12-13T23:11:11.189ZINFOcrucible-agent (worker): ok!
782024-12-13T23:11:11.194ZINFOcrucible-agent (worker): SMF ok!
792024-12-13T23:11:11.194ZINFOcrucible-agent (datafile): region cf374909-1e83-4b54-9237-49e962f73746 running snapshot b0a42f65-f337-4889-aa17-0f10ab86bc92 state: Requested -> Created
802024-12-13T23:11:11.325ZINFOcrucible-agent (datafile): path is "/data/regions/cf374909-1e83-4b54-9237-49e962f73746"
812024-12-13T23:11:11.333ZINFOcrucible-agent (datafile): dataset is oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/cf374909-1e83-4b54-9237-49e962f73746
822024-12-13T23:11:11.342ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/cf374909-1e83-4b54-9237-49e962f73746@b0a42f65-f337-4889-aa17-0f10ab86bc92
832024-12-13T23:11:11.342ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/cf374909-1e83-4b54-9237-49e962f73746", "b0a42f65-f337-4889-aa17-0f10ab86bc92"]
842024-12-13T23:11:11.350ZINFOcrucible-agent (dropshot): request completed latency_us = 25659 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54308 req_id = 7f6f1daa-6ad5-4af9-ac79-880b3042ff80 response_code = 200 uri = /crucible/0/regions/cf374909-1e83-4b54-9237-49e962f73746/snapshots/b0a42f65-f337-4889-aa17-0f10ab86bc92/run
852024-12-13T23:11:14.490ZINFOcrucible-agent (datafile): region 7cb25504-7859-4e01-b27e-fcb0d959ec86 state: Requested
862024-12-13T23:11:14.490ZINFOcrucible-agent (dropshot): request completed latency_us = 232 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54308 req_id = 35756042-504e-46c1-8115-b96deddfe705 response_code = 200 uri = /crucible/0/regions
872024-12-13T23:11:14.490ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
882024-12-13T23:11:14.501ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/7cb25504-7859-4e01-b27e-fcb0d959ec86
892024-12-13T23:11:14.501ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/7cb25504-7859-4e01-b27e-fcb0d959ec86
902024-12-13T23:11:14.558ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7cb25504-7859-4e01-b27e-fcb0d959ec86"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/7cb25504-7859-4e01-b27e-fcb0d959ec86" region = 7cb25504-7859-4e01-b27e-fcb0d959ec86
912024-12-13T23:11:14.560ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "7cb25504-7859-4e01-b27e-fcb0d959ec86" "--data" "/data/regions/7cb25504-7859-4e01-b27e-fcb0d959ec86" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 7cb25504-7859-4e01-b27e-fcb0d959ec86
922024-12-13T23:11:14.641ZINFOcrucible-agent (worker): region files created ok region = 7cb25504-7859-4e01-b27e-fcb0d959ec86
932024-12-13T23:11:14.641ZINFOcrucible-agent (datafile): region 7cb25504-7859-4e01-b27e-fcb0d959ec86 state: Requested -> Created
942024-12-13T23:11:14.641ZINFOcrucible-agent (worker): applying SMF actions post create...
952024-12-13T23:11:14.642ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7cb25504-7859-4e01-b27e-fcb0d959ec86
962024-12-13T23:11:14.646ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7cb25504-7859-4e01-b27e-fcb0d959ec86
972024-12-13T23:11:14.655ZINFOcrucible-agent (worker): creating config property group
982024-12-13T23:11:14.659ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7cb25504-7859-4e01-b27e-fcb0d959ec86
992024-12-13T23:11:14.659ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7cb25504-7859-4e01-b27e-fcb0d959ec86
1002024-12-13T23:11:14.659ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
1012024-12-13T23:11:14.660ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
1022024-12-13T23:11:14.660ZINFOcrucible-agent (worker): commit
1032024-12-13T23:11:14.666ZINFOcrucible-agent (worker): ok!
1042024-12-13T23:11:14.679ZINFOcrucible-agent (worker): SMF ok!
1052024-12-13T23:11:14.773ZINFOcrucible-agent (dropshot): request completed latency_us = 115 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54308 req_id = 954a4a67-2839-4f65-9174-3f92f1b42020 response_code = 200 uri = /crucible/0/regions
1062024-12-13T23:11:39.237ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54308 req_id = 8bfc3075-3758-4a43-9958-cb09304412e0 response_code = 200 uri = /crucible/0/regions/7cb25504-7859-4e01-b27e-fcb0d959ec86
1072024-12-13T23:11:39.240ZINFOcrucible-agent (datafile): path is "/data/regions/7cb25504-7859-4e01-b27e-fcb0d959ec86"
1082024-12-13T23:11:39.253ZINFOcrucible-agent (datafile): dataset is oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/7cb25504-7859-4e01-b27e-fcb0d959ec86
1092024-12-13T23:11:39.263ZINFOcrucible-agent (datafile): region 7cb25504-7859-4e01-b27e-fcb0d959ec86 state: Created -> Tombstoned
1102024-12-13T23:11:39.263ZINFOcrucible-agent (worker): applying SMF actions before removal...
1112024-12-13T23:11:39.263ZINFOcrucible-agent (dropshot): request completed latency_us = 23029 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:54308 req_id = a39e4931-b4d0-40c5-9d08-873bde0cb5d8 response_code = 204 uri = /crucible/0/regions/7cb25504-7859-4e01-b27e-fcb0d959ec86
1122024-12-13T23:11:39.267ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-7cb25504-7859-4e01-b27e-fcb0d959ec86 (instance states: (Some(Online), None))
1132024-12-13T23:11:39.268ZINFOcrucible-agent (dropshot): request completed latency_us = 31 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54308 req_id = d06104c7-b2b7-4c25-bc4a-560c9f781d13 response_code = 200 uri = /crucible/0/regions/7cb25504-7859-4e01-b27e-fcb0d959ec86
1142024-12-13T23:11:39.275ZINFOcrucible-agent (worker): SMF ok!
1152024-12-13T23:11:39.286ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_cb54037f-125a-4af3-8595-b53b9b45d26a/crucible/regions/7cb25504-7859-4e01-b27e-fcb0d959ec86" region = 7cb25504-7859-4e01-b27e-fcb0d959ec86
1162024-12-13T23:11:39.330ZINFOcrucible-agent (dropshot): request completed latency_us = 674 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54308 req_id = 17fd4f04-3fa7-4159-a341-b748a0dfae6c response_code = 200 uri = /crucible/0/regions/7cb25504-7859-4e01-b27e-fcb0d959ec86
1172024-12-13T23:11:39.353ZINFOcrucible-agent (datafile): region 7cb25504-7859-4e01-b27e-fcb0d959ec86 state: Tombstoned -> Destroyed
1182024-12-13T23:11:39.397ZINFOcrucible-agent (dropshot): request completed latency_us = 35 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54308 req_id = e625d59d-be2b-4264-8432-e8c831ac483e response_code = 200 uri = /crucible/0/regions/7cb25504-7859-4e01-b27e-fcb0d959ec86