Max level shown:
1 [ Aug 12 22:32:17 Enabled. ]
2 [ Aug 12 22:32:17 Rereading configuration. ]
3 [ Aug 12 22:32:20 Rereading configuration. ]
4 [ Aug 12 22:32:26 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-08-12T22:32:26.812ZINFOcrucible-agent: dataset: "oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible"
72024-08-12T22:32:26.815ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
82024-08-12T22:32:26.815ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-08-12T22:32:26.826ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-08-12T22:32:26.985ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
112024-08-12T22:33:38.513ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:41774
122024-08-12T22:33:38.527ZINFOcrucible-agent (datafile): region b754dae4-8dfb-4055-91cb-eacd8945042e state: Requested
132024-08-12T22:33:38.530ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142024-08-12T22:33:38.534ZINFOcrucible-agent (dropshot): request completed latency_us = 11210 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41774 req_id = 8f1828b0-2ebe-4192-a914-4952a2631b8f response_code = 200 uri = /crucible/0/regions
152024-08-12T22:33:38.541ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible/regions/b754dae4-8dfb-4055-91cb-eacd8945042e
162024-08-12T22:33:38.541ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible/regions/b754dae4-8dfb-4055-91cb-eacd8945042e
172024-08-12T22:33:38.600ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b754dae4-8dfb-4055-91cb-eacd8945042e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b754dae4-8dfb-4055-91cb-eacd8945042e" region = b754dae4-8dfb-4055-91cb-eacd8945042e
182024-08-12T22:33:38.600ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b754dae4-8dfb-4055-91cb-eacd8945042e" "--data" "/data/regions/b754dae4-8dfb-4055-91cb-eacd8945042e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b754dae4-8dfb-4055-91cb-eacd8945042e
192024-08-12T22:33:38.834ZINFOcrucible-agent (worker): region files created ok region = b754dae4-8dfb-4055-91cb-eacd8945042e
202024-08-12T22:33:38.834ZINFOcrucible-agent (datafile): region b754dae4-8dfb-4055-91cb-eacd8945042e state: Requested -> Created
212024-08-12T22:33:38.835ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-08-12T22:33:38.835ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b754dae4-8dfb-4055-91cb-eacd8945042e
232024-08-12T22:33:38.841ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b754dae4-8dfb-4055-91cb-eacd8945042e
242024-08-12T22:33:38.858ZINFOcrucible-agent (worker): creating config property group
252024-08-12T22:33:38.862ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b754dae4-8dfb-4055-91cb-eacd8945042e
262024-08-12T22:33:38.869ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b754dae4-8dfb-4055-91cb-eacd8945042e
272024-08-12T22:33:38.871ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-08-12T22:33:38.871ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
292024-08-12T22:33:38.871ZINFOcrucible-agent (worker): commit
302024-08-12T22:33:38.877ZINFOcrucible-agent (worker): ok!
312024-08-12T22:33:38.880ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41774 req_id = 72994bc1-c282-4cd5-8aee-57d34b6d7fe6 response_code = 200 uri = /crucible/0/regions
322024-08-12T22:33:38.884ZINFOcrucible-agent (worker): SMF ok!
332024-08-12T22:39:15.117ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:58077
342024-08-12T22:39:15.117ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58077 req_id = ed37f809-92e5-40d9-8275-2d7af25e49ea response_code = 200 uri = /crucible/0/regions/b754dae4-8dfb-4055-91cb-eacd8945042e
352024-08-12T22:39:15.123ZINFOcrucible-agent (datafile): path is "/data/regions/b754dae4-8dfb-4055-91cb-eacd8945042e"
362024-08-12T22:39:15.133ZINFOcrucible-agent (datafile): dataset is oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible/regions/b754dae4-8dfb-4055-91cb-eacd8945042e
372024-08-12T22:39:15.141ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible/regions/b754dae4-8dfb-4055-91cb-eacd8945042e@6ad175c4-d009-4baf-bcf4-40a5a6345162
382024-08-12T22:39:15.141ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible/regions/b754dae4-8dfb-4055-91cb-eacd8945042e", "6ad175c4-d009-4baf-bcf4-40a5a6345162"]
392024-08-12T22:39:15.152ZINFOcrucible-agent (dropshot): request completed latency_us = 32451 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58077 req_id = 76205fba-011d-4bc5-a82d-7bc254b23b14 response_code = 200 uri = /crucible/0/regions/b754dae4-8dfb-4055-91cb-eacd8945042e/snapshots/6ad175c4-d009-4baf-bcf4-40a5a6345162
402024-08-12T22:39:15.155ZINFOcrucible-agent (datafile): path is "/data/regions/b754dae4-8dfb-4055-91cb-eacd8945042e"
412024-08-12T22:39:15.163ZINFOcrucible-agent (datafile): dataset is oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible/regions/b754dae4-8dfb-4055-91cb-eacd8945042e
422024-08-12T22:39:15.172ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible/regions/b754dae4-8dfb-4055-91cb-eacd8945042e@6ad175c4-d009-4baf-bcf4-40a5a6345162
432024-08-12T22:39:15.172ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible/regions/b754dae4-8dfb-4055-91cb-eacd8945042e", "6ad175c4-d009-4baf-bcf4-40a5a6345162"]
442024-08-12T22:39:15.181ZINFOcrucible-agent (datafile): requesting running snapshot b754dae4-8dfb-4055-91cb-eacd8945042e-6ad175c4-d009-4baf-bcf4-40a5a6345162 state: Requested
452024-08-12T22:39:15.182ZINFOcrucible-agent (worker): applying SMF actions for region b754dae4-8dfb-4055-91cb-eacd8945042e running snapshot 6ad175c4-d009-4baf-bcf4-40a5a6345162 (state Requested)...
462024-08-12T22:39:15.182ZINFOcrucible-agent (dropshot): request completed latency_us = 26856 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58077 req_id = 71539f92-5d6c-47c6-a9ac-6cdfcbbaef16 response_code = 200 uri = /crucible/0/regions/b754dae4-8dfb-4055-91cb-eacd8945042e/snapshots/6ad175c4-d009-4baf-bcf4-40a5a6345162/run
472024-08-12T22:39:15.187ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/b754dae4-8dfb-4055-91cb-eacd8945042e
482024-08-12T22:39:15.187ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
492024-08-12T22:39:15.187ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
502024-08-12T22:39:15.187ZINFOcrucible-agent (worker): reconfig required
512024-08-12T22:39:15.187ZINFOcrucible-agent (worker): using existing config property group
522024-08-12T22:39:15.187ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b754dae4-8dfb-4055-91cb-eacd8945042e
532024-08-12T22:39:15.188ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b754dae4-8dfb-4055-91cb-eacd8945042e
542024-08-12T22:39:15.188ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
552024-08-12T22:39:15.188ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
562024-08-12T22:39:15.188ZINFOcrucible-agent (worker): commit
572024-08-12T22:39:15.199ZINFOcrucible-agent (worker): ok!
582024-08-12T22:39:15.200ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-b754dae4-8dfb-4055-91cb-eacd8945042e-6ad175c4-d009-4baf-bcf4-40a5a6345162
592024-08-12T22:39:15.210ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-b754dae4-8dfb-4055-91cb-eacd8945042e-6ad175c4-d009-4baf-bcf4-40a5a6345162
602024-08-12T22:39:15.230ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-b754dae4-8dfb-4055-91cb-eacd8945042e-6ad175c4-d009-4baf-bcf4-40a5a6345162
612024-08-12T22:39:15.230ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b754dae4-8dfb-4055-91cb-eacd8945042e/.zfs/snapshot/6ad175c4-d009-4baf-bcf4-40a5a6345162
622024-08-12T22:39:15.231ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
632024-08-12T22:39:15.231ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
642024-08-12T22:39:15.231ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
652024-08-12T22:39:15.231ZINFOcrucible-agent (worker): commit
662024-08-12T22:39:15.238ZINFOcrucible-agent (worker): ok!
672024-08-12T22:39:15.247ZINFOcrucible-agent (worker): SMF ok!
682024-08-12T22:39:15.247ZINFOcrucible-agent (datafile): region b754dae4-8dfb-4055-91cb-eacd8945042e running snapshot 6ad175c4-d009-4baf-bcf4-40a5a6345162 state: Requested -> Created
692024-08-12T22:39:15.470ZINFOcrucible-agent (datafile): path is "/data/regions/b754dae4-8dfb-4055-91cb-eacd8945042e"
702024-08-12T22:39:15.479ZINFOcrucible-agent (datafile): dataset is oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible/regions/b754dae4-8dfb-4055-91cb-eacd8945042e
712024-08-12T22:39:15.487ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible/regions/b754dae4-8dfb-4055-91cb-eacd8945042e@6ad175c4-d009-4baf-bcf4-40a5a6345162
722024-08-12T22:39:15.487ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible/regions/b754dae4-8dfb-4055-91cb-eacd8945042e", "6ad175c4-d009-4baf-bcf4-40a5a6345162"]
732024-08-12T22:39:15.496ZINFOcrucible-agent (dropshot): request completed latency_us = 26449 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58077 req_id = 4014b7da-12bc-4473-867b-d0e3b0e5455d response_code = 200 uri = /crucible/0/regions/b754dae4-8dfb-4055-91cb-eacd8945042e/snapshots/6ad175c4-d009-4baf-bcf4-40a5a6345162/run
742024-08-12T22:39:18.717ZINFOcrucible-agent (datafile): region e86b1522-e9d2-4e32-9e6c-f281bda6ce88 state: Requested
752024-08-12T22:39:18.717ZINFOcrucible-agent (dropshot): request completed latency_us = 855 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58077 req_id = 026b6c00-e4ee-4070-ae46-34e30acbdb2d response_code = 200 uri = /crucible/0/regions
762024-08-12T22:39:18.717ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
772024-08-12T22:39:18.726ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible/regions/e86b1522-e9d2-4e32-9e6c-f281bda6ce88
782024-08-12T22:39:18.726ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible/regions/e86b1522-e9d2-4e32-9e6c-f281bda6ce88
792024-08-12T22:39:18.811ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e86b1522-e9d2-4e32-9e6c-f281bda6ce88"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e86b1522-e9d2-4e32-9e6c-f281bda6ce88" region = e86b1522-e9d2-4e32-9e6c-f281bda6ce88
802024-08-12T22:39:18.812ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e86b1522-e9d2-4e32-9e6c-f281bda6ce88" "--data" "/data/regions/e86b1522-e9d2-4e32-9e6c-f281bda6ce88" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e86b1522-e9d2-4e32-9e6c-f281bda6ce88
812024-08-12T22:39:18.956ZINFOcrucible-agent (worker): region files created ok region = e86b1522-e9d2-4e32-9e6c-f281bda6ce88
822024-08-12T22:39:18.956ZINFOcrucible-agent (datafile): region e86b1522-e9d2-4e32-9e6c-f281bda6ce88 state: Requested -> Created
832024-08-12T22:39:18.956ZINFOcrucible-agent (worker): applying SMF actions post create...
842024-08-12T22:39:18.957ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/b754dae4-8dfb-4055-91cb-eacd8945042e
852024-08-12T22:39:18.957ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
862024-08-12T22:39:18.957ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
872024-08-12T22:39:18.957ZINFOcrucible-agent (worker): reconfig required
882024-08-12T22:39:18.957ZINFOcrucible-agent (worker): using existing config property group
892024-08-12T22:39:18.957ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b754dae4-8dfb-4055-91cb-eacd8945042e
902024-08-12T22:39:18.958ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b754dae4-8dfb-4055-91cb-eacd8945042e
912024-08-12T22:39:18.958ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
922024-08-12T22:39:18.958ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
932024-08-12T22:39:18.958ZINFOcrucible-agent (worker): commit
942024-08-12T22:39:18.965ZINFOcrucible-agent (worker): ok!
952024-08-12T22:39:18.965ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e86b1522-e9d2-4e32-9e6c-f281bda6ce88
962024-08-12T22:39:18.972ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e86b1522-e9d2-4e32-9e6c-f281bda6ce88
972024-08-12T22:39:18.988ZINFOcrucible-agent (worker): creating config property group
982024-08-12T22:39:18.995ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e86b1522-e9d2-4e32-9e6c-f281bda6ce88
992024-08-12T22:39:18.996ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e86b1522-e9d2-4e32-9e6c-f281bda6ce88
1002024-08-12T22:39:18.996ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1012024-08-12T22:39:18.996ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
1022024-08-12T22:39:18.996ZINFOcrucible-agent (worker): commit
1032024-08-12T22:39:19.001ZINFOcrucible-agent (worker): ok!
1042024-08-12T22:39:19.011ZINFOcrucible-agent (worker): SMF ok!
1052024-08-12T22:39:19.064ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58077 req_id = 95c422c2-b664-4686-90dc-bf26a73e16b6 response_code = 200 uri = /crucible/0/regions
1062024-08-12T22:39:44.353ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58077 req_id = 31f7f629-fa77-480d-b03d-54e81cce8d43 response_code = 200 uri = /crucible/0/regions/e86b1522-e9d2-4e32-9e6c-f281bda6ce88
1072024-08-12T22:39:44.355ZINFOcrucible-agent (datafile): path is "/data/regions/e86b1522-e9d2-4e32-9e6c-f281bda6ce88"
1082024-08-12T22:39:44.367ZINFOcrucible-agent (datafile): dataset is oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible/regions/e86b1522-e9d2-4e32-9e6c-f281bda6ce88
1092024-08-12T22:39:44.376ZINFOcrucible-agent (datafile): region e86b1522-e9d2-4e32-9e6c-f281bda6ce88 state: Created -> Tombstoned
1102024-08-12T22:39:44.376ZINFOcrucible-agent (worker): applying SMF actions before removal...
1112024-08-12T22:39:44.376ZINFOcrucible-agent (dropshot): request completed latency_us = 21131 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:58077 req_id = 0fea5a49-a7f3-41cd-a8ad-201124c899e5 response_code = 204 uri = /crucible/0/regions/e86b1522-e9d2-4e32-9e6c-f281bda6ce88
1122024-08-12T22:39:44.377ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e86b1522-e9d2-4e32-9e6c-f281bda6ce88 (instance states: (Some(Online), None))
1132024-08-12T22:39:44.380ZINFOcrucible-agent (dropshot): request completed latency_us = 450 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58077 req_id = 5b706446-54a3-4a20-b698-263ed78620a0 response_code = 200 uri = /crucible/0/regions/e86b1522-e9d2-4e32-9e6c-f281bda6ce88
1142024-08-12T22:39:44.382ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/b754dae4-8dfb-4055-91cb-eacd8945042e
1152024-08-12T22:39:44.382ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1162024-08-12T22:39:44.382ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
1172024-08-12T22:39:44.382ZINFOcrucible-agent (worker): reconfig required
1182024-08-12T22:39:44.382ZINFOcrucible-agent (worker): using existing config property group
1192024-08-12T22:39:44.382ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b754dae4-8dfb-4055-91cb-eacd8945042e
1202024-08-12T22:39:44.382ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b754dae4-8dfb-4055-91cb-eacd8945042e
1212024-08-12T22:39:44.382ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1222024-08-12T22:39:44.382ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
1232024-08-12T22:39:44.382ZINFOcrucible-agent (worker): commit
1242024-08-12T22:39:44.386ZINFOcrucible-agent (worker): ok!
1252024-08-12T22:39:44.388ZINFOcrucible-agent (worker): SMF ok!
1262024-08-12T22:39:44.398ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_537dde5b-089b-4e20-9ef8-bf10127d7dce/crucible/regions/e86b1522-e9d2-4e32-9e6c-f281bda6ce88" region = e86b1522-e9d2-4e32-9e6c-f281bda6ce88
1272024-08-12T22:39:44.471ZINFOcrucible-agent (datafile): region e86b1522-e9d2-4e32-9e6c-f281bda6ce88 state: Tombstoned -> Destroyed
1282024-08-12T22:39:44.476ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58077 req_id = 3627bd68-0d6b-466b-b246-cc2681ec4334 response_code = 200 uri = /crucible/0/regions/e86b1522-e9d2-4e32-9e6c-f281bda6ce88