Max level shown:
1 [ Jun 17 18:06:38 Enabled. ]
2 [ Jun 17 18:06:38 Rereading configuration. ]
3 [ Jun 17 18:06:39 Rereading configuration. ]
4 [ Jun 17 18:06:41 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_2f10330f-475e-4093-976d-8267583dac69/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-06-17T18:06:41.105ZINFOcrucible-agent: dataset: "oxp_2f10330f-475e-4093-976d-8267583dac69/crucible"
72024-06-17T18:06:41.109ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82024-06-17T18:06:41.109ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-06-17T18:06:41.130ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-06-17T18:06:41.242ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
112024-06-17T18:07:04.785ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:41383
122024-06-17T18:07:04.796ZINFOcrucible-agent (datafile): region 8969bc10-0f3f-49e9-994e-4656428a6d08 state: Requested
132024-06-17T18:07:04.799ZINFOcrucible-agent (dropshot): request completed latency_us = 5714 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41383 req_id = 7ee3a00d-10ec-4ab5-844c-cfb7eb89e079 response_code = 200 uri = /crucible/0/regions
142024-06-17T18:07:04.799ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-06-17T18:07:04.808ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/8969bc10-0f3f-49e9-994e-4656428a6d08
162024-06-17T18:07:04.808ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/8969bc10-0f3f-49e9-994e-4656428a6d08
172024-06-17T18:07:04.891ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8969bc10-0f3f-49e9-994e-4656428a6d08"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8969bc10-0f3f-49e9-994e-4656428a6d08" region = 8969bc10-0f3f-49e9-994e-4656428a6d08
182024-06-17T18:07:04.894ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8969bc10-0f3f-49e9-994e-4656428a6d08" "--data" "/data/regions/8969bc10-0f3f-49e9-994e-4656428a6d08" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 8969bc10-0f3f-49e9-994e-4656428a6d08
192024-06-17T18:07:04.945ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41383 req_id = e24fb218-c0c3-477a-b987-8ba34d2db66a response_code = 200 uri = /crucible/0/regions
202024-06-17T18:07:05.034ZINFOcrucible-agent (worker): region files created ok region = 8969bc10-0f3f-49e9-994e-4656428a6d08
212024-06-17T18:07:05.034ZINFOcrucible-agent (datafile): region 8969bc10-0f3f-49e9-994e-4656428a6d08 state: Requested -> Created
222024-06-17T18:07:05.034ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-06-17T18:07:05.034ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8969bc10-0f3f-49e9-994e-4656428a6d08
242024-06-17T18:07:05.039ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8969bc10-0f3f-49e9-994e-4656428a6d08
252024-06-17T18:07:05.052ZINFOcrucible-agent (worker): creating config property group
262024-06-17T18:07:05.064ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8969bc10-0f3f-49e9-994e-4656428a6d08
272024-06-17T18:07:05.065ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8969bc10-0f3f-49e9-994e-4656428a6d08
282024-06-17T18:07:05.067ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-06-17T18:07:05.067ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
302024-06-17T18:07:05.067ZINFOcrucible-agent (worker): commit
312024-06-17T18:07:05.072ZINFOcrucible-agent (worker): ok!
322024-06-17T18:07:05.078ZINFOcrucible-agent (worker): SMF ok!
332024-06-17T18:07:05.695ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41383 req_id = 8b011b1e-7199-427e-84fe-a73044ebfe06 response_code = 200 uri = /crucible/0/regions
342024-06-17T18:07:05.934ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41383 req_id = 9cdaf1b3-c5c2-469b-894c-be06726baf51 response_code = 200 uri = /crucible/0/regions/8969bc10-0f3f-49e9-994e-4656428a6d08
352024-06-17T18:07:05.936ZINFOcrucible-agent (datafile): path is "/data/regions/8969bc10-0f3f-49e9-994e-4656428a6d08"
362024-06-17T18:07:05.946ZINFOcrucible-agent (datafile): dataset is oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/8969bc10-0f3f-49e9-994e-4656428a6d08
372024-06-17T18:07:05.955ZINFOcrucible-agent (datafile): region 8969bc10-0f3f-49e9-994e-4656428a6d08 state: Created -> Tombstoned
382024-06-17T18:07:05.956ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-06-17T18:07:05.957ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-8969bc10-0f3f-49e9-994e-4656428a6d08 (instance states: (Some(Online), None))
402024-06-17T18:07:05.958ZINFOcrucible-agent (dropshot): request completed latency_us = 22537 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:41383 req_id = 51d22940-96db-4828-912e-b043b097a8f8 response_code = 204 uri = /crucible/0/regions/8969bc10-0f3f-49e9-994e-4656428a6d08
412024-06-17T18:07:05.961ZINFOcrucible-agent (worker): SMF ok!
422024-06-17T18:07:05.964ZINFOcrucible-agent (dropshot): request completed latency_us = 3212 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41383 req_id = 6687431f-8280-4933-8e30-1c8846b6e535 response_code = 200 uri = /crucible/0/regions/8969bc10-0f3f-49e9-994e-4656428a6d08
432024-06-17T18:07:05.972ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/8969bc10-0f3f-49e9-994e-4656428a6d08" region = 8969bc10-0f3f-49e9-994e-4656428a6d08
442024-06-17T18:07:06.037ZINFOcrucible-agent (datafile): region 8969bc10-0f3f-49e9-994e-4656428a6d08 state: Tombstoned -> Destroyed
452024-06-17T18:07:06.100ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41383 req_id = 8e7fdd08-33e5-4766-9dcb-8a4b806769c3 response_code = 200 uri = /crucible/0/regions/8969bc10-0f3f-49e9-994e-4656428a6d08
462024-06-17T18:07:07.631ZINFOcrucible-agent (datafile): region 92226e77-aebb-40a7-bae6-04877e57fa42 state: Requested
472024-06-17T18:07:07.631ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482024-06-17T18:07:07.631ZINFOcrucible-agent (dropshot): request completed latency_us = 236 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41383 req_id = 498dba57-ea90-4c47-bcd7-387a56cab009 response_code = 200 uri = /crucible/0/regions
492024-06-17T18:07:07.639ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/92226e77-aebb-40a7-bae6-04877e57fa42
502024-06-17T18:07:07.639ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/92226e77-aebb-40a7-bae6-04877e57fa42
512024-06-17T18:07:07.700ZINFOcrucible-agent (worker): creating region Region { id: RegionId("92226e77-aebb-40a7-bae6-04877e57fa42"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/92226e77-aebb-40a7-bae6-04877e57fa42" region = 92226e77-aebb-40a7-bae6-04877e57fa42
522024-06-17T18:07:07.702ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "92226e77-aebb-40a7-bae6-04877e57fa42" "--data" "/data/regions/92226e77-aebb-40a7-bae6-04877e57fa42" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 92226e77-aebb-40a7-bae6-04877e57fa42
532024-06-17T18:07:07.768ZINFOcrucible-agent (worker): region files created ok region = 92226e77-aebb-40a7-bae6-04877e57fa42
542024-06-17T18:07:07.768ZINFOcrucible-agent (datafile): region 92226e77-aebb-40a7-bae6-04877e57fa42 state: Requested -> Created
552024-06-17T18:07:07.768ZINFOcrucible-agent (worker): applying SMF actions post create...
562024-06-17T18:07:07.769ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-92226e77-aebb-40a7-bae6-04877e57fa42
572024-06-17T18:07:07.773ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-92226e77-aebb-40a7-bae6-04877e57fa42
582024-06-17T18:07:07.781ZINFOcrucible-agent (worker): creating config property group
592024-06-17T18:07:07.784ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-92226e77-aebb-40a7-bae6-04877e57fa42
602024-06-17T18:07:07.785ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/92226e77-aebb-40a7-bae6-04877e57fa42
612024-06-17T18:07:07.785ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622024-06-17T18:07:07.785ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
632024-06-17T18:07:07.785ZINFOcrucible-agent (worker): commit
642024-06-17T18:07:07.788ZINFOcrucible-agent (worker): ok!
652024-06-17T18:07:07.789ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41383 req_id = bbd28491-298e-4d86-a8c6-e360de40725a response_code = 200 uri = /crucible/0/regions
662024-06-17T18:07:07.793ZINFOcrucible-agent (worker): SMF ok!
672024-06-17T18:12:24.956ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:51361
682024-06-17T18:12:24.956ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51361 req_id = 8c2d4681-5cdd-4740-81a0-c0c00ba4506b response_code = 200 uri = /crucible/0/regions/92226e77-aebb-40a7-bae6-04877e57fa42
692024-06-17T18:12:24.959ZINFOcrucible-agent (datafile): path is "/data/regions/92226e77-aebb-40a7-bae6-04877e57fa42"
702024-06-17T18:12:24.968ZINFOcrucible-agent (datafile): dataset is oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/92226e77-aebb-40a7-bae6-04877e57fa42
712024-06-17T18:12:24.977ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/92226e77-aebb-40a7-bae6-04877e57fa42@33f80c78-d70c-4161-b1d0-689787d4000d
722024-06-17T18:12:24.977ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/92226e77-aebb-40a7-bae6-04877e57fa42", "33f80c78-d70c-4161-b1d0-689787d4000d"]
732024-06-17T18:12:24.990ZINFOcrucible-agent (dropshot): request completed latency_us = 34243 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51361 req_id = 7c5d2f5d-8c34-4f9f-a7dd-b16e322ed850 response_code = 200 uri = /crucible/0/regions/92226e77-aebb-40a7-bae6-04877e57fa42/snapshots/33f80c78-d70c-4161-b1d0-689787d4000d
742024-06-17T18:12:24.990ZINFOcrucible-agent (datafile): path is "/data/regions/92226e77-aebb-40a7-bae6-04877e57fa42"
752024-06-17T18:12:24.998ZINFOcrucible-agent (datafile): dataset is oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/92226e77-aebb-40a7-bae6-04877e57fa42
762024-06-17T18:12:25.007ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/92226e77-aebb-40a7-bae6-04877e57fa42@33f80c78-d70c-4161-b1d0-689787d4000d
772024-06-17T18:12:25.007ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/92226e77-aebb-40a7-bae6-04877e57fa42", "33f80c78-d70c-4161-b1d0-689787d4000d"]
782024-06-17T18:12:25.015ZINFOcrucible-agent (datafile): requesting running snapshot 92226e77-aebb-40a7-bae6-04877e57fa42-33f80c78-d70c-4161-b1d0-689787d4000d state: Requested
792024-06-17T18:12:25.016ZINFOcrucible-agent (worker): applying SMF actions for region 92226e77-aebb-40a7-bae6-04877e57fa42 running snapshot 33f80c78-d70c-4161-b1d0-689787d4000d (state Requested)...
802024-06-17T18:12:25.016ZINFOcrucible-agent (dropshot): request completed latency_us = 25741 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51361 req_id = afab9b21-7fd6-4fba-9aec-44ee7bba50ba response_code = 200 uri = /crucible/0/regions/92226e77-aebb-40a7-bae6-04877e57fa42/snapshots/33f80c78-d70c-4161-b1d0-689787d4000d/run
812024-06-17T18:12:25.021ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-92226e77-aebb-40a7-bae6-04877e57fa42-33f80c78-d70c-4161-b1d0-689787d4000d
822024-06-17T18:12:25.026ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-92226e77-aebb-40a7-bae6-04877e57fa42-33f80c78-d70c-4161-b1d0-689787d4000d
832024-06-17T18:12:25.038ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-92226e77-aebb-40a7-bae6-04877e57fa42-33f80c78-d70c-4161-b1d0-689787d4000d
842024-06-17T18:12:25.038ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/92226e77-aebb-40a7-bae6-04877e57fa42/.zfs/snapshot/33f80c78-d70c-4161-b1d0-689787d4000d
852024-06-17T18:12:25.038ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
862024-06-17T18:12:25.038ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
872024-06-17T18:12:25.038ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
882024-06-17T18:12:25.038ZINFOcrucible-agent (worker): commit
892024-06-17T18:12:25.042ZINFOcrucible-agent (worker): ok!
902024-06-17T18:12:25.046ZINFOcrucible-agent (worker): SMF ok!
912024-06-17T18:12:25.046ZINFOcrucible-agent (datafile): region 92226e77-aebb-40a7-bae6-04877e57fa42 running snapshot 33f80c78-d70c-4161-b1d0-689787d4000d state: Requested -> Created
922024-06-17T18:12:27.729ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:37599
932024-06-17T18:12:27.729ZINFOcrucible-agent (datafile): region b726c484-8f9f-4f7c-b92c-a398b1652f21 state: Requested
942024-06-17T18:12:27.729ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
952024-06-17T18:12:27.729ZINFOcrucible-agent (dropshot): request completed latency_us = 251 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37599 req_id = 6a1b69be-9809-40f1-8137-e3bd811ddbb1 response_code = 200 uri = /crucible/0/regions
962024-06-17T18:12:27.739ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/b726c484-8f9f-4f7c-b92c-a398b1652f21
972024-06-17T18:12:27.739ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/b726c484-8f9f-4f7c-b92c-a398b1652f21
982024-06-17T18:12:27.797ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b726c484-8f9f-4f7c-b92c-a398b1652f21"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b726c484-8f9f-4f7c-b92c-a398b1652f21" region = b726c484-8f9f-4f7c-b92c-a398b1652f21
992024-06-17T18:12:27.797ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b726c484-8f9f-4f7c-b92c-a398b1652f21" "--data" "/data/regions/b726c484-8f9f-4f7c-b92c-a398b1652f21" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b726c484-8f9f-4f7c-b92c-a398b1652f21
1002024-06-17T18:12:27.865ZINFOcrucible-agent (worker): region files created ok region = b726c484-8f9f-4f7c-b92c-a398b1652f21
1012024-06-17T18:12:27.865ZINFOcrucible-agent (datafile): region b726c484-8f9f-4f7c-b92c-a398b1652f21 state: Requested -> Created
1022024-06-17T18:12:27.866ZINFOcrucible-agent (worker): applying SMF actions post create...
1032024-06-17T18:12:27.867ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b726c484-8f9f-4f7c-b92c-a398b1652f21
1042024-06-17T18:12:27.871ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b726c484-8f9f-4f7c-b92c-a398b1652f21
1052024-06-17T18:12:27.877ZINFOcrucible-agent (worker): creating config property group
1062024-06-17T18:12:27.880ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b726c484-8f9f-4f7c-b92c-a398b1652f21
1072024-06-17T18:12:27.880ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b726c484-8f9f-4f7c-b92c-a398b1652f21
1082024-06-17T18:12:27.880ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1092024-06-17T18:12:27.880ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
1102024-06-17T18:12:27.880ZINFOcrucible-agent (worker): commit
1112024-06-17T18:12:27.883ZINFOcrucible-agent (worker): ok!
1122024-06-17T18:12:27.889ZINFOcrucible-agent (worker): SMF ok!
1132024-06-17T18:12:27.997ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37599 req_id = 84be6bba-dfc8-47f5-823a-99dd8f4a3c98 response_code = 200 uri = /crucible/0/regions
1142024-06-17T18:12:51.453ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37599 req_id = d8d3e49b-7173-4ca2-960c-38b12a5d6dc3 response_code = 200 uri = /crucible/0/regions/b726c484-8f9f-4f7c-b92c-a398b1652f21
1152024-06-17T18:12:51.455ZINFOcrucible-agent (datafile): path is "/data/regions/b726c484-8f9f-4f7c-b92c-a398b1652f21"
1162024-06-17T18:12:51.467ZINFOcrucible-agent (datafile): dataset is oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/b726c484-8f9f-4f7c-b92c-a398b1652f21
1172024-06-17T18:12:51.476ZINFOcrucible-agent (datafile): region b726c484-8f9f-4f7c-b92c-a398b1652f21 state: Created -> Tombstoned
1182024-06-17T18:12:51.476ZINFOcrucible-agent (worker): applying SMF actions before removal...
1192024-06-17T18:12:51.476ZINFOcrucible-agent (dropshot): request completed latency_us = 20826 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:37599 req_id = a99c845e-252e-4e8b-8bed-a2820839b37b response_code = 204 uri = /crucible/0/regions/b726c484-8f9f-4f7c-b92c-a398b1652f21
1202024-06-17T18:12:51.478ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-b726c484-8f9f-4f7c-b92c-a398b1652f21 (instance states: (Some(Online), None))
1212024-06-17T18:12:51.479ZINFOcrucible-agent (dropshot): request completed latency_us = 22 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37599 req_id = b41ef6a2-62c6-4909-a8b6-f9f045ce28e8 response_code = 200 uri = /crucible/0/regions/b726c484-8f9f-4f7c-b92c-a398b1652f21
1222024-06-17T18:12:51.483ZINFOcrucible-agent (worker): SMF ok!
1232024-06-17T18:12:51.492ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_2f10330f-475e-4093-976d-8267583dac69/crucible/regions/b726c484-8f9f-4f7c-b92c-a398b1652f21" region = b726c484-8f9f-4f7c-b92c-a398b1652f21
1242024-06-17T18:12:51.540ZINFOcrucible-agent (datafile): region b726c484-8f9f-4f7c-b92c-a398b1652f21 state: Tombstoned -> Destroyed
1252024-06-17T18:12:51.622ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37599 req_id = 27aa64a0-aa9e-409a-b78d-c8db30b686bd response_code = 200 uri = /crucible/0/regions/b726c484-8f9f-4f7c-b92c-a398b1652f21