Max level shown:
1 [ Feb 5 23:45:03 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
2 note: configured to log to "/dev/stdout"
32026-02-05T23:45:03.371ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 7103cd3a3d7b0112d2949dd135db06fef0c156bb Commit timestamp: 2025-11-10T22:24:53.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
42026-02-05T23:45:03.371ZINFOcrucible-agent: dataset: "oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible"
52026-02-05T23:45:03.371ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
62026-02-05T23:45:03.372ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
72026-02-05T23:45:03.394ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
82026-02-05T23:45:03.580ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
92026-02-05T23:45:53.015ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::c]:56750
102026-02-05T23:45:53.042ZINFOcrucible-agent (datafile): region 6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe state: Requested
112026-02-05T23:45:53.044ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
122026-02-05T23:45:53.044ZINFOcrucible-agent (dropshot): request completed latency_us = 13634 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:56750 req_id = aa850012-afa3-45e4-b17a-f70ae6f6a75a response_code = 200 uri = /crucible/0/regions
132026-02-05T23:45:53.052ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe
142026-02-05T23:45:53.052ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe
152026-02-05T23:45:53.100ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe" region = 6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe
162026-02-05T23:45:53.103ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe" "--data" "/data/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe
172026-02-05T23:45:53.294ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:56750 req_id = d331cace-3a95-4247-ba4a-d35b18e7b155 response_code = 200 uri = /crucible/0/regions
182026-02-05T23:45:53.462ZINFOcrucible-agent (worker): region files created ok region = 6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe
192026-02-05T23:45:53.462ZINFOcrucible-agent (datafile): region 6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe state: Requested -> Created
202026-02-05T23:45:53.463ZINFOcrucible-agent (worker): applying SMF actions post create...
212026-02-05T23:45:53.463ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe
222026-02-05T23:45:53.471ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe
232026-02-05T23:45:53.488ZINFOcrucible-agent (worker): creating config property group
242026-02-05T23:45:53.491ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe
252026-02-05T23:45:53.492ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe
262026-02-05T23:45:53.492ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
272026-02-05T23:45:53.492ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
282026-02-05T23:45:53.492ZINFOcrucible-agent (worker): commit
292026-02-05T23:45:53.497ZINFOcrucible-agent (worker): ok!
302026-02-05T23:45:53.501ZINFOcrucible-agent (worker): SMF ok!
312026-02-05T23:45:53.902ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:56750 req_id = a210e306-13ab-4706-838c-190fae7a99ca response_code = 200 uri = /crucible/0/regions
322026-02-05T23:57:04.273ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::c]:38251
332026-02-05T23:57:04.274ZINFOcrucible-agent (datafile): region da6203c8-6921-48b1-9c2f-8c89552148ea state: Requested
342026-02-05T23:57:04.274ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
352026-02-05T23:57:04.274ZINFOcrucible-agent (dropshot): request completed latency_us = 1086 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38251 req_id = c7d351f0-e328-4ddc-86cf-0ef925a43665 response_code = 200 uri = /crucible/0/regions
362026-02-05T23:57:04.281ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/da6203c8-6921-48b1-9c2f-8c89552148ea
372026-02-05T23:57:04.281ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/da6203c8-6921-48b1-9c2f-8c89552148ea
382026-02-05T23:57:04.329ZINFOcrucible-agent (worker): creating region Region { id: RegionId("da6203c8-6921-48b1-9c2f-8c89552148ea"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/da6203c8-6921-48b1-9c2f-8c89552148ea" region = da6203c8-6921-48b1-9c2f-8c89552148ea
392026-02-05T23:57:04.329ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "da6203c8-6921-48b1-9c2f-8c89552148ea" "--data" "/data/regions/da6203c8-6921-48b1-9c2f-8c89552148ea" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = da6203c8-6921-48b1-9c2f-8c89552148ea
402026-02-05T23:57:04.403ZINFOcrucible-agent (worker): region files created ok region = da6203c8-6921-48b1-9c2f-8c89552148ea
412026-02-05T23:57:04.403ZINFOcrucible-agent (datafile): region da6203c8-6921-48b1-9c2f-8c89552148ea state: Requested -> Created
422026-02-05T23:57:04.403ZINFOcrucible-agent (worker): applying SMF actions post create...
432026-02-05T23:57:04.422ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-da6203c8-6921-48b1-9c2f-8c89552148ea
442026-02-05T23:57:04.429ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-da6203c8-6921-48b1-9c2f-8c89552148ea
452026-02-05T23:57:04.440ZINFOcrucible-agent (worker): creating config property group
462026-02-05T23:57:04.443ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-da6203c8-6921-48b1-9c2f-8c89552148ea
472026-02-05T23:57:04.443ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/da6203c8-6921-48b1-9c2f-8c89552148ea
482026-02-05T23:57:04.443ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
492026-02-05T23:57:04.443ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
502026-02-05T23:57:04.443ZINFOcrucible-agent (worker): commit
512026-02-05T23:57:04.448ZINFOcrucible-agent (worker): ok!
522026-02-05T23:57:04.453ZINFOcrucible-agent (worker): SMF ok!
532026-02-05T23:57:04.604ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38251 req_id = 6e1fea5e-1f74-47a8-afab-2a102281e6b0 response_code = 200 uri = /crucible/0/regions
542026-02-05T23:57:06.289ZINFOcrucible-agent (dropshot): request completed latency_us = 88 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38251 req_id = b6db2a36-686d-4037-9249-c0612d1bdfb8 response_code = 200 uri = /crucible/0/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe
552026-02-05T23:57:06.295ZINFOcrucible-agent (datafile): path is "/data/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe"
562026-02-05T23:57:06.301ZINFOcrucible-agent (datafile): dataset is oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe
572026-02-05T23:57:06.308ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe@5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f
582026-02-05T23:57:06.308ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe", "5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f"]
592026-02-05T23:57:06.315ZINFOcrucible-agent (dropshot): request completed latency_us = 20599 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38251 req_id = 068f0b42-69da-48b8-8076-66a2916e39c4 response_code = 200 uri = /crucible/0/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe/snapshots/5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f
602026-02-05T23:57:06.319ZINFOcrucible-agent (datafile): path is "/data/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe"
612026-02-05T23:57:06.325ZINFOcrucible-agent (datafile): dataset is oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe
622026-02-05T23:57:06.331ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe@5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f
632026-02-05T23:57:06.331ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe", "5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f"]
642026-02-05T23:57:06.339ZINFOcrucible-agent (datafile): requesting running snapshot 6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe-5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f state: Requested
652026-02-05T23:57:06.339ZINFOcrucible-agent (worker): applying SMF actions for region 6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe running snapshot 5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f (state Requested)...
662026-02-05T23:57:06.339ZINFOcrucible-agent (dropshot): request completed latency_us = 20398 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38251 req_id = 46d0f847-c9d0-4ef1-8b81-ecf6141fc9f1 response_code = 200 uri = /crucible/0/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe/snapshots/5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f/run
672026-02-05T23:57:06.344ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe-5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f
682026-02-05T23:57:06.356ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe-5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f
692026-02-05T23:57:06.365ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe-5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f
702026-02-05T23:57:06.365ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe/.zfs/snapshot/5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f
712026-02-05T23:57:06.365ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
722026-02-05T23:57:06.365ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
732026-02-05T23:57:06.365ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
742026-02-05T23:57:06.365ZINFOcrucible-agent (worker): commit
752026-02-05T23:57:06.369ZINFOcrucible-agent (worker): ok!
762026-02-05T23:57:06.373ZINFOcrucible-agent (worker): SMF ok!
772026-02-05T23:57:06.373ZINFOcrucible-agent (datafile): region 6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe running snapshot 5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f state: Requested -> Created
782026-02-05T23:57:06.709ZINFOcrucible-agent (datafile): path is "/data/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe"
792026-02-05T23:57:06.716ZINFOcrucible-agent (datafile): dataset is oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe
802026-02-05T23:57:06.722ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe@5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f
812026-02-05T23:57:06.722ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe", "5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f"]
822026-02-05T23:57:06.728ZINFOcrucible-agent (dropshot): request completed latency_us = 18124 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38251 req_id = 809af8be-f2b1-4b37-bb9b-93fd2453a21a response_code = 200 uri = /crucible/0/regions/6ef0c57d-0a0c-4d7a-a7da-2a7bb75ac0fe/snapshots/5e6d76e8-1b76-4174-8aee-55c5e6ee2f9f/run
832026-02-05T23:57:11.355ZINFOcrucible-agent (datafile): region 105ded62-48b3-4975-bcb6-864a19fc6bf0 state: Requested
842026-02-05T23:57:11.356ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
852026-02-05T23:57:11.356ZINFOcrucible-agent (dropshot): request completed latency_us = 267 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38251 req_id = 3b97c537-f7d8-4d47-85fe-8842eaefcea6 response_code = 200 uri = /crucible/0/regions
862026-02-05T23:57:11.362ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/105ded62-48b3-4975-bcb6-864a19fc6bf0
872026-02-05T23:57:11.362ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/105ded62-48b3-4975-bcb6-864a19fc6bf0
882026-02-05T23:57:11.400ZINFOcrucible-agent (worker): creating region Region { id: RegionId("105ded62-48b3-4975-bcb6-864a19fc6bf0"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/105ded62-48b3-4975-bcb6-864a19fc6bf0" region = 105ded62-48b3-4975-bcb6-864a19fc6bf0
892026-02-05T23:57:11.400ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "105ded62-48b3-4975-bcb6-864a19fc6bf0" "--data" "/data/regions/105ded62-48b3-4975-bcb6-864a19fc6bf0" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 105ded62-48b3-4975-bcb6-864a19fc6bf0
902026-02-05T23:57:11.483ZINFOcrucible-agent (worker): region files created ok region = 105ded62-48b3-4975-bcb6-864a19fc6bf0
912026-02-05T23:57:11.483ZINFOcrucible-agent (datafile): region 105ded62-48b3-4975-bcb6-864a19fc6bf0 state: Requested -> Created
922026-02-05T23:57:11.483ZINFOcrucible-agent (worker): applying SMF actions post create...
932026-02-05T23:57:11.483ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-105ded62-48b3-4975-bcb6-864a19fc6bf0
942026-02-05T23:57:11.486ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-105ded62-48b3-4975-bcb6-864a19fc6bf0
952026-02-05T23:57:11.493ZINFOcrucible-agent (worker): creating config property group
962026-02-05T23:57:11.496ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-105ded62-48b3-4975-bcb6-864a19fc6bf0
972026-02-05T23:57:11.496ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/105ded62-48b3-4975-bcb6-864a19fc6bf0
982026-02-05T23:57:11.496ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
992026-02-05T23:57:11.496ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
1002026-02-05T23:57:11.496ZINFOcrucible-agent (worker): commit
1012026-02-05T23:57:11.500ZINFOcrucible-agent (worker): ok!
1022026-02-05T23:57:11.510ZINFOcrucible-agent (worker): SMF ok!
1032026-02-05T23:57:11.568ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38251 req_id = fcf654d8-bd29-49b3-9da7-c55ab8b3441c response_code = 200 uri = /crucible/0/regions
1042026-02-05T23:57:36.112ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38251 req_id = c689c58b-2ccc-484e-9a3d-0c857d2bb00b response_code = 200 uri = /crucible/0/regions/105ded62-48b3-4975-bcb6-864a19fc6bf0
1052026-02-05T23:57:36.116ZINFOcrucible-agent (datafile): path is "/data/regions/105ded62-48b3-4975-bcb6-864a19fc6bf0"
1062026-02-05T23:57:36.126ZINFOcrucible-agent (datafile): dataset is oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/105ded62-48b3-4975-bcb6-864a19fc6bf0
1072026-02-05T23:57:36.133ZINFOcrucible-agent (datafile): region 105ded62-48b3-4975-bcb6-864a19fc6bf0 state: Created -> Tombstoned
1082026-02-05T23:57:36.134ZINFOcrucible-agent (worker): applying SMF actions before removal...
1092026-02-05T23:57:36.134ZINFOcrucible-agent (dropshot): request completed latency_us = 17977 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:38251 req_id = 99188793-49d8-4a4b-a961-0174947c9fe6 response_code = 204 uri = /crucible/0/regions/105ded62-48b3-4975-bcb6-864a19fc6bf0
1102026-02-05T23:57:36.135ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-105ded62-48b3-4975-bcb6-864a19fc6bf0 (instance states: (Some(Online), None))
1112026-02-05T23:57:36.137ZINFOcrucible-agent (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38251 req_id = 9ef27fc2-c87c-478a-a588-35567f37c148 response_code = 200 uri = /crucible/0/regions/105ded62-48b3-4975-bcb6-864a19fc6bf0
1122026-02-05T23:57:36.152ZINFOcrucible-agent (worker): SMF ok!
1132026-02-05T23:57:36.161ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_aa284d21-36a1-4bb8-9512-75f515e83c76/crucible/regions/105ded62-48b3-4975-bcb6-864a19fc6bf0" region = 105ded62-48b3-4975-bcb6-864a19fc6bf0
1142026-02-05T23:57:36.214ZINFOcrucible-agent (datafile): region 105ded62-48b3-4975-bcb6-864a19fc6bf0 state: Tombstoned -> Destroyed
1152026-02-05T23:57:36.241ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38251 req_id = 64e3b44e-2a43-4986-9b35-293a5d21006f response_code = 200 uri = /crucible/0/regions/105ded62-48b3-4975-bcb6-864a19fc6bf0