Max level shown:
1 [ Mar 26 15:17:39 Enabled. ]
2 [ Mar 26 15:17:39 Rereading configuration. ]
3 [ Mar 26 15:17:42 Rereading configuration. ]
4 [ Mar 26 15:17:48 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-03-26T15:17:48.942ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 7103cd3a3d7b0112d2949dd135db06fef0c156bb Commit timestamp: 2025-11-10T22:24:53.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-03-26T15:17:48.943ZINFOcrucible-agent: dataset: "oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible"
82026-03-26T15:17:48.943ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
92026-03-26T15:17:48.943ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-03-26T15:17:48.955ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-03-26T15:17:49.066ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
122026-03-26T15:18:41.848ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::c]:52525
132026-03-26T15:18:41.892ZINFOcrucible-agent (datafile): region 4368dcc5-672a-4f5c-b8a1-e348606c9118 state: Requested
142026-03-26T15:18:41.894ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152026-03-26T15:18:41.895ZINFOcrucible-agent (dropshot): request completed latency_us = 18681 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:52525 req_id = 7e330375-44b7-471e-bea3-60f1a5d39939 response_code = 200 uri = /crucible/0/regions
162026-03-26T15:18:41.903ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118
172026-03-26T15:18:41.903ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118
182026-03-26T15:18:41.968ZINFOcrucible-agent (worker): creating region Region { id: RegionId("4368dcc5-672a-4f5c-b8a1-e348606c9118"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118" region = 4368dcc5-672a-4f5c-b8a1-e348606c9118
192026-03-26T15:18:41.971ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "4368dcc5-672a-4f5c-b8a1-e348606c9118" "--data" "/data/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 4368dcc5-672a-4f5c-b8a1-e348606c9118
202026-03-26T15:18:42.194ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:52525 req_id = e7bdc15e-5bad-4e66-9e53-cbb1e727bd97 response_code = 200 uri = /crucible/0/regions
212026-03-26T15:18:42.322ZINFOcrucible-agent (worker): region files created ok region = 4368dcc5-672a-4f5c-b8a1-e348606c9118
222026-03-26T15:18:42.322ZINFOcrucible-agent (datafile): region 4368dcc5-672a-4f5c-b8a1-e348606c9118 state: Requested -> Created
232026-03-26T15:18:42.322ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-03-26T15:18:42.323ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-4368dcc5-672a-4f5c-b8a1-e348606c9118
252026-03-26T15:18:42.330ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-4368dcc5-672a-4f5c-b8a1-e348606c9118
262026-03-26T15:18:42.345ZINFOcrucible-agent (worker): creating config property group
272026-03-26T15:18:42.348ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-4368dcc5-672a-4f5c-b8a1-e348606c9118
282026-03-26T15:18:42.349ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118
292026-03-26T15:18:42.349ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-03-26T15:18:42.349ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
312026-03-26T15:18:42.349ZINFOcrucible-agent (worker): commit
322026-03-26T15:18:42.354ZINFOcrucible-agent (worker): ok!
332026-03-26T15:18:42.359ZINFOcrucible-agent (worker): SMF ok!
342026-03-26T15:18:42.733ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:52525 req_id = 6c65a0b2-6985-4d7b-9651-785cdd6f6e11 response_code = 200 uri = /crucible/0/regions
352026-03-26T15:28:54.294ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::c]:65224
362026-03-26T15:28:54.294ZINFOcrucible-agent (datafile): region 164f3c04-fc99-4697-a693-c2290cefcb49 state: Requested
372026-03-26T15:28:54.295ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
382026-03-26T15:28:54.295ZINFOcrucible-agent (dropshot): request completed latency_us = 850 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:65224 req_id = 77a8a3e1-7ea1-4677-8b7a-77a27f89a05f response_code = 200 uri = /crucible/0/regions
392026-03-26T15:28:54.305ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/164f3c04-fc99-4697-a693-c2290cefcb49
402026-03-26T15:28:54.305ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/164f3c04-fc99-4697-a693-c2290cefcb49
412026-03-26T15:28:54.363ZINFOcrucible-agent (worker): creating region Region { id: RegionId("164f3c04-fc99-4697-a693-c2290cefcb49"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/164f3c04-fc99-4697-a693-c2290cefcb49" region = 164f3c04-fc99-4697-a693-c2290cefcb49
422026-03-26T15:28:54.363ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "164f3c04-fc99-4697-a693-c2290cefcb49" "--data" "/data/regions/164f3c04-fc99-4697-a693-c2290cefcb49" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 164f3c04-fc99-4697-a693-c2290cefcb49
432026-03-26T15:28:54.439ZINFOcrucible-agent (worker): region files created ok region = 164f3c04-fc99-4697-a693-c2290cefcb49
442026-03-26T15:28:54.439ZINFOcrucible-agent (datafile): region 164f3c04-fc99-4697-a693-c2290cefcb49 state: Requested -> Created
452026-03-26T15:28:54.439ZINFOcrucible-agent (worker): applying SMF actions post create...
462026-03-26T15:28:54.440ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-164f3c04-fc99-4697-a693-c2290cefcb49
472026-03-26T15:28:54.451ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-164f3c04-fc99-4697-a693-c2290cefcb49
482026-03-26T15:28:54.473ZINFOcrucible-agent (worker): creating config property group
492026-03-26T15:28:54.476ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-164f3c04-fc99-4697-a693-c2290cefcb49
502026-03-26T15:28:54.477ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/164f3c04-fc99-4697-a693-c2290cefcb49
512026-03-26T15:28:54.477ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
522026-03-26T15:28:54.477ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
532026-03-26T15:28:54.477ZINFOcrucible-agent (worker): commit
542026-03-26T15:28:54.481ZINFOcrucible-agent (worker): ok!
552026-03-26T15:28:54.495ZINFOcrucible-agent (worker): SMF ok!
562026-03-26T15:28:54.627ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:65224 req_id = 684c1929-eb35-4ad6-8040-8d63ff110cab response_code = 200 uri = /crucible/0/regions
572026-03-26T15:28:55.714ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:65224 req_id = 379651c7-10d1-4530-9e1a-b81e04538140 response_code = 200 uri = /crucible/0/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118
582026-03-26T15:28:55.718ZINFOcrucible-agent (datafile): path is "/data/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118"
592026-03-26T15:28:55.725ZINFOcrucible-agent (datafile): dataset is oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118
602026-03-26T15:28:55.732ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118@41a764fc-3d99-48fd-a6cb-ced9d1fe2758
612026-03-26T15:28:55.732ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118", "41a764fc-3d99-48fd-a6cb-ced9d1fe2758"]
622026-03-26T15:28:55.741ZINFOcrucible-agent (dropshot): request completed latency_us = 23234 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:65224 req_id = 4ada6ae6-c10f-41c4-aaf7-2b057470f78f response_code = 200 uri = /crucible/0/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118/snapshots/41a764fc-3d99-48fd-a6cb-ced9d1fe2758
632026-03-26T15:28:55.745ZINFOcrucible-agent (datafile): path is "/data/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118"
642026-03-26T15:28:55.751ZINFOcrucible-agent (datafile): dataset is oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118
652026-03-26T15:28:55.757ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118@41a764fc-3d99-48fd-a6cb-ced9d1fe2758
662026-03-26T15:28:55.757ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118", "41a764fc-3d99-48fd-a6cb-ced9d1fe2758"]
672026-03-26T15:28:55.765ZINFOcrucible-agent (datafile): requesting running snapshot 4368dcc5-672a-4f5c-b8a1-e348606c9118-41a764fc-3d99-48fd-a6cb-ced9d1fe2758 state: Requested
682026-03-26T15:28:55.765ZINFOcrucible-agent (dropshot): request completed latency_us = 20504 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:65224 req_id = 4ba9b55d-d35e-4475-96a4-978f08cee10e response_code = 200 uri = /crucible/0/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118/snapshots/41a764fc-3d99-48fd-a6cb-ced9d1fe2758/run
692026-03-26T15:28:55.765ZINFOcrucible-agent (worker): applying SMF actions for region 4368dcc5-672a-4f5c-b8a1-e348606c9118 running snapshot 41a764fc-3d99-48fd-a6cb-ced9d1fe2758 (state Requested)...
702026-03-26T15:28:55.769ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-4368dcc5-672a-4f5c-b8a1-e348606c9118-41a764fc-3d99-48fd-a6cb-ced9d1fe2758
712026-03-26T15:28:55.782ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-4368dcc5-672a-4f5c-b8a1-e348606c9118-41a764fc-3d99-48fd-a6cb-ced9d1fe2758
722026-03-26T15:28:55.793ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-4368dcc5-672a-4f5c-b8a1-e348606c9118-41a764fc-3d99-48fd-a6cb-ced9d1fe2758
732026-03-26T15:28:55.793ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118/.zfs/snapshot/41a764fc-3d99-48fd-a6cb-ced9d1fe2758
742026-03-26T15:28:55.793ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
752026-03-26T15:28:55.793ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
762026-03-26T15:28:55.793ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
772026-03-26T15:28:55.793ZINFOcrucible-agent (worker): commit
782026-03-26T15:28:55.797ZINFOcrucible-agent (worker): ok!
792026-03-26T15:28:55.801ZINFOcrucible-agent (worker): SMF ok!
802026-03-26T15:28:55.801ZINFOcrucible-agent (datafile): region 4368dcc5-672a-4f5c-b8a1-e348606c9118 running snapshot 41a764fc-3d99-48fd-a6cb-ced9d1fe2758 state: Requested -> Created
812026-03-26T15:28:56.113ZINFOcrucible-agent (datafile): path is "/data/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118"
822026-03-26T15:28:56.120ZINFOcrucible-agent (datafile): dataset is oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118
832026-03-26T15:28:56.126ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118@41a764fc-3d99-48fd-a6cb-ced9d1fe2758
842026-03-26T15:28:56.126ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118", "41a764fc-3d99-48fd-a6cb-ced9d1fe2758"]
852026-03-26T15:28:56.132ZINFOcrucible-agent (dropshot): request completed latency_us = 19459 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:65224 req_id = 5b54d6f0-1dbe-4ee2-9899-3e469c68d7f0 response_code = 200 uri = /crucible/0/regions/4368dcc5-672a-4f5c-b8a1-e348606c9118/snapshots/41a764fc-3d99-48fd-a6cb-ced9d1fe2758/run
862026-03-26T15:29:01.619ZINFOcrucible-agent (datafile): region 97cede2e-a40f-468e-a3f2-59a95dee89c8 state: Requested
872026-03-26T15:29:01.619ZINFOcrucible-agent (dropshot): request completed latency_us = 214 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:65224 req_id = 0434aa5a-2a6a-4c0b-acbc-fdac11a22083 response_code = 200 uri = /crucible/0/regions
882026-03-26T15:29:01.619ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
892026-03-26T15:29:01.625ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/97cede2e-a40f-468e-a3f2-59a95dee89c8
902026-03-26T15:29:01.625ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/97cede2e-a40f-468e-a3f2-59a95dee89c8
912026-03-26T15:29:01.684ZINFOcrucible-agent (worker): creating region Region { id: RegionId("97cede2e-a40f-468e-a3f2-59a95dee89c8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/97cede2e-a40f-468e-a3f2-59a95dee89c8" region = 97cede2e-a40f-468e-a3f2-59a95dee89c8
922026-03-26T15:29:01.684ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "97cede2e-a40f-468e-a3f2-59a95dee89c8" "--data" "/data/regions/97cede2e-a40f-468e-a3f2-59a95dee89c8" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 97cede2e-a40f-468e-a3f2-59a95dee89c8
932026-03-26T15:29:01.756ZINFOcrucible-agent (worker): region files created ok region = 97cede2e-a40f-468e-a3f2-59a95dee89c8
942026-03-26T15:29:01.756ZINFOcrucible-agent (datafile): region 97cede2e-a40f-468e-a3f2-59a95dee89c8 state: Requested -> Created
952026-03-26T15:29:01.756ZINFOcrucible-agent (worker): applying SMF actions post create...
962026-03-26T15:29:01.758ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-97cede2e-a40f-468e-a3f2-59a95dee89c8
972026-03-26T15:29:01.761ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-97cede2e-a40f-468e-a3f2-59a95dee89c8
982026-03-26T15:29:01.772ZINFOcrucible-agent (worker): creating config property group
992026-03-26T15:29:01.775ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-97cede2e-a40f-468e-a3f2-59a95dee89c8
1002026-03-26T15:29:01.776ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/97cede2e-a40f-468e-a3f2-59a95dee89c8
1012026-03-26T15:29:01.776ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
1022026-03-26T15:29:01.776ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
1032026-03-26T15:29:01.776ZINFOcrucible-agent (worker): commit
1042026-03-26T15:29:01.779ZINFOcrucible-agent (worker): ok!
1052026-03-26T15:29:01.785ZINFOcrucible-agent (worker): SMF ok!
1062026-03-26T15:29:01.811ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:65224 req_id = f5ad5b9a-c739-4c3d-8144-c680d4d122f0 response_code = 200 uri = /crucible/0/regions
1072026-03-26T15:29:27.496ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:65224 req_id = 67e88371-bed8-454d-931a-b082d93e5a2f response_code = 200 uri = /crucible/0/regions/97cede2e-a40f-468e-a3f2-59a95dee89c8
1082026-03-26T15:29:27.498ZINFOcrucible-agent (datafile): path is "/data/regions/97cede2e-a40f-468e-a3f2-59a95dee89c8"
1092026-03-26T15:29:27.507ZINFOcrucible-agent (datafile): dataset is oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/97cede2e-a40f-468e-a3f2-59a95dee89c8
1102026-03-26T15:29:27.515ZINFOcrucible-agent (datafile): region 97cede2e-a40f-468e-a3f2-59a95dee89c8 state: Created -> Tombstoned
1112026-03-26T15:29:27.515ZINFOcrucible-agent (dropshot): request completed latency_us = 16613 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:65224 req_id = 4afe4d48-0027-4e04-9887-f950a6144971 response_code = 204 uri = /crucible/0/regions/97cede2e-a40f-468e-a3f2-59a95dee89c8
1122026-03-26T15:29:27.515ZINFOcrucible-agent (worker): applying SMF actions before removal...
1132026-03-26T15:29:27.516ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-97cede2e-a40f-468e-a3f2-59a95dee89c8 (instance states: (Some(Online), None))
1142026-03-26T15:29:27.519ZINFOcrucible-agent (dropshot): request completed latency_us = 32 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:65224 req_id = 153c269e-f305-4eb0-bbbc-d61fe343a31a response_code = 200 uri = /crucible/0/regions/97cede2e-a40f-468e-a3f2-59a95dee89c8
1152026-03-26T15:29:27.526ZINFOcrucible-agent (worker): SMF ok!
1162026-03-26T15:29:27.533ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_8541defb-f7cc-49eb-9f05-247131d7cb9c/crucible/regions/97cede2e-a40f-468e-a3f2-59a95dee89c8" region = 97cede2e-a40f-468e-a3f2-59a95dee89c8
1172026-03-26T15:29:27.592ZINFOcrucible-agent (datafile): region 97cede2e-a40f-468e-a3f2-59a95dee89c8 state: Tombstoned -> Destroyed
1182026-03-26T15:29:27.618ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:65224 req_id = 44d622a6-4464-4b9c-8555-8c16d429bbb6 response_code = 200 uri = /crucible/0/regions/97cede2e-a40f-468e-a3f2-59a95dee89c8