Max level shown:
1 [ Mar 13 04:51:51 Enabled. ]
2 [ Mar 13 04:51:51 Rereading configuration. ]
3 [ Mar 13 04:51:55 Rereading configuration. ]
4 [ Mar 13 04:52:04 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-03-13T04:52:04.480ZINFOcrucible-agent: dataset: "oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible"
72024-03-13T04:52:04.483ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
82024-03-13T04:52:04.483ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-03-13T04:52:04.675ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
102024-03-13T04:52:23.327ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:64170
112024-03-13T04:52:23.388ZINFOcrucible-agent (datafile): region ce033bfe-9230-4d19-a9d2-912a765ad2ca state: Requested
122024-03-13T04:52:23.388ZINFOcrucible-agent (dropshot): request completed latency_us = 1640 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64170 req_id = 1f5422ea-1f6f-439d-94ec-ca51e717d842 response_code = 200 uri = /crucible/0/regions
132024-03-13T04:52:23.389ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-03-13T04:52:23.398ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/ce033bfe-9230-4d19-a9d2-912a765ad2ca
152024-03-13T04:52:23.398ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/ce033bfe-9230-4d19-a9d2-912a765ad2ca
162024-03-13T04:52:23.497ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ce033bfe-9230-4d19-a9d2-912a765ad2ca"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/ce033bfe-9230-4d19-a9d2-912a765ad2ca" region = ce033bfe-9230-4d19-a9d2-912a765ad2ca
172024-03-13T04:52:23.580ZINFOcrucible-agent (dropshot): request completed latency_us = 920 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64170 req_id = dabddc76-5624-40f7-888b-8dce5299186b response_code = 200 uri = /crucible/0/regions
182024-03-13T04:52:23.669ZINFOcrucible-agent (worker): region files created ok region = ce033bfe-9230-4d19-a9d2-912a765ad2ca
192024-03-13T04:52:23.669ZINFOcrucible-agent (datafile): region ce033bfe-9230-4d19-a9d2-912a765ad2ca state: Requested -> Created
202024-03-13T04:52:23.669ZINFOcrucible-agent (worker): applying SMF actions post create...
212024-03-13T04:52:23.670ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ce033bfe-9230-4d19-a9d2-912a765ad2ca
222024-03-13T04:52:23.678ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ce033bfe-9230-4d19-a9d2-912a765ad2ca
232024-03-13T04:52:23.706ZINFOcrucible-agent (worker): creating config property group
242024-03-13T04:52:23.717ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ce033bfe-9230-4d19-a9d2-912a765ad2ca
252024-03-13T04:52:23.718ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ce033bfe-9230-4d19-a9d2-912a765ad2ca
262024-03-13T04:52:23.718ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
272024-03-13T04:52:23.718ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
282024-03-13T04:52:23.718ZINFOcrucible-agent (worker): commit
292024-03-13T04:52:23.730ZINFOcrucible-agent (worker): ok!
302024-03-13T04:52:23.741ZINFOcrucible-agent (worker): SMF ok!
312024-03-13T04:52:24.145ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64170 req_id = 439aa6cd-12ad-49dc-85b3-21447b8fccab response_code = 200 uri = /crucible/0/regions
322024-03-13T04:52:24.487ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:39770
332024-03-13T04:52:24.487ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:39770 req_id = bde3c9d2-af6e-40a3-a941-c89df61dd4d9 response_code = 200 uri = /crucible/0/regions/ce033bfe-9230-4d19-a9d2-912a765ad2ca
342024-03-13T04:52:24.487ZINFOcrucible-agent (datafile): path is "/data/regions/ce033bfe-9230-4d19-a9d2-912a765ad2ca"
352024-03-13T04:52:24.496ZINFOcrucible-agent (datafile): dataset is oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/ce033bfe-9230-4d19-a9d2-912a765ad2ca
362024-03-13T04:52:24.505ZINFOcrucible-agent (datafile): region ce033bfe-9230-4d19-a9d2-912a765ad2ca state: Created -> Tombstoned
372024-03-13T04:52:24.505ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-03-13T04:52:24.505ZINFOcrucible-agent (dropshot): request completed latency_us = 17507 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:39770 req_id = 00073cc0-1d22-442d-b5c2-65b7a67551cf response_code = 204 uri = /crucible/0/regions/ce033bfe-9230-4d19-a9d2-912a765ad2ca
392024-03-13T04:52:24.505ZINFOcrucible-agent (dropshot): request completed latency_us = 22 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:39770 req_id = 144f2c14-5ed4-434d-8c41-ed5547907441 response_code = 200 uri = /crucible/0/regions/ce033bfe-9230-4d19-a9d2-912a765ad2ca
402024-03-13T04:52:24.506ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-ce033bfe-9230-4d19-a9d2-912a765ad2ca (instance states: (Some(Online), None))
412024-03-13T04:52:24.513ZINFOcrucible-agent (worker): SMF ok!
422024-03-13T04:52:24.523ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/ce033bfe-9230-4d19-a9d2-912a765ad2ca" region = ce033bfe-9230-4d19-a9d2-912a765ad2ca
432024-03-13T04:52:24.591ZINFOcrucible-agent (datafile): region ce033bfe-9230-4d19-a9d2-912a765ad2ca state: Tombstoned -> Destroyed
442024-03-13T04:52:24.640ZINFOcrucible-agent (dropshot): request completed latency_us = 579 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:39770 req_id = f9300cde-dd08-4175-8120-e3832d82f7d1 response_code = 200 uri = /crucible/0/regions/ce033bfe-9230-4d19-a9d2-912a765ad2ca
452024-03-13T04:52:26.464ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:54517
462024-03-13T04:52:26.465ZINFOcrucible-agent (datafile): region dedd7bc4-90c2-48f0-96ae-93981d75768b state: Requested
472024-03-13T04:52:26.465ZINFOcrucible-agent (dropshot): request completed latency_us = 1006 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54517 req_id = edab5b29-276e-4d50-bd9c-af440679815f response_code = 200 uri = /crucible/0/regions
482024-03-13T04:52:26.465ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492024-03-13T04:52:26.475ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b
502024-03-13T04:52:26.475ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b
512024-03-13T04:52:26.560ZINFOcrucible-agent (worker): creating region Region { id: RegionId("dedd7bc4-90c2-48f0-96ae-93981d75768b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b" region = dedd7bc4-90c2-48f0-96ae-93981d75768b
522024-03-13T04:52:26.670ZINFOcrucible-agent (worker): region files created ok region = dedd7bc4-90c2-48f0-96ae-93981d75768b
532024-03-13T04:52:26.670ZINFOcrucible-agent (datafile): region dedd7bc4-90c2-48f0-96ae-93981d75768b state: Requested -> Created
542024-03-13T04:52:26.670ZINFOcrucible-agent (worker): applying SMF actions post create...
552024-03-13T04:52:26.672ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-dedd7bc4-90c2-48f0-96ae-93981d75768b
562024-03-13T04:52:26.675ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-dedd7bc4-90c2-48f0-96ae-93981d75768b
572024-03-13T04:52:26.689ZINFOcrucible-agent (worker): creating config property group
582024-03-13T04:52:26.699ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-dedd7bc4-90c2-48f0-96ae-93981d75768b
592024-03-13T04:52:26.699ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b
602024-03-13T04:52:26.699ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-03-13T04:52:26.700ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
622024-03-13T04:52:26.700ZINFOcrucible-agent (worker): commit
632024-03-13T04:52:26.706ZINFOcrucible-agent (worker): ok!
642024-03-13T04:52:26.712ZINFOcrucible-agent (worker): SMF ok!
652024-03-13T04:52:26.820ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54517 req_id = f0fb31f5-d8eb-45c7-b00b-ffa45adc1289 response_code = 200 uri = /crucible/0/regions
662024-03-13T04:57:45.636ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:35194
672024-03-13T04:57:45.637ZINFOcrucible-agent (dropshot): request completed latency_us = 510 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35194 req_id = f9c0daf1-95bd-43df-a22b-05ca548b4f0d response_code = 200 uri = /crucible/0/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b
682024-03-13T04:57:45.637ZINFOcrucible-agent (datafile): path is "/data/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b"
692024-03-13T04:57:45.646ZINFOcrucible-agent (datafile): dataset is oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b
702024-03-13T04:57:45.654ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b@6c125d2f-b8d1-4fdb-bccf-20213af38f6d
712024-03-13T04:57:45.654ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b", "6c125d2f-b8d1-4fdb-bccf-20213af38f6d"]
722024-03-13T04:57:45.665ZINFOcrucible-agent (dropshot): request completed latency_us = 27895 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35194 req_id = 79d3b34c-a64f-401d-8158-1d2a45f0e1b5 response_code = 200 uri = /crucible/0/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b/snapshots/6c125d2f-b8d1-4fdb-bccf-20213af38f6d
732024-03-13T04:57:45.665ZINFOcrucible-agent (datafile): path is "/data/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b"
742024-03-13T04:57:45.673ZINFOcrucible-agent (datafile): dataset is oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b
752024-03-13T04:57:45.680ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b@6c125d2f-b8d1-4fdb-bccf-20213af38f6d
762024-03-13T04:57:45.680ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b", "6c125d2f-b8d1-4fdb-bccf-20213af38f6d"]
772024-03-13T04:57:45.691ZINFOcrucible-agent (datafile): requesting running snapshot dedd7bc4-90c2-48f0-96ae-93981d75768b-6c125d2f-b8d1-4fdb-bccf-20213af38f6d state: Requested
782024-03-13T04:57:45.692ZINFOcrucible-agent (worker): applying SMF actions for region dedd7bc4-90c2-48f0-96ae-93981d75768b running snapshot 6c125d2f-b8d1-4fdb-bccf-20213af38f6d (state Requested)...
792024-03-13T04:57:45.692ZINFOcrucible-agent (dropshot): request completed latency_us = 26750 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35194 req_id = bc6b80ea-0a83-4f9d-af6e-39a510903be7 response_code = 200 uri = /crucible/0/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b/snapshots/6c125d2f-b8d1-4fdb-bccf-20213af38f6d/run
802024-03-13T04:57:45.700ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-dedd7bc4-90c2-48f0-96ae-93981d75768b-6c125d2f-b8d1-4fdb-bccf-20213af38f6d
812024-03-13T04:57:45.706ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-dedd7bc4-90c2-48f0-96ae-93981d75768b-6c125d2f-b8d1-4fdb-bccf-20213af38f6d
822024-03-13T04:57:45.717ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-dedd7bc4-90c2-48f0-96ae-93981d75768b-6c125d2f-b8d1-4fdb-bccf-20213af38f6d
832024-03-13T04:57:45.717ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/dedd7bc4-90c2-48f0-96ae-93981d75768b/.zfs/snapshot/6c125d2f-b8d1-4fdb-bccf-20213af38f6d
842024-03-13T04:57:45.717ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
852024-03-13T04:57:45.717ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
862024-03-13T04:57:45.717ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
872024-03-13T04:57:45.717ZINFOcrucible-agent (worker): commit
882024-03-13T04:57:45.720ZINFOcrucible-agent (worker): ok!
892024-03-13T04:57:45.724ZINFOcrucible-agent (worker): SMF ok!
902024-03-13T04:57:45.724ZINFOcrucible-agent (datafile): region dedd7bc4-90c2-48f0-96ae-93981d75768b running snapshot 6c125d2f-b8d1-4fdb-bccf-20213af38f6d state: Requested -> Created
912024-03-13T04:57:48.508ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:57220
922024-03-13T04:57:48.567ZINFOcrucible-agent (datafile): region 9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6 state: Requested
932024-03-13T04:57:48.568ZINFOcrucible-agent (dropshot): request completed latency_us = 285 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57220 req_id = a9563935-e866-43ab-ad3b-29acc27f4240 response_code = 200 uri = /crucible/0/regions
942024-03-13T04:57:48.568ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
952024-03-13T04:57:48.578ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6
962024-03-13T04:57:48.578ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6
972024-03-13T04:57:48.652ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6" region = 9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6
982024-03-13T04:57:48.712ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57220 req_id = 562ee083-7377-4f8f-8e9e-111a433f077d response_code = 200 uri = /crucible/0/regions
992024-03-13T04:57:48.744ZINFOcrucible-agent (worker): region files created ok region = 9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6
1002024-03-13T04:57:48.744ZINFOcrucible-agent (datafile): region 9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6 state: Requested -> Created
1012024-03-13T04:57:48.744ZINFOcrucible-agent (worker): applying SMF actions post create...
1022024-03-13T04:57:48.745ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6
1032024-03-13T04:57:48.748ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6
1042024-03-13T04:57:48.755ZINFOcrucible-agent (worker): creating config property group
1052024-03-13T04:57:48.758ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6
1062024-03-13T04:57:48.758ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6
1072024-03-13T04:57:48.758ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1082024-03-13T04:57:48.758ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
1092024-03-13T04:57:48.758ZINFOcrucible-agent (worker): commit
1102024-03-13T04:57:48.761ZINFOcrucible-agent (worker): ok!
1112024-03-13T04:57:48.771ZINFOcrucible-agent (worker): SMF ok!
1122024-03-13T04:57:49.431ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57220 req_id = 1d76e6ce-91e3-46c9-8f5e-af6f35a3a465 response_code = 200 uri = /crucible/0/regions
1132024-03-13T04:58:29.396ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:61193
1142024-03-13T04:58:29.396ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:61193 req_id = 3ddf5df6-6927-484f-85a4-cb9ae9278ad0 response_code = 200 uri = /crucible/0/regions/9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6
1152024-03-13T04:58:29.396ZINFOcrucible-agent (datafile): path is "/data/regions/9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6"
1162024-03-13T04:58:29.407ZINFOcrucible-agent (datafile): dataset is oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6
1172024-03-13T04:58:29.415ZINFOcrucible-agent (datafile): region 9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6 state: Created -> Tombstoned
1182024-03-13T04:58:29.415ZINFOcrucible-agent (worker): applying SMF actions before removal...
1192024-03-13T04:58:29.415ZINFOcrucible-agent (dropshot): request completed latency_us = 19449 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:61193 req_id = 5d43c8f1-b1d1-4a06-8017-df6e6c1478b7 response_code = 204 uri = /crucible/0/regions/9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6
1202024-03-13T04:58:29.416ZINFOcrucible-agent (dropshot): request completed latency_us = 26 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:61193 req_id = 517e146b-565b-4d50-9476-43a587b15a7b response_code = 200 uri = /crucible/0/regions/9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6
1212024-03-13T04:58:29.417ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6 (instance states: (Some(Online), None))
1222024-03-13T04:58:29.424ZINFOcrucible-agent (worker): SMF ok!
1232024-03-13T04:58:29.433ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6" region = 9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6
1242024-03-13T04:58:29.479ZINFOcrucible-agent (datafile): region 9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6 state: Tombstoned -> Destroyed
1252024-03-13T04:58:29.523ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:61193 req_id = 0281cf0d-bf0e-463a-8da1-eefe8879618e response_code = 200 uri = /crucible/0/regions/9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6