Max level shown:
1 [ Sep 23 18:20:58 Enabled. ]
2 [ Sep 23 18:20:58 Rereading configuration. ]
3 [ Sep 23 18:21:01 Rereading configuration. ]
4 [ Sep 23 18:21:08 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-09-23T18:21:08.692ZINFOcrucible-agent: dataset: "oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible"
72024-09-23T18:21:08.695ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
82024-09-23T18:21:08.695ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-09-23T18:21:08.710ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-09-23T18:21:08.975ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
112024-09-23T18:22:34.473ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:63933
122024-09-23T18:22:34.510ZINFOcrucible-agent (datafile): region 5974210c-41ae-4667-b206-8171012260ea state: Requested
132024-09-23T18:22:34.515ZINFOcrucible-agent (dropshot): request completed latency_us = 23878 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63933 req_id = 20de2100-4934-4f45-bc23-12a7a0bcf0c2 response_code = 200 uri = /crucible/0/regions
142024-09-23T18:22:34.519ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152024-09-23T18:22:34.528ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible/regions/5974210c-41ae-4667-b206-8171012260ea
162024-09-23T18:22:34.528ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible/regions/5974210c-41ae-4667-b206-8171012260ea
172024-09-23T18:22:34.582ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5974210c-41ae-4667-b206-8171012260ea"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5974210c-41ae-4667-b206-8171012260ea" region = 5974210c-41ae-4667-b206-8171012260ea
182024-09-23T18:22:34.586ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5974210c-41ae-4667-b206-8171012260ea" "--data" "/data/regions/5974210c-41ae-4667-b206-8171012260ea" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5974210c-41ae-4667-b206-8171012260ea
192024-09-23T18:22:34.879ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63933 req_id = a5a6eb98-6d40-4a84-bcdb-d944471e3183 response_code = 200 uri = /crucible/0/regions
202024-09-23T18:22:34.892ZINFOcrucible-agent (worker): region files created ok region = 5974210c-41ae-4667-b206-8171012260ea
212024-09-23T18:22:34.892ZINFOcrucible-agent (datafile): region 5974210c-41ae-4667-b206-8171012260ea state: Requested -> Created
222024-09-23T18:22:34.893ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-09-23T18:22:34.895ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5974210c-41ae-4667-b206-8171012260ea
242024-09-23T18:22:34.901ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5974210c-41ae-4667-b206-8171012260ea
252024-09-23T18:22:34.917ZINFOcrucible-agent (worker): creating config property group
262024-09-23T18:22:34.921ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5974210c-41ae-4667-b206-8171012260ea
272024-09-23T18:22:34.922ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5974210c-41ae-4667-b206-8171012260ea
282024-09-23T18:22:34.925ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-09-23T18:22:34.925ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
302024-09-23T18:22:34.925ZINFOcrucible-agent (worker): commit
312024-09-23T18:22:34.933ZINFOcrucible-agent (worker): ok!
322024-09-23T18:22:34.941ZINFOcrucible-agent (worker): SMF ok!
332024-09-23T18:22:35.555ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63933 req_id = 72b46877-b814-4fc8-b5d8-562541e10b1f response_code = 200 uri = /crucible/0/regions
342024-09-23T18:27:51.607ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:48854
352024-09-23T18:27:51.607ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48854 req_id = f56fa261-f996-4ed1-81e1-a7a01cfab7d2 response_code = 200 uri = /crucible/0/regions/5974210c-41ae-4667-b206-8171012260ea
362024-09-23T18:27:51.610ZINFOcrucible-agent (datafile): path is "/data/regions/5974210c-41ae-4667-b206-8171012260ea"
372024-09-23T18:27:51.619ZINFOcrucible-agent (datafile): dataset is oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible/regions/5974210c-41ae-4667-b206-8171012260ea
382024-09-23T18:27:51.629ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible/regions/5974210c-41ae-4667-b206-8171012260ea@bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7
392024-09-23T18:27:51.629ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible/regions/5974210c-41ae-4667-b206-8171012260ea", "bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7"]
402024-09-23T18:27:51.637ZINFOcrucible-agent (dropshot): request completed latency_us = 27288 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48854 req_id = fe7f95d5-f35f-483a-b41d-8f373a93b7e5 response_code = 200 uri = /crucible/0/regions/5974210c-41ae-4667-b206-8171012260ea/snapshots/bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7
412024-09-23T18:27:51.640ZINFOcrucible-agent (datafile): path is "/data/regions/5974210c-41ae-4667-b206-8171012260ea"
422024-09-23T18:27:51.648ZINFOcrucible-agent (datafile): dataset is oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible/regions/5974210c-41ae-4667-b206-8171012260ea
432024-09-23T18:27:51.656ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible/regions/5974210c-41ae-4667-b206-8171012260ea@bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7
442024-09-23T18:27:51.656ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible/regions/5974210c-41ae-4667-b206-8171012260ea", "bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7"]
452024-09-23T18:27:51.665ZINFOcrucible-agent (datafile): requesting running snapshot 5974210c-41ae-4667-b206-8171012260ea-bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7 state: Requested
462024-09-23T18:27:51.665ZINFOcrucible-agent (worker): applying SMF actions for region 5974210c-41ae-4667-b206-8171012260ea running snapshot bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7 (state Requested)...
472024-09-23T18:27:51.665ZINFOcrucible-agent (dropshot): request completed latency_us = 25377 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48854 req_id = 428bc156-c5c5-4350-b0a2-60391e578173 response_code = 200 uri = /crucible/0/regions/5974210c-41ae-4667-b206-8171012260ea/snapshots/bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7/run
482024-09-23T18:27:51.678ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/5974210c-41ae-4667-b206-8171012260ea
492024-09-23T18:27:51.678ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
502024-09-23T18:27:51.678ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
512024-09-23T18:27:51.678ZINFOcrucible-agent (worker): reconfig required
522024-09-23T18:27:51.678ZINFOcrucible-agent (worker): using existing config property group
532024-09-23T18:27:51.678ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5974210c-41ae-4667-b206-8171012260ea
542024-09-23T18:27:51.679ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5974210c-41ae-4667-b206-8171012260ea
552024-09-23T18:27:51.681ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
562024-09-23T18:27:51.681ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
572024-09-23T18:27:51.681ZINFOcrucible-agent (worker): commit
582024-09-23T18:27:51.689ZINFOcrucible-agent (worker): ok!
592024-09-23T18:27:51.689ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-5974210c-41ae-4667-b206-8171012260ea-bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7
602024-09-23T18:27:51.693ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-5974210c-41ae-4667-b206-8171012260ea-bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7
612024-09-23T18:27:51.706ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-5974210c-41ae-4667-b206-8171012260ea-bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7
622024-09-23T18:27:51.706ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5974210c-41ae-4667-b206-8171012260ea/.zfs/snapshot/bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7
632024-09-23T18:27:51.706ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
642024-09-23T18:27:51.706ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
652024-09-23T18:27:51.706ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
662024-09-23T18:27:51.706ZINFOcrucible-agent (worker): commit
672024-09-23T18:27:51.711ZINFOcrucible-agent (worker): ok!
682024-09-23T18:27:51.715ZINFOcrucible-agent (worker): SMF ok!
692024-09-23T18:27:51.715ZINFOcrucible-agent (datafile): region 5974210c-41ae-4667-b206-8171012260ea running snapshot bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7 state: Requested -> Created
702024-09-23T18:27:51.827ZINFOcrucible-agent (datafile): path is "/data/regions/5974210c-41ae-4667-b206-8171012260ea"
712024-09-23T18:27:51.836ZINFOcrucible-agent (datafile): dataset is oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible/regions/5974210c-41ae-4667-b206-8171012260ea
722024-09-23T18:27:51.845ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible/regions/5974210c-41ae-4667-b206-8171012260ea@bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7
732024-09-23T18:27:51.845ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible/regions/5974210c-41ae-4667-b206-8171012260ea", "bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7"]
742024-09-23T18:27:51.853ZINFOcrucible-agent (dropshot): request completed latency_us = 25610 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48854 req_id = a9cc69c5-1dea-498e-9dd3-4c031f05fdd8 response_code = 200 uri = /crucible/0/regions/5974210c-41ae-4667-b206-8171012260ea/snapshots/bf6b8e04-a5bf-448b-a96c-5d70aa90f8a7/run
752024-09-23T18:27:55.649ZINFOcrucible-agent (datafile): region 327e9947-f7e1-4b97-92df-e5d731ca17a8 state: Requested
762024-09-23T18:27:55.650ZINFOcrucible-agent (dropshot): request completed latency_us = 257 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48854 req_id = d6536e9c-a4f5-4595-8c3b-cf6f363be20d response_code = 200 uri = /crucible/0/regions
772024-09-23T18:27:55.650ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
782024-09-23T18:27:55.660ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible/regions/327e9947-f7e1-4b97-92df-e5d731ca17a8
792024-09-23T18:27:55.660ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible/regions/327e9947-f7e1-4b97-92df-e5d731ca17a8
802024-09-23T18:27:55.734ZINFOcrucible-agent (worker): creating region Region { id: RegionId("327e9947-f7e1-4b97-92df-e5d731ca17a8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/327e9947-f7e1-4b97-92df-e5d731ca17a8" region = 327e9947-f7e1-4b97-92df-e5d731ca17a8
812024-09-23T18:27:55.734ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "327e9947-f7e1-4b97-92df-e5d731ca17a8" "--data" "/data/regions/327e9947-f7e1-4b97-92df-e5d731ca17a8" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 327e9947-f7e1-4b97-92df-e5d731ca17a8
822024-09-23T18:27:55.800ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48854 req_id = 40ead772-e133-49b8-a14a-80a8a4262486 response_code = 200 uri = /crucible/0/regions
832024-09-23T18:27:55.811ZINFOcrucible-agent (worker): region files created ok region = 327e9947-f7e1-4b97-92df-e5d731ca17a8
842024-09-23T18:27:55.811ZINFOcrucible-agent (datafile): region 327e9947-f7e1-4b97-92df-e5d731ca17a8 state: Requested -> Created
852024-09-23T18:27:55.811ZINFOcrucible-agent (worker): applying SMF actions post create...
862024-09-23T18:27:55.812ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-327e9947-f7e1-4b97-92df-e5d731ca17a8
872024-09-23T18:27:55.817ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-327e9947-f7e1-4b97-92df-e5d731ca17a8
882024-09-23T18:27:55.825ZINFOcrucible-agent (worker): creating config property group
892024-09-23T18:27:55.829ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-327e9947-f7e1-4b97-92df-e5d731ca17a8
902024-09-23T18:27:55.829ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/327e9947-f7e1-4b97-92df-e5d731ca17a8
912024-09-23T18:27:55.829ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
922024-09-23T18:27:55.829ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
932024-09-23T18:27:55.829ZINFOcrucible-agent (worker): commit
942024-09-23T18:27:55.834ZINFOcrucible-agent (worker): ok!
952024-09-23T18:27:55.840ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/5974210c-41ae-4667-b206-8171012260ea
962024-09-23T18:27:55.840ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
972024-09-23T18:27:55.840ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
982024-09-23T18:27:55.840ZINFOcrucible-agent (worker): reconfig required
992024-09-23T18:27:55.840ZINFOcrucible-agent (worker): using existing config property group
1002024-09-23T18:27:55.840ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5974210c-41ae-4667-b206-8171012260ea
1012024-09-23T18:27:55.844ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5974210c-41ae-4667-b206-8171012260ea
1022024-09-23T18:27:55.844ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1032024-09-23T18:27:55.844ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
1042024-09-23T18:27:55.844ZINFOcrucible-agent (worker): commit
1052024-09-23T18:27:55.849ZINFOcrucible-agent (worker): ok!
1062024-09-23T18:27:55.851ZINFOcrucible-agent (worker): SMF ok!
1072024-09-23T18:27:56.282ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48854 req_id = b63951c1-b141-4e37-b604-79935e7e115f response_code = 200 uri = /crucible/0/regions
1082024-09-23T18:28:20.245ZINFOcrucible-agent (dropshot): request completed latency_us = 388 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48854 req_id = 04a7d061-6e7e-4e7b-9046-d3c3cdd2cd3c response_code = 200 uri = /crucible/0/regions/327e9947-f7e1-4b97-92df-e5d731ca17a8
1092024-09-23T18:28:20.248ZINFOcrucible-agent (datafile): path is "/data/regions/327e9947-f7e1-4b97-92df-e5d731ca17a8"
1102024-09-23T18:28:20.260ZINFOcrucible-agent (datafile): dataset is oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible/regions/327e9947-f7e1-4b97-92df-e5d731ca17a8
1112024-09-23T18:28:20.270ZINFOcrucible-agent (datafile): region 327e9947-f7e1-4b97-92df-e5d731ca17a8 state: Created -> Tombstoned
1122024-09-23T18:28:20.270ZINFOcrucible-agent (worker): applying SMF actions before removal...
1132024-09-23T18:28:20.270ZINFOcrucible-agent (dropshot): request completed latency_us = 22209 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:48854 req_id = df614139-8697-4a26-9ac6-39e05168f7d1 response_code = 204 uri = /crucible/0/regions/327e9947-f7e1-4b97-92df-e5d731ca17a8
1142024-09-23T18:28:20.271ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-327e9947-f7e1-4b97-92df-e5d731ca17a8 (instance states: (Some(Online), None))
1152024-09-23T18:28:20.273ZINFOcrucible-agent (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48854 req_id = 4c89481e-a837-4c69-928a-4baf20261149 response_code = 200 uri = /crucible/0/regions/327e9947-f7e1-4b97-92df-e5d731ca17a8
1162024-09-23T18:28:20.277ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/5974210c-41ae-4667-b206-8171012260ea
1172024-09-23T18:28:20.277ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1182024-09-23T18:28:20.277ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
1192024-09-23T18:28:20.277ZINFOcrucible-agent (worker): reconfig required
1202024-09-23T18:28:20.277ZINFOcrucible-agent (worker): using existing config property group
1212024-09-23T18:28:20.277ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5974210c-41ae-4667-b206-8171012260ea
1222024-09-23T18:28:20.277ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5974210c-41ae-4667-b206-8171012260ea
1232024-09-23T18:28:20.277ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1242024-09-23T18:28:20.277ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
1252024-09-23T18:28:20.277ZINFOcrucible-agent (worker): commit
1262024-09-23T18:28:20.282ZINFOcrucible-agent (worker): ok!
1272024-09-23T18:28:20.284ZINFOcrucible-agent (worker): SMF ok!
1282024-09-23T18:28:20.297ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_1f7ede35-40db-4a1a-8087-fc87b6705700/crucible/regions/327e9947-f7e1-4b97-92df-e5d731ca17a8" region = 327e9947-f7e1-4b97-92df-e5d731ca17a8
1292024-09-23T18:28:20.340ZINFOcrucible-agent (dropshot): request completed latency_us = 89 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48854 req_id = 1371b480-20c5-471c-9faf-c3b508816b4a response_code = 200 uri = /crucible/0/regions/327e9947-f7e1-4b97-92df-e5d731ca17a8
1302024-09-23T18:28:20.365ZINFOcrucible-agent (datafile): region 327e9947-f7e1-4b97-92df-e5d731ca17a8 state: Tombstoned -> Destroyed
1312024-09-23T18:28:20.482ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48854 req_id = 3080b523-ba6f-4c26-8ff5-f85ea7d8f6bd response_code = 200 uri = /crucible/0/regions/327e9947-f7e1-4b97-92df-e5d731ca17a8