Max level shown:
1 [ Jul 16 03:48:47 Enabled. ]
2 [ Jul 16 03:48:47 Rereading configuration. ]
3 [ Jul 16 03:48:49 Rereading configuration. ]
4 [ Jul 16 03:48:53 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_ce236cd3-1211-4ed1-b293-f36094cd8259/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-07-16T03:48:53.449ZINFOcrucible-agent: dataset: "oxp_ce236cd3-1211-4ed1-b293-f36094cd8259/crucible"
72024-07-16T03:48:53.453ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
82024-07-16T03:48:53.453ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-07-16T03:48:53.473ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-07-16T03:48:53.626ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
112024-07-16T03:50:09.409ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:33932
122024-07-16T03:50:09.430ZINFOcrucible-agent (datafile): region 92c00360-cfdb-42cd-9ddd-6d1f24359322 state: Requested
132024-07-16T03:50:09.439ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142024-07-16T03:50:09.439ZINFOcrucible-agent (dropshot): request completed latency_us = 17952 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33932 req_id = 4319ec39-cb00-4dd3-95e1-62e377cfe15d response_code = 200 uri = /crucible/0/regions
152024-07-16T03:50:09.452ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ce236cd3-1211-4ed1-b293-f36094cd8259/crucible/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322
162024-07-16T03:50:09.452ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ce236cd3-1211-4ed1-b293-f36094cd8259/crucible/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322
172024-07-16T03:50:09.499ZINFOcrucible-agent (worker): creating region Region { id: RegionId("92c00360-cfdb-42cd-9ddd-6d1f24359322"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322" region = 92c00360-cfdb-42cd-9ddd-6d1f24359322
182024-07-16T03:50:09.501ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "92c00360-cfdb-42cd-9ddd-6d1f24359322" "--data" "/data/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 92c00360-cfdb-42cd-9ddd-6d1f24359322
192024-07-16T03:50:09.626ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33932 req_id = 9c4c0f8f-e38e-4a17-8c28-a71476335542 response_code = 200 uri = /crucible/0/regions
202024-07-16T03:50:09.658ZINFOcrucible-agent (worker): region files created ok region = 92c00360-cfdb-42cd-9ddd-6d1f24359322
212024-07-16T03:50:09.658ZINFOcrucible-agent (datafile): region 92c00360-cfdb-42cd-9ddd-6d1f24359322 state: Requested -> Created
222024-07-16T03:50:09.658ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-07-16T03:50:09.659ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-92c00360-cfdb-42cd-9ddd-6d1f24359322
242024-07-16T03:50:09.665ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-92c00360-cfdb-42cd-9ddd-6d1f24359322
252024-07-16T03:50:09.678ZINFOcrucible-agent (worker): creating config property group
262024-07-16T03:50:09.681ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-92c00360-cfdb-42cd-9ddd-6d1f24359322
272024-07-16T03:50:09.682ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322
282024-07-16T03:50:09.686ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-07-16T03:50:09.686ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
302024-07-16T03:50:09.686ZINFOcrucible-agent (worker): commit
312024-07-16T03:50:09.700ZINFOcrucible-agent (worker): ok!
322024-07-16T03:50:09.707ZINFOcrucible-agent (worker): SMF ok!
332024-07-16T03:50:10.273ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:32870
342024-07-16T03:50:10.273ZINFOcrucible-agent (dropshot): request completed latency_us = 88 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:32870 req_id = bb1d85a0-a591-4149-8206-46c4f0944c6f response_code = 200 uri = /crucible/0/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322
352024-07-16T03:50:10.365ZINFOcrucible-agent (dropshot): request completed latency_us = 605 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33932 req_id = f54f35b5-2af9-48b5-a15c-06d0ac3a711e response_code = 200 uri = /crucible/0/regions
362024-07-16T03:55:28.690ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:42391
372024-07-16T03:55:28.690ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42391 req_id = 38ffe67b-2c13-43ea-a73d-e907e142f839 response_code = 200 uri = /crucible/0/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322
382024-07-16T03:55:28.693ZINFOcrucible-agent (datafile): path is "/data/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322"
392024-07-16T03:55:28.702ZINFOcrucible-agent (datafile): dataset is oxp_ce236cd3-1211-4ed1-b293-f36094cd8259/crucible/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322
402024-07-16T03:55:28.711ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ce236cd3-1211-4ed1-b293-f36094cd8259/crucible/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322@8546765b-299a-4074-b332-a3f1ba0d9bb8
412024-07-16T03:55:28.711ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ce236cd3-1211-4ed1-b293-f36094cd8259/crucible/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322", "8546765b-299a-4074-b332-a3f1ba0d9bb8"]
422024-07-16T03:55:28.722ZINFOcrucible-agent (dropshot): request completed latency_us = 31412 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42391 req_id = 45785f9b-0411-459b-8407-15477722a1bb response_code = 200 uri = /crucible/0/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322/snapshots/8546765b-299a-4074-b332-a3f1ba0d9bb8
432024-07-16T03:55:28.722ZINFOcrucible-agent (datafile): path is "/data/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322"
442024-07-16T03:55:28.730ZINFOcrucible-agent (datafile): dataset is oxp_ce236cd3-1211-4ed1-b293-f36094cd8259/crucible/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322
452024-07-16T03:55:28.738ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ce236cd3-1211-4ed1-b293-f36094cd8259/crucible/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322@8546765b-299a-4074-b332-a3f1ba0d9bb8
462024-07-16T03:55:28.738ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ce236cd3-1211-4ed1-b293-f36094cd8259/crucible/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322", "8546765b-299a-4074-b332-a3f1ba0d9bb8"]
472024-07-16T03:55:28.748ZINFOcrucible-agent (datafile): requesting running snapshot 92c00360-cfdb-42cd-9ddd-6d1f24359322-8546765b-299a-4074-b332-a3f1ba0d9bb8 state: Requested
482024-07-16T03:55:28.749ZINFOcrucible-agent (worker): applying SMF actions for region 92c00360-cfdb-42cd-9ddd-6d1f24359322 running snapshot 8546765b-299a-4074-b332-a3f1ba0d9bb8 (state Requested)...
492024-07-16T03:55:28.749ZINFOcrucible-agent (dropshot): request completed latency_us = 26776 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42391 req_id = b91cc650-0251-48d5-9ebe-ad9ddd62b13a response_code = 200 uri = /crucible/0/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322/snapshots/8546765b-299a-4074-b332-a3f1ba0d9bb8/run
502024-07-16T03:55:28.757ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322
512024-07-16T03:55:28.757ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
522024-07-16T03:55:28.757ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
532024-07-16T03:55:28.757ZINFOcrucible-agent (worker): reconfig required
542024-07-16T03:55:28.757ZINFOcrucible-agent (worker): using existing config property group
552024-07-16T03:55:28.757ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-92c00360-cfdb-42cd-9ddd-6d1f24359322
562024-07-16T03:55:28.757ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322
572024-07-16T03:55:28.757ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
582024-07-16T03:55:28.757ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
592024-07-16T03:55:28.757ZINFOcrucible-agent (worker): commit
602024-07-16T03:55:28.766ZINFOcrucible-agent (worker): ok!
612024-07-16T03:55:28.767ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-92c00360-cfdb-42cd-9ddd-6d1f24359322-8546765b-299a-4074-b332-a3f1ba0d9bb8
622024-07-16T03:55:28.776ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-92c00360-cfdb-42cd-9ddd-6d1f24359322-8546765b-299a-4074-b332-a3f1ba0d9bb8
632024-07-16T03:55:28.797ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-92c00360-cfdb-42cd-9ddd-6d1f24359322-8546765b-299a-4074-b332-a3f1ba0d9bb8
642024-07-16T03:55:28.797ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322/.zfs/snapshot/8546765b-299a-4074-b332-a3f1ba0d9bb8
652024-07-16T03:55:28.797ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
662024-07-16T03:55:28.797ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
672024-07-16T03:55:28.797ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
682024-07-16T03:55:28.797ZINFOcrucible-agent (worker): commit
692024-07-16T03:55:28.801ZINFOcrucible-agent (worker): ok!
702024-07-16T03:55:28.809ZINFOcrucible-agent (worker): SMF ok!
712024-07-16T03:55:28.809ZINFOcrucible-agent (datafile): region 92c00360-cfdb-42cd-9ddd-6d1f24359322 running snapshot 8546765b-299a-4074-b332-a3f1ba0d9bb8 state: Requested -> Created
722024-07-16T03:55:31.664ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:49203
732024-07-16T03:55:31.664ZINFOcrucible-agent (datafile): region d4b25bfe-ee64-4645-a42f-d440b640d9e6 state: Requested
742024-07-16T03:55:31.666ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
752024-07-16T03:55:31.666ZINFOcrucible-agent (dropshot): request completed latency_us = 2466 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49203 req_id = df5fe6ab-7948-4b52-b220-ddba83572600 response_code = 200 uri = /crucible/0/regions
762024-07-16T03:55:31.676ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ce236cd3-1211-4ed1-b293-f36094cd8259/crucible/regions/d4b25bfe-ee64-4645-a42f-d440b640d9e6
772024-07-16T03:55:31.676ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ce236cd3-1211-4ed1-b293-f36094cd8259/crucible/regions/d4b25bfe-ee64-4645-a42f-d440b640d9e6
782024-07-16T03:55:31.743ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d4b25bfe-ee64-4645-a42f-d440b640d9e6"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d4b25bfe-ee64-4645-a42f-d440b640d9e6" region = d4b25bfe-ee64-4645-a42f-d440b640d9e6
792024-07-16T03:55:31.745ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d4b25bfe-ee64-4645-a42f-d440b640d9e6" "--data" "/data/regions/d4b25bfe-ee64-4645-a42f-d440b640d9e6" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d4b25bfe-ee64-4645-a42f-d440b640d9e6
802024-07-16T03:55:31.828ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49203 req_id = 2f7fc143-bb4d-4406-a7c5-25899c81a8c9 response_code = 200 uri = /crucible/0/regions
812024-07-16T03:55:31.861ZINFOcrucible-agent (worker): region files created ok region = d4b25bfe-ee64-4645-a42f-d440b640d9e6
822024-07-16T03:55:31.862ZINFOcrucible-agent (datafile): region d4b25bfe-ee64-4645-a42f-d440b640d9e6 state: Requested -> Created
832024-07-16T03:55:31.862ZINFOcrucible-agent (worker): applying SMF actions post create...
842024-07-16T03:55:31.862ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322
852024-07-16T03:55:31.862ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
862024-07-16T03:55:31.862ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
872024-07-16T03:55:31.862ZINFOcrucible-agent (worker): reconfig required
882024-07-16T03:55:31.863ZINFOcrucible-agent (worker): using existing config property group
892024-07-16T03:55:31.863ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-92c00360-cfdb-42cd-9ddd-6d1f24359322
902024-07-16T03:55:31.863ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322
912024-07-16T03:55:31.863ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
922024-07-16T03:55:31.863ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
932024-07-16T03:55:31.863ZINFOcrucible-agent (worker): commit
942024-07-16T03:55:31.872ZINFOcrucible-agent (worker): ok!
952024-07-16T03:55:31.873ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d4b25bfe-ee64-4645-a42f-d440b640d9e6
962024-07-16T03:55:31.887ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d4b25bfe-ee64-4645-a42f-d440b640d9e6
972024-07-16T03:55:31.929ZINFOcrucible-agent (worker): creating config property group
982024-07-16T03:55:31.939ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d4b25bfe-ee64-4645-a42f-d440b640d9e6
992024-07-16T03:55:31.939ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d4b25bfe-ee64-4645-a42f-d440b640d9e6
1002024-07-16T03:55:31.939ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1012024-07-16T03:55:31.940ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
1022024-07-16T03:55:31.940ZINFOcrucible-agent (worker): commit
1032024-07-16T03:55:31.946ZINFOcrucible-agent (worker): ok!
1042024-07-16T03:55:31.954ZINFOcrucible-agent (worker): SMF ok!
1052024-07-16T03:55:32.160ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49203 req_id = 789ad15d-90e8-4c8f-a7ce-293c4c0de90d response_code = 200 uri = /crucible/0/regions
1062024-07-16T03:55:56.926ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49203 req_id = 309d1951-5c1e-448f-ae18-578963db1a75 response_code = 200 uri = /crucible/0/regions/d4b25bfe-ee64-4645-a42f-d440b640d9e6
1072024-07-16T03:55:56.929ZINFOcrucible-agent (datafile): path is "/data/regions/d4b25bfe-ee64-4645-a42f-d440b640d9e6"
1082024-07-16T03:55:56.940ZINFOcrucible-agent (datafile): dataset is oxp_ce236cd3-1211-4ed1-b293-f36094cd8259/crucible/regions/d4b25bfe-ee64-4645-a42f-d440b640d9e6
1092024-07-16T03:55:56.948ZINFOcrucible-agent (datafile): region d4b25bfe-ee64-4645-a42f-d440b640d9e6 state: Created -> Tombstoned
1102024-07-16T03:55:56.948ZINFOcrucible-agent (worker): applying SMF actions before removal...
1112024-07-16T03:55:56.948ZINFOcrucible-agent (dropshot): request completed latency_us = 19722 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:49203 req_id = c7e9e7c0-586a-44c9-94f7-cf1c2365dd34 response_code = 204 uri = /crucible/0/regions/d4b25bfe-ee64-4645-a42f-d440b640d9e6
1122024-07-16T03:55:56.949ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-d4b25bfe-ee64-4645-a42f-d440b640d9e6 (instance states: (Some(Online), None))
1132024-07-16T03:55:56.952ZINFOcrucible-agent (dropshot): request completed latency_us = 526 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49203 req_id = ea23ba7a-336e-421c-abad-f1379ffb754b response_code = 200 uri = /crucible/0/regions/d4b25bfe-ee64-4645-a42f-d440b640d9e6
1142024-07-16T03:55:56.958ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322
1152024-07-16T03:55:56.958ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1162024-07-16T03:55:56.958ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
1172024-07-16T03:55:56.958ZINFOcrucible-agent (worker): reconfig required
1182024-07-16T03:55:56.958ZINFOcrucible-agent (worker): using existing config property group
1192024-07-16T03:55:56.958ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-92c00360-cfdb-42cd-9ddd-6d1f24359322
1202024-07-16T03:55:56.958ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/92c00360-cfdb-42cd-9ddd-6d1f24359322
1212024-07-16T03:55:56.959ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1222024-07-16T03:55:56.959ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
1232024-07-16T03:55:56.959ZINFOcrucible-agent (worker): commit
1242024-07-16T03:55:56.965ZINFOcrucible-agent (worker): ok!
1252024-07-16T03:55:56.967ZINFOcrucible-agent (worker): SMF ok!
1262024-07-16T03:55:56.976ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_ce236cd3-1211-4ed1-b293-f36094cd8259/crucible/regions/d4b25bfe-ee64-4645-a42f-d440b640d9e6" region = d4b25bfe-ee64-4645-a42f-d440b640d9e6
1272024-07-16T03:55:57.027ZINFOcrucible-agent (datafile): region d4b25bfe-ee64-4645-a42f-d440b640d9e6 state: Tombstoned -> Destroyed
1282024-07-16T03:55:57.088ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49203 req_id = c86ebeaa-4fdc-4776-8278-95dabef3cbb4 response_code = 200 uri = /crucible/0/regions/d4b25bfe-ee64-4645-a42f-d440b640d9e6